Alvin Sng
@alvinsng
The model providers optimize for raw benchmark scores or they optimize for price per token. Neither captures what customers actually care about: the cost to efficiently complete the work that actually exists.
That’s why we built Legacy: a benchmark representative of the real
That’s why we built Legacy: a benchmark representative of the real
Factory@FactoryAI · Sep 24Today, our benchmark, Legacy-Bench, joins @FireworksAI_HQ’s Specialized Intelligence Index.
Frontier models have blind spots for legacy code, what’s benchmarked is improved. Legacy-Bench tests how well AI models can debug, extend, and migrate historic systems, to drive the
Frontier models have blind spots for legacy code, what’s benchmarked is improved. Legacy-Bench tests how well AI models can debug, extend, and migrate historic systems, to drive the
Open quoted post →
3 12