Its been no secret that benchmarking has long been outpaced vastly recently by model improvements, but the infrastructure around it breaking means raw performance becomes more unwieldy and expensive to measure.

The slowdown in infrastructure to benchmark/eval effectively is the