Russell Kaplan
@russelljkaplan
New hardest coding eval just dropped. Let’s see how long it takes to saturate.
Cognition@cognition · Jun 8Introducing FrontierCode: a coding eval that raises the bar for difficulty & quality. Each task took 40+ hrs of work by leading open-source maintainers.
Models write sloppy code that works but isn’t maintainable. Our eval is first to measure: would you actually merge this code?
Models write sloppy code that works but isn’t maintainable. Our eval is first to measure: would you actually merge this code?
Open quoted post →
6 107