What does @Microsoft do when they can’t win a benchmark? Leave out whoever beat them 😄
The launch chart is built on JevBench but skips Sage by @LevantoLabs, #1 in the API category where Microsoft, OpenAI and Jev compete.
@satyanadella, this is not fair.
Here’s the real chart: benchmarkheaven.com/jev-models/api
The launch chart is built on JevBench but skips Sage by @LevantoLabs, #1 in the API category where Microsoft, OpenAI and Jev compete.
@satyanadella, this is not fair.
Here’s the real chart: benchmarkheaven.com/jev-models/api
Satya Nadella@satyanadella · 17hIntroducing Microsoft-Decision-1, our new model for fast decision-making.
It delivers top performance on structured decision tasks, outperforming both LLMs and other decision models in latency and quality.
We’re already testing it across Microsoft for everything from incident response and quality control to scientific discovery.
It delivers top performance on structured decision tasks, outperforming both LLMs and other decision models in latency and quality.
We’re already testing it across Microsoft for everything from incident response and quality control to scientific discovery.
2 1 0 8 501 0
Big Iron Chris
Unbefallen
Levanto Labs
Celeste Ang
Massimo
Amos Meiri
quirq
Tibo
erik.eth 🛡