Grace Li
@grx_xce
Two ships for you today...
1) Audio Arena by @intelligence_ai: real-time, real-world conversations, evaluated at scale.
2) Conversation Bench (v1): SOTA benchmark for realistic S2S conversations. 75 turns with tool calls.
Starting with S2S models from @ultravox_dot_ai, @OpenAI,
1) Audio Arena by @intelligence_ai: real-time, real-world conversations, evaluated at scale.
2) Conversation Bench (v1): SOTA benchmark for realistic S2S conversations. 75 turns with tool calls.
Starting with S2S models from @ultravox_dot_ai, @OpenAI,
9 35