Kenny Workman
@kenbwork
Biology benchmarks must evolve with agent capabilities and behavior. We updated benchmarks.bio after observing agents investigate benchmark identities, browse unrelated material and supply fabricated API contact details.
The update includes:
- Restricted or disabled
The update includes:
- Restricted or disabled
benchmarks.biobenchmarks.bio — Agentic benchmarks on real-world biological data
arjun@arjunomics · Sep 23on the latest misalignment we've observed & our efforts to combat it! x.com/i/article/2102…
Open quoted post → 2 42