Marco Mascorro
@Mascobot
Congrats @chem_safety & @Ning_Catsnail on the launch of 🥕Karotte!
Building robust and secure RL environments is more important than ever these days because the current bottleneck on AI progress is misalignment, and developing aligned models requires robust, correct reward
Building robust and secure RL environments is more important than ever these days because the current bottleneck on AI progress is misalignment, and developing aligned models requires robust, correct reward
Jennifer Zhou@chem_safety · Oct 7Today we are open-sourcing 🥕Karotte, our framework for building RL environments.
We've used it for the past year to build MLE RL environments for frontier labs, and it's been hardened through 1M+ evaluation runs and red-teaming.
We've used it for the past year to build MLE RL environments for frontier labs, and it's been hardened through 1M+ evaluation runs and red-teaming.
Open quoted post →
3 23