Hongsuk Benjamin Choi
@redstone_hong
amazing! where are the humans resetting the scenes before rollouts?
Nicolas Keller@Nicolas_Keller · Sep 29The Era of Evals is coming to AI robotics.
Today we’re launching Reality Check: our leaderboard & first public robot manipulation benchmark.
14,400 real-world rollouts. Four models. Multiple tasks & data regimes. Object placements. Confidence intervals. FR3 Duo stations.
1/10
Today we’re launching Reality Check: our leaderboard & first public robot manipulation benchmark.
14,400 real-world rollouts. Four models. Multiple tasks & data regimes. Object placements. Confidence intervals. FR3 Duo stations.
1/10
1 28