Stone Tao
@Stone_Tao
have a draft blog about robotics benchmarking. Originally was going to talk more about sim eval design but maybe I should pivot to just talk about “what should be benchmarked”
some benchmarks are good, but some are just pure distraction atm (eg this particular test)
some benchmarks are good, but some are just pure distraction atm (eg this particular test)
Ahmet S Asarkaya@asark38 · Oct 3With all due respect, I'm really having hard time to time see benefits of this types of benchmarks at this stage of the Physical AI.
I don't think it provides a strong signal for us, feels more like a distraction at this stage 🤔
Open quoted post →I don't think it provides a strong signal for us, feels more like a distraction at this stage 🤔
9 114