Mustafa Mukadam
@mukadammh
Visuo-tactile world models!
With touch we incorporate physical understanding in action conditioned WMs
During fine manipulation objects don't disappear and only move under contact; planning with WM also achieves higher success rates on new tasks
Led by @carohiguerarias 🧵👇
With touch we incorporate physical understanding in action conditioned WMs
During fine manipulation objects don't disappear and only move under contact; planning with WM also achieves higher success rates on new tasks
Led by @carohiguerarias 🧵👇
Carolina Higuera@carohiguerarias · Feb 27Most world models for robot manipulation learn physics from pixels. But pixels don’t see it all.
Can we ground these models in the "feeling" of contact to disambiguate visually identical states?
Visuo-Tactile World Models (VT-WM): robot imagination in a shared space👇
Can we ground these models in the "feeling" of contact to disambiguate visually identical states?
Visuo-Tactile World Models (VT-WM): robot imagination in a shared space👇
0:21 0 32