Google: Towards 3D Foundational Robotics Models

Transformers have completely changed the landscape of Robotics, becoming main computational backbones of the generalist robotics models, capable of solving a variety of tasks across several embodiments and enviromental conditions. However designing foundational robotics architectures that can create efficient explicit or implicit 3D models of the surrounding environment and leverage them for optimal control is still work in progress and an exciting research direction. In this EXPO session, we will discuss progress made on this subject in last few years, bring panelists who are experts in the field to brainstorm new methods (e.g. particle-based world models for robotics) and discuss the impact of this research on robotics in a few years from now.