GreenWAM: A World Foundation Model for Robotics
AuthorsGennady Sidorov, Valerii Kornilov, Denis Grankin, Polina Fedotova, Aleksey Postnikov
AffiliationsBrain Team, Sber Robotics Center
GreenWAM aims to give many kinds of robots one shared model that can both predict what actions will do and choose actions to perform.
Key results
Embodiments covered by GreenWAM’s shared action interface.
Shared joint-coordinate slots for mapping robot layouts.
GreenWAM’s score, leading the compared world–action models.
Success rate on perturbed episodes without LIBERO-plus training.
Instruction success for the GreenWAM teacher on the real humanoid.
Factor faster than the unoptimized policy.
What the paper found
GreenWAM turns NVIDIA’s Cosmos 3 Edge 4B into a robotics foundation model that can both predict action-conditioned video and control robots. Its central innovation is a shared anatomical interface with 79 joint-coordinate slots, mapping 20 robot families into one action space; training across seven visual, action-conditioned, and joint video–action modes lets one model support both prediction and policy learning. On WorldArena 1.0, GreenWAM achieves 56.0 trajectory accuracy and 98.2 depth accuracy, leading the compared world–action models on both measures. The same foundation reaches 86.8% zero-shot success on LIBERO-plus, and on a real humanoid it succeeds on 95.6% of in-distribution instructions, ahead of policies adapted from Cosmos 3 Edge and π0.5. For faster control, the team distills the policy into a single-step student that runs 12.32 times faster than the unoptimized policy. Ablations show that robot-specialized training helps prediction and control, splitting off an action expert improves policy success, and retaining world-model training modes raises randomized-scene success by 8.0%.
Original abstract
A robot needs a world model that predicts how its actions will change the scene and a policy that chooses those actions. Models are usually built and evaluated for only one of these roles, and every robot records its actions in its own format. We ask whether one robot world model can serve both roles across different bodies, and what makes this work. We present GreenWAM, a world foundation model for robotics, together with the recipe that produces it: (1) a shared anatomical action space that describes 20 robot families, from bimanual arms to dexterous humanoids, in common joint coordinates; (2) joint training on these families in visual, action-conditioned and world-action modes; and (3) policies that split an action expert off the generator. As a world model, GreenWAM attains top-tier trajectory, depth and 3D accuracy on WorldArena 1.0, ahead of every world-action model and video generator in our comparison. As a policy, it scores among the top entries of the RoboTwin 2.0 leaderboard, reaches the highest zero-shot LIBERO-plus success among the compared methods and is competitive with dedicated vision-language-action and world-action policies on CALVIN and LIBERO. We further adapt GreenWAM to a real humanoid, where it succeeds more often than policies adapted from $π_{0.5}$ and from Cosmos 3 Edge, and distill it into a single-step policy for real-time control. Controlled experiments yield three findings: robot specialization improves world prediction and control together; an action expert helps when split off at the start of adaptation; and keeping world-model modes during policy adaptation preserves robustness to scene changes.
Read the original paperMore in World Models
Browse all 44 papers →Ropedia W0: Scaling Loco-Manipulation World Models across Embodiments with Human Experience
Tianqi Liu, Hanfei Zhao, Qifeng Liang, Hui En Pang, Jiarui Xu, Sayang Mu, Penghao Qiu, YingSheng Zhang, Jun Wang, Ziang Cao, Mingze Sun, Yukang Cao, Fangzhou Hong, Zhaoxi Chen, Ziwei Liu
Ropedia W0 learns to predict movement and manipulation across humans and robots by training on thousands of hours of egocentric experience.
WOVEN: Weaving Visual World Modeling into Multimodal LLMs
Zheyu Fan, Yue Zhang, Mingkai Deng, Kangrui Wang, Qineng Wang, Canyu Chen, Jie Hao, Xing Fan, Chenlei Guo, Eric P. Xing, Mohit Bansal, Manling Li
WOVEN trains multimodal models to reason about how visual scenes change, aiming to improve performance across many embodied and temporal tasks.
4Director: Controlling Video World Models with Rigid 3D Geometry
Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R, Shimon Vainer, Mark Boss, Yaoyao Liu
4Director makes video world models controllable by moving explicit 3D meshes through time while preserving realistic, consistent appearances.