Search papers, labs, and topics across Lattice.
This paper introduces RoboWorld, an automated evaluation pipeline that integrates a fast autoregressive video world model with a vision-language model to enhance the reliability of evaluating generalist robot policies. The method addresses the challenges of world-model errors and slow inference by employing a novel technique called Step Forcing, which mitigates train-test mismatch while maintaining action-observation dynamics. As a result, RoboWorld achieves a high correlation with real-world robot evaluations, evidenced by Pearson's r = 0.989 and Spearman's 蟻 = 0.970, demonstrating its effectiveness across various tasks and environments.
Achieving a near-perfect alignment with real-world robot evaluations, RoboWorld redefines how we assess generalist robot policies in simulated environments.
Video world models are emerging as a scalable alternative for evaluating generalist robot policies, bypassing the physical constraints and engineering burdens of real-world deployment. However, evaluating policies with video world models remains challenging, as world-model errors can make generated rollouts unreliable and slow inference limits large-scale throughput. We introduce RoboWorld, an automated evaluation pipeline that pairs a fast autoregressive video world model with a task-progress-aware vision-language model scoring. To enable reliable long-horizon autoregressive world-model rollouts, we propose Step Forcing, which combines anchored and one-step self-forwarded contexts to reduce train--test mismatch while preserving action--observation dynamics. Together, these components enable RoboWorld to align strongly with real-world robot evaluation across tasks and environments, achieving Pearson's r = 0.989 and Spearman's \r{ho} = 0.970.
