Search papers, labs, and topics across Lattice.
This paper introduces RoboTrustBench, a comprehensive benchmark designed to evaluate the trustworthiness of video world models in robotic manipulation across four challenging scenarios: Normal, Constraint-Sensitive, Counterfactual, and Adversarial. The benchmark comprises 1,207 expert-validated instruction-image pairs and employs a six-dimensional evaluation protocol with 13 criteria to assess model performance. The evaluation reveals that while current models excel in generating visually coherent outputs, they significantly falter in areas such as constraint reasoning and unsafe-instruction suppression, highlighting the inadequacy of visual quality as a sole measure of trustworthiness.
Current video world models may look good on the surface, but they fail to handle critical reasoning tasks, revealing a gap in trustworthiness that could jeopardize robotic manipulation safety.
Video world models are increasingly used in robotic manipulation, yet existing benchmarks mostly evaluate them under valid, feasible, and safe instructions. We introduce RoboTrustBench, a benchmark for evaluating the trustworthiness of video world models under four scenarios: Normal, Constraint-Sensitive, Counterfactual, and Adversarial. Built from real-world DROID episodes, RoboTrustBench contains 1,207 expert-validated instruction-image pairs and a six-dimensional evaluation protocol with 13 fine-grained criteria. Evaluating seven representative video world models with human and MLLM assessment, we find that current models often generate visually coherent videos, but struggle with constraint reasoning, counterfactual grounding, physical interaction, and unsafe-instruction suppression. These results show that visual quality and surface-level instruction following are insufficient for trustworthy robotic video world modeling.
Tsinghua AI