Search papers, labs, and topics across Lattice.
Camera-conditioned world models require simultaneous evaluation of physical action execution and temporal visual fidelity, yet existing rewards treat geometry and appearance in isolation while monolithic VLM evaluation dilutes localized action cues. WorldReward addresses this by decomposing video pairs into action-aligned temporal chunks, extracting structured local visual evidence, and aggregating chunk-level VLM decisions into decoupled preferences for action consistency and visual quality. Benchmarked on human evaluations, the model surpasses GPT-5.5 across action, appearance, and motion consistency metrics while successfully driving RL post-training improvements in HY-WorldPlay 1.5.
Monolithic video evaluation dilutes critical action cues, but chunking interactive rollouts into action-aligned visual evidence allows targeted reward models to outperform GPT-5.5 at scoring world model dynamics.
Camera-conditioned world models generate interactive videos in which commanded actions should induce the expected scene changes while appearance, geometry, and temporal dynamics remain coherent. Existing rewards assess these requirements separately: geometry-based rewards estimate trajectory execution but cannot judge the visual quality of the executed motion, whereas image-based rewards measure frame quality without capturing action execution or temporal dynamics. We posit that a vision-language model (VLM) offers a shared reasoning space for relating actions to their visual outcomes. However, judging a complete long video against its full action sequence creates a lengthy, noisy context in which short-lived local action evidence can be missed or diluted. We present WorldReward, a VLM-based pairwise preference reward model that unifies action-consistency and visual-quality evaluation for camera-conditioned world models. WorldReward decomposes paired videos into action-aligned chunks, organizes each chunk into structured visual evidence, and aggregates chunk-level decisions by voting into separate video-level action and visual-quality preferences. To train it, we construct a large-scale reasoning-augmented preference dataset using structured judgments generated by a frontier VLM and refined through tool-based agent auditing and targeted human review. We further introduce WorldReward-Bench, a human-annotated benchmark measuring reward-model agreement with human preferences across action consistency, appearance quality, and motion quality. WorldReward achieves the highest agreement on all three dimensions, exceeding GPT-5.5 by 3.42, 1.45, and 3.56 percentage points, respectively. When used for RL post-training of HY-WorldPlay 1.5, it consistently improves both action execution and visual quality across short- to long-term horizons.
