Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Action-Consistency Transfer Matrix (ATM), a novel diagnostic tool for evaluating latent world models used in control and goal-conditioned planning. By comparing action information in real and model-predicted transitions, ATM provides a lightweight, interpretable matrix that reveals representation quality and inconsistency without the need for extensive simulator rollouts. The method achieves over 100x speedup in evaluation time while maintaining reliable pairwise ranking of models, and it also demonstrates that action-identifiability can enhance training for improved planning performance.
Action-Consistency Transfer Matrix (ATM) offers a game-changing 100x speedup in evaluating latent world models, transforming how we diagnose and improve planning representations.
Latent world models are increasingly used for control and goal-conditioned planning, yet assessing whether their learned representations are useful for planning usually requires slow, planner-coupled simulator evaluation with CEM or similar planners. Such evaluation is black-box and model-complexity-dependent: under the same protocol, different world models may require minutes to hours per checkpoint. In this work, we propose ATM, an Action-Consistency Transfer Matrix for diagnosing whether latent transitions preserve action semantics relevant to planning. ATM compares action information in real encoded transitions and model-predicted transitions through lightweight post-hoc probes, producing an interpretable matrix that reveals representation quality, transition-domain inconsistency, and failure modes without simulator rollout. It can also be collapsed into a simple screening score for within-task ranking across checkpoints, variants, and world models. When the true success gap is non-trivial, ATM achieves highly reliable pairwise ranking, while reducing minutes-to-hours CEM evaluation to seconds-level transition analysis, yielding more than 100x speedup in our setup. We further introduce AITS, showing that action-identifiability is not only diagnostic but also a useful training signal for improving downstream planning without changing the planner.