Search papers, labs, and topics across Lattice.
This paper investigates the relationship between latent space properties and planning success in world models by comparing two regularization loss functions, SIGReg and VISReg. While SIGReg is beneficial for self-supervised learning, it does not enhance planning performance, whereas VISReg significantly improves planning success on out-of-domain datasets. The authors introduce VIScore, a new metric that quantifies the reachability and capacity of predictors, demonstrating its superior correlation with planning success rates compared to existing metrics, achieving a Spearman correlation over 0.75 across various models and datasets.
VIScore reveals that the reachability and capacity of predictors are crucial for planning success, outperforming traditional metrics in predictive accuracy.
Regulating the latent space to an isotropic Gaussian distribution provides a stable and information-maximized landscape for world model planning. However, the latent space property and successful planning remain disconnected. We first study this by comparing SIGReg and VISReg, two regularization loss functions with the same distribution target but different properties. Compared with SIGReg, VISReg has more flexibility in controlling the weights of center, scale, and shape regularization, and a larger batch size brings a finer distribution approximation. We find that the former, despite being beneficial in self-supervised learning (SSL), does not help the planning, whereas the latter improves the planning success on out-of-domain (OOD) datasets. This motivates a deep understanding of the factors that correlate with the success rate. Unlike the previous metrics focusing on the encoded latent only, we propose the Veracity-Influence-Sobriety score (VIScore), a metric that quantifies the reachability and capacity of a predictor given the encoded feature, and the hallucination of the searching-based planner. Compared with straightness, physical-state probing, and empowerment, we show that, with the measurement covering encoder, predictor, and planner, VIScore explains the success rate better than the others, as reflected by a strong Spearman correlation. Specifically, VIScore consistently achieves a Spearman correlation over 0.75 on both seen and unseen models and datasets on the cross-task success rate pool. Moreover, VIScore is the only metric that has a calibration error below the constant fit across all testing scenarios, showcasing the importance of these three aspects in planning success. We hope this metric can help future studies on world model design and diagnosis.
