Search papers, labs, and topics across Lattice.
This paper introduces QQWorld, a novel approach that enhances latent world models by replacing the Epps-Pulley objective with a quantile-quantile matching objective to better control heavy-tailed deviations in latent distributions. By aligning projected latent samples with rank-matched Gaussian quantiles, QQWorld maintains effective corrective gradients, particularly in the tails, which are often neglected in traditional methods. Experimental results across four control environments demonstrate that QQWorld significantly improves the average planning success rate of LeWM while achieving better Gaussian alignment and thinner latent tails.
Heavy-tailed deviations in latent distributions can be effectively controlled with QQWorld, leading to a notable increase in planning success rates for latent world models.
Latent world models enable efficient planning by predicting future states in a compact representation space, but their performance depends critically on the quality of the learned latent distribution. LeWorldModel (LeWM) regularizes its latents toward an isotropic Gaussian using the Epps-Pulley (EP) objective. We show that the corrective gradients of EP rapidly vanish for isolated tail samples, leaving heavy-tailed deviations insufficiently controlled. To address this limitation, we propose QQWorld, which replaces EP with a quantile-quantile matching objective that directly aligns projected latent samples with rank-matched Gaussian quantiles, thereby maintaining effective corrective gradients in the tails. We further develop cross-batch QQ, which enlarges the effective ranking pool using detached samples from previous batches, and characterize its bias-variance trade-off. Across four control environments, QQWorld effectively improves the average planning success rate of LeWM, while consistently yielding better Gaussian alignment and thinner latent tails.
