Search papers, labs, and topics across Lattice.
This paper introduces 3D-Anchored Lookahead Planning (3D-ALP), a novel approach to robotic manipulation that integrates Monte Carlo Tree Search (MCTS) with a 3D-consistent world model. By maintaining a persistent camera-to-world anchor, 3D-ALP enables accurate replanning even when objects are occluded, overcoming limitations of reactive policies. Experiments on a 5-step sequential reach task demonstrate a significant improvement in success rate (0.650 vs. 0.006 for a greedy baseline) on memory-required steps, highlighting the importance of spatial memory and deeper lookahead.
Robots can now remember where objects *used to be* and plan accordingly, even when those objects are no longer visible.
We present 3D-Anchored Lookahead Planning (3D-ALP), a System 2 reasoning engine for robotic manipulation that combines Monte Carlo Tree Search (MCTS) with a 3D-consistent world model as the rollout oracle. Unlike reactive policies that evaluate actions from the current camera frame only, 3D-ALP maintains a persistent camera-to-world (c2w) anchor that survives occlusion, enabling accurate replanning to object positions that are no longer directly observable. On a 5-step sequential reach task requiring spatial memory (Experiment E3), 3D-ALP achieves 0.650 0.109 success rate on memory-required steps versus 0.006 0.008 for a greedy reactive baseline ({\Delta}=+0.645), while step 5 success reaches 0.822 against 0.000 for greedy. An ablation study (30 episodes, 3 seeds) isolates tree search spatial memory as the primary driver (+0.533, 82% of gain) with additional benefit from deeper lookahead (+0.111, 17%). We also identify and resolve four structural failure modes in applying UCT-MCTS (Upper Confidence Bounds applied to Trees [10]) to continuous robotic manipulation.