Search papers, labs, and topics across Lattice.
The paper introduces AnySlot, a hierarchical framework for vision-language-action policies that decomposes compositional language instructions for robotic manipulation into explicit spatial visual goals represented by scene markers. This allows for decoupling high-level slot selection from low-level execution, improving both semantic accuracy and spatial robustness. Evaluated on a new benchmark, SlotBench, AnySlot significantly outperforms flat VLA baselines and prior modular grounding methods in zero-shot slot-level placement tasks.
Achieve sub-centimeter robotic placement accuracy from compositional language instructions by decomposing the task into visual goal representation and goal-conditioned execution.
Vision-Language-Action (VLA) policies have emerged as a versatile paradigm for generalist robotic manipulation. However, precise object placement under compositional language instructions remains a major challenge for modern monolithic VLA policies. Slot-level tasks require both reliable slot grounding and sub-centimeter execution accuracy. To this end, we propose AnySlot, a framework that reduces compositional complexity by introducing an explicit spatial visual goal as an intermediate representation between language grounding and control. AnySlot turns language into an explicit visual goal by generating a scene marker, then executes this goal with a goal-conditioned VLA policy. This hierarchical design effectively decouples high-level slot selection from low-level execution, ensuring both semantic accuracy and spatial robustness. Furthermore, recognizing the lack of existing benchmarks for such precision-demanding tasks, we introduce SlotBench, a comprehensive simulation benchmark featuring nine task categories tailored to evaluate structured spatial reasoning in slot-level placement. Extensive experiments show that AnySlot significantly outperforms flat VLA baselines and previous modular grounding methods in zero-shot slot-level placement.
CMU ML