Search papers, labs, and topics across Lattice.
OpenSPM introduces a novel framework for robotic manipulation that integrates spatial pose memory with high-frequency action generation, addressing the limitations of existing vision-language-action models. By employing semantically conditioned 3D perception and Kalman filtering, the system effectively tracks continuous 6D poses and retrieves transferable spatial memories from human demonstrations. Evaluated across ten LIBERO-GOAL tasks, OpenSPM achieved an impressive 85.6% success rate while maintaining a high control frequency of 1033.3 Hz, demonstrating its efficiency and reliability in real-time robotic applications.
OpenSPM achieves 85.6% task success with a control frequency of 1033.3 Hz, revolutionizing high-frequency robotic manipulation with minimal computational demands.
Open-environment tabletop robotic manipulation requires systems to possess semantic understanding, precise geometric pose estimation, and high-frequency action generation. While end-to-end vision-language-action (VLA) models excel at semantic generalization, they often lack explicit geometric constraints for fine-grained tasks and require costly training. To bridge the gap between high-level semantics and low-level physical execution, we propose OpenSPM, an open environment spatial persistent memory framework consisting of spatial pose memory and flow-matching action generation model. OpenSPM first leverages semantically conditioned 3D perception and Kalman filtering to track continuous 6D poses. It then extracts key spatial poses from human demonstrations, keeping them as transferable, object-centric spatial persistent memory entries. During inference, OpenSPM retrieves relevant memory entries in terms of natural language instructions, transfers the spatial poses to new scenes using SE(3) transformations, and generates high-frequency action chunks via a lightweight conditional flow-matching model. Combined with real-time proprioceptive state feedback and terminal residual correction, the system effectively suppresses trajectory error accumulation. Evaluated on ten LIBERO-GOAL tasks, OpenSPM achieves an 85.6% success rate and an equivalent control frequency of 1033.3 Hz, while requiring minimal inference AI computing power. Extensive ablations illustrate that structured spatial persistent memory and closed-loop residual correction play a crucial role in reliable, high-frequency robotic manipulation.
Tsinghua AI