Search papers, labs, and topics across Lattice.
This paper introduces HyperMVP, a self-supervised pretraining framework that leverages hyperbolic space to learn structured multiview embeddings for robotic manipulation. HyperMVP extends the masked autoencoder paradigm with a GeoLink encoder and is pretrained on a new large-scale dataset called 3D-MOV. Experiments on COLOSSEUM, RLBench, and real-world scenarios demonstrate that HyperMVP outperforms existing Euclidean embedding methods, leading to more robust and generalizable manipulation policies.
By pretraining in hyperbolic space, robots can learn more robust spatial perception, leading to significantly improved manipulation performance compared to traditional Euclidean embeddings.
3D-aware visual pretraining has proven effective in improving the performance of downstream robotic manipulation tasks. However, existing methods are constrained to Euclidean embedding spaces, whose flat geometry limits their ability to model structural relations among embeddings. As a result, they struggle to learn structured embeddings that are essential for robust spatial perception in robotic applications. To this end, we propose HyperMVP, a self-supervised framework for \underline{Hyper}bolic \underline{M}ulti\underline{V}iew \underline{P}retraining. Hyperbolic space offers geometric properties well suited for capturing structural relations. Methodologically, we extend the masked autoencoder paradigm and design a GeoLink encoder to learn multiview hyperbolic representations. The pretrained encoder is then finetuned with visuomotor policies on manipulation tasks. In addition, we introduce 3D-MOV, a large-scale dataset comprising multiple types of 3D point clouds to support pretraining. We evaluate HyperMVP on COLOSSEUM, RLBench, and real-world scenarios, where it consistently outperforms strong baselines across diverse tasks and perturbation settings. Our results highlight the potential of 3D-aware pretraining in a non-Euclidean space for learning robust and generalizable robotic manipulation policies.
