Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
CollisionSplatting implements a GPU-accelerated, probability-inspired collision distance metric with adjustable conservatism that operates directly on standard 3D Gaussian Splatting (3DGS) scene representations alongside image-conditioned reward objectives. This unified formulation resolves the persistent trade-off between the geometric tractability of classical planning abstractions and the rich semantic conditioning afforded by dense visual representations. Integrated into parallelized MPPI and RRT planners, the method achieves superior collision-checking throughput and lower VRAM usage compared to existing visual baselines while maintaining high collision-classification accuracy in real-world navigation and manipulation setups.
Robots can now compute collision-free, visually conditioned trajectories directly on standard 3D Gaussian Splats at high throughput without ever converting the scene into lossy meshes or voxel grids.
Incorporating dense visual information into motion planning remains challenging, as geometric planners rely on abstracted scene representations that discard visual richness, while learned visual models often lack geometric interpretability and computational efficiency. This paper introduces CollisionSplatting, a simple, modular, GPU-accelerated, probability-inspired distance metric with tunable conservatism that operates directly on standard 3D Gaussian Splatting (3DGS) scenes. When combined with learned image-conditioned reward functions, this metric enables joint geometric and visual planning by unifying collision-aware costs with image-space objectives. We integrate the metric into GPU-accelerated Model Predictive Path Integral (MPPI) and Rapidly-Exploring Random Tree (RRT) planners, and show on-par or better collision-classification performance compared to representative baselines while achieving substantially higher collision-checking throughput and significantly lower VRAM usage. Finally, we demonstrate the effectiveness of our metric in real-world vision-guided navigation and manipulation tasks, highlighting 3DGS as a practical bridge between rich perception and real-time motion planning.