Search papers, labs, and topics across Lattice.
This paper introduces FLASH, a GPU-accelerated simulation framework designed to address the challenges of contact-rich deformable manipulation in robotics. By leveraging a novel NCP-based solver optimized for GPU parallelism, FLASH achieves high fidelity and speed, enabling the simulation of over 3 million degrees of freedom at 30 FPS. The framework's effectiveness is demonstrated through successful zero-shot sim-to-real transfer of policies trained on synthetic data, allowing robots to perform complex tasks like towel and garment folding without prior real-world demonstrations.
FLASH enables robots to master complex deformable manipulation tasks in minutes using only synthetic data, eliminating the need for labor-intensive real-world training.
Simulation frameworks such as Isaac Sim have enabled scalable robot learning for locomotion and rigid-body manipulation; however, contact-rich simulation remains a major bottleneck for deformable object manipulation. The continuously changing geometry of soft materials, together with large numbers of vertices and contact constraints, makes it difficult to achieve high accuracy, speed, and stability required for large-scale interactive learning. We present FLASH, a GPU-native simulation framework for contact-rich deformable manipulation, built on an accurate NCP-based solver that enforces strict contact and deformation constraints while being explicitly designed for fine-grained GPU parallelism. Rather than porting conventional single-instruction-multiple-data (SIMD) solvers to GPUs, FLASH redesigns the physics engine from the ground up to leverage modern GPU architectures, including optimized collision handling and memory layouts. As a result, FLASH scales to over 3 million degrees of freedom at 30 FPS on a single RTX 5090, while accurately simulating physical interactions. Policies trained solely on FLASH-generated synthetic data in minutes achieve robust zero-shot sim-to-real transfer, which we validate on physical robots performing challenging deformable manipulation tasks such as towel folding and garment folding, without any real-world demonstration, providing a practical alternative to labor-intensive real-world data collection.
NUS