Search papers, labs, and topics across Lattice.
HyperSim, a novel sim-to-real framework, tackles the domain gap in robotic manipulation by integrating high-fidelity environment synthesis, adversarial trajectory generation, and sim-and-real co-training. The framework enhances visual realism, expands data coverage, and enforces domain-invariant representations to improve policy transfer. Empirical validation on two manipulation models demonstrates sim-to-real success rates of 80% and 95% with ACT and π₀, respectively, and a 35% increase in robustness against physical perturbations.
Achieve near-perfect sim-to-real transfer in robotic manipulation by closing the loop between synthetic data generation and robust policy training.
Scaling data volume and diversity is critical for generalizing embodied intelligence. While synthetic data generation offers a scalable alternative to expensive physical data acquisition, transferring robotic manipulation policies from simulation to the real world (sim-to-real) remains a formidable challenge due to the domain gap. This paper presents HyperSim, a holistic framework spanning from synthetic data generation to policy training and seamless real-world deployment. To systematically bridge the sim-to-real gap, HyperSim is realized through three core pillars: high-fidelity environment synthesis, adversarial trajectory generation, and sim-and-real co-training. Collectively, these modules address domain discrepancies by enhancing visual fidelity, expanding data coverage, and enforcing domain-invariant representations. We rigorously validate HyperSim through a large-scale empirical study involving 400 real-world task executions across two representative manipulation models. Assessed across three fine-grained metrics, our complete pipeline achieves remarkable sim-to-real success rates of 80% and 95% with ACT and \pi_{0}, respectively. Furthermore, policies trained on our adversarial trajectories exhibit significantly enhanced robustness against dynamic uncertainties, achieving a 35% higher completion rate under physical perturbations.
