Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
RoboSimStudio (RSS) addresses the challenge of accurately modeling robot-object interaction physics by providing an interactive toolkit that exposes solver, contact model, and physical parameter choices for iterative refinement. This approach allows both human experts and AI agents to tune simulations against observed real-world behavior, bridging the reality gap in robot manipulation. Experiments demonstrate successful real-to-simulation transfer using visual evaluation, force feedback, and agentic refinement loops.
Fine-tune robot simulation physics with unprecedented interactive control, enabling AI agents to learn from real-world interactions and achieve accurate real-to-sim transfer.
It is difficult to accurately model the physics of the interaction between a robot and the objects it manipulates, including contact mechanics, coupled contact dynamics, deformations, stiffness and friction. We present RoboSimStudio (RSS), an interactive toolkit that makes choices of solver, contact model, and physical parameters explicit and editable, allowing both humans and coding agents to iteratively refine simulations based on observed physical behavior. We implement RSS with the open Newton physics simulation system and describe experiments with human-guided real2sim using (1) visual evaluation, (2) force-feedback and (3) agentic Real2Sim2Real. Code, video and additional information can be found on the project website.