Search papers, labs, and topics across Lattice.
This paper introduces DART, a dual-arm manipulation framework that combines nonlinear Model Predictive Control (MPC) with an impedance controller for precise object manipulation on a dynamically controlled tray. The framework explores three strategies for modeling tray-object dynamics within the MPC: analytical, online regression, and reinforcement learning-based models. Results in simulation demonstrate the trade-offs between these modeling strategies in terms of settling time, steady-state error, control effort, and generalization across different object properties.
Forget brittle physics models: DART uses online learning to give dual-armed robots waiter-like dexterity in balancing objects on a tray.
What appears effortless to a human waiter remains a major challenge for robots. Manipulating objects nonprehensilely on a tray is inherently difficult, and the complexity is amplified in dual-arm settings. Such tasks are highly relevant to service robotics in domains such as hotels and hospitality, where robots must transport and reposition diverse objects with precision. We present DART, a novel dual-arm framework that integrates nonlinear Model Predictive Control (MPC) with an optimization-based impedance controller to achieve accurate object motion relative to a dynamically controlled tray. The framework systematically evaluates three complementary strategies for modeling tray-object dynamics as the state transition function within our MPC formulation: (i) a physics-based analytical model, (ii) an online regression based identification model that adapts in real-time, and (iii) a reinforcement learning-based dynamics model that generalizes across object properties. Our pipeline is validated in simulation with objects of varying mass, geometry, and friction coefficients. Extensive evaluations highlight the trade-offs among the three modeling strategies in terms of settling time, steady-state error, control effort, and generalization across objects. To the best of our knowledge, DART constitutes the first framework for non-prehensile dual-arm manipulation of objects on a tray. Project Link: https://dart-icra.github.io/dart/