Search papers, labs, and topics across Lattice.
This paper introduces DuoBench, a comprehensive benchmarking framework designed for evaluating bimanual manipulation policies on the FR3 Duo platform, addressing the complexities of coordinating dual-arm systems. The framework includes eleven tasks across four coordination categories, implemented in both simulation and real-world settings, with a focus on fine-grained semantic failure analysis and human-teleoperated datasets. Benchmarking results reveal that existing dual-arm policies struggle significantly with early interactions, parallel execution, and transferring skills from simulation to real-world applications, highlighting critical areas for improvement in bimanual manipulation research.
Current dual-arm manipulation policies falter in real-world applications, with significant challenges in early interactions and skill transfer from simulation.
Bimanual robot systems substantially expand manipulation capabilities, but coordinating two arms introduces additional control complexity and failure modes that are not well captured by existing benchmarks. We introduce DuoBench, an extensible benchmarking framework for bimanual manipulation policies on the FR3 Duo platform. DuoBench comprises eleven tasks spanning four coordination categories, implemented in simulation and partially reproduced in the real world through reproducible task recipes with 3D-printable assets. In addition, we propose a stage-based evaluation scheme that supports fine-grained semantic failure analysis beyond binary success and provide human-teleoperated datasets for all benchmark tasks. We benchmark several dual-arm imitation-learning and vision-language-action policies in simulation and on real hardware. Our results show that current policies remain challenged by bimanual manipulation, particularly in early interaction stages, parallel arm execution, and transfer between simulation and real-world settings. DuoBench provides a reproducible testbed for diagnosing these failure modes and studying future methods for dual-arm policy learning. Code, datasets, and videos are available at https://duobench.github.io/
