Search papers, labs, and topics across Lattice.
This paper introduces a modular benchmark called Peg-in-Bench for evaluating high-precision robotic insertion tasks, addressing the limitations of fixed configurations in existing benchmarks. The benchmark features fully 3D-printable components that allow for a diverse range of peg geometries, tolerance levels, and base structures, facilitating systematic testing of generalization and robustness across various insertion scenarios. A scenario generation tool is also provided to ensure reproducibility and standardization in task configurations, enhancing the utility of the benchmark for future research.
A modular benchmark that adapts to diverse insertion scenarios reveals critical insights into robotic generalization capabilities in high-precision tasks.
High-precision insertion remains a fundamental challenge in robotic manipulation due to the strict alignment requirements and contact-rich interactions involved. Although peg-in-hole tasks are widely used for evaluation, existing bench- marks often rely on fixed task configurations, limiting their ability to assess robustness and generalization across different insertion scenarios. This paper introduces a reconfigurable peg-in-hole benchmark designed to evaluate task generalization in high-precision insertion. The benchmark consists of a set of fully 3D-printable modular components, including multiple peg geometries, tolerance levels, and configurable base structures that can be combined to generate a large variety of insertion and assembly tasks. By varying object layouts, orientations, and task structures while maintaining controlled physical conditions, the benchmark enables systematic evaluation of adaptation to unseen scenarios. To support reproducibility, we additionally provide a scenario generation tool capable of producing standardized task configurations and machine-readable task descriptions. The scenario generation tool and the STL files of the benchmark pieces are available through the project repository: https://github.com/aistairc/peg-in-bench.
