Search papers, labs, and topics across Lattice.
The paper introduces SynthRender, an open-source framework for synthetic image generation using Guided Domain Randomization, and benchmarks Reality-to-Simulation techniques for creating 3D assets from 2D images. They address the challenge of acquiring large, annotated datasets for object perception in industrial settings by providing a low-overhead, transferable data generation pipeline. The authors demonstrate the effectiveness of their approach by achieving state-of-the-art object detection performance on multiple benchmarks, including a new dataset, IRIS, specifically designed for industrial object perception.
Generate synthetic training data that's good enough to achieve 99% mAP on real-world industrial object perception tasks, even without 3D models.
Object perception is fundamental for tasks such as robotic material handling and quality inspection. However, modern supervised deep-learning perception models require large datasets for robust automation under semi-uncontrolled conditions. The cost of acquiring and annotating such data for proprietary parts is a major barrier for widespread deployment. In this context, we release SynthRender, an open source framework for synthetic image generation with Guided Domain Randomization capabilities. Furthermore, we benchmark recent Reality-to-Simulation techniques for 3D asset creation from 2D images of real parts. Combined with Domain Randomization, these synthetic assets provide low-overhead, transferable data even for parts lacking 3D files. We also introduce IRIS, the Industrial Real-Sim Imagery Set, containing 32 categories with diverse textures, intra-class variation, strong inter-class similarities and about 20,000 labels. Ablations on multiple benchmarks outline guidelines for efficient data generation with SynthRender. Our method surpasses existing approaches, achieving 99.1% mAP@50 on a public robotics dataset, 98.3% mAP@50 on an automotive benchmark, and 95.3% mAP@50 on IRIS.
