Search papers, labs, and topics across Lattice.
This paper introduces ScratchSim, a procedural rendering pipeline that generates large-scale annotated synthetic data for surface scratch detection using BlenderProc, addressing the challenge of limited annotated defect data in industrial quality control. The authors evaluate four training strategies鈥攕ynthetic-only, real-only, mixed, and fine-tuning from synthetic weights鈥攁cross various material properties and lightweight edge-deployable detectors, revealing that fine-tuning from synthetic weights consistently outperforms real-only training. The results demonstrate that mixed training can effectively recover performance in scenarios with scarce real data, validating the approach across both convolutional and transformer-based architectures.
Fine-tuning with synthetic data can outperform traditional real-data training in surface scratch detection, revolutionizing defect detection strategies in industrial applications.
While automated defect detection such as the detection of surface scratched is an important aspect in industrial quality control, the scarcity of annotated defect data make this task challenging. This paper presents a procedural rendering pipeline that generates large-scale annotated synthetic training data using BlenderProc, with configurable material appearance, camera modes, and domain randomization, producing automatic COCO-format annotations. To show the potential of our approach, we evaluate four training strategies, namely synthetic-only, real-only, mixed, and fine-tuning from synthetic weights, across two objects with different material properties and three lightweight edge-deployable detectors, YOLOX, YOLO26, and LW-DETR. Our evaluation show that fine-tuning from synthetic weights consistently outperforms real-only training, and that mixed training effectively recovers performance under scarce real-data conditions, with findings validated across both convolutional and transformer-based architectures. The proposed approach enables scalable defect detection without the burden of large real annotated datasets, making it practical for on-device industrial inspection. The pipeline scripts, 3D model, and both synthetic and real annotated scratch datasets for a glossy toy Ferrari car will be made available through the project website upon acceptance.
