Search papers, labs, and topics across Lattice.
This study addresses the challenge of training object detectors with limited labeled data by synthesizing labeled training images from a few unlabeled photographs using a vision-language model to create 3D vegetation scenes. The method involves generating bounding boxes, segmentation masks, and occlusion data from the scene geometry, which allows for effective training without manual annotation. The results show that detectors trained on these synthesized images perform comparably or better than those trained on larger labeled datasets from different sites, highlighting the effectiveness of unsupervised site adaptation techniques in improving detection performance in varied environments.
Synthesizing labeled training images from a few unlabeled photographs can outperform traditional methods, achieving superior detection accuracy in challenging environments.
Labeled images of small objects hidden in vegetation are scarce, and detectors trained on them generalize poorly across sites. Rather than reusing labels collected at another site, we synthesize labeled training images from a handful of unlabeled photographs of the deployment site itself. A vision--language model generates a coarse 3D vegetation scene from one photograph; placing 3D object meshes in the scene yields bounding boxes, segmentation masks, and per-instance occlusion directly from the scene geometry, without manual annotation. A lightweight adapter fine-tuned on the photographs conditions a diffusion pass that re-textures the renders, and a graded mask-lock sets how much diffusion may touch the object itself. In our runs this grade was the most influential curation choice: lightly diffusing the object improves minority-class recall over fully protecting its pixels, while unrestricted diffusion dissolves it. Trained on these images, a standard detector matched or exceeded its counterpart trained on a larger labeled dataset of real images from a different site, consistently across seeds on a humanitarian-demining benchmark; the comparison is thus unsupervised site adaptation from a handful of photographs against conventional cross-site label reuse. In our ablations the gains were largely insensitive to the photograph and crop budgets, and in-domain accuracy did not predict cross-site performance.
