Search papers, labs, and topics across Lattice.
This paper introduces a virtual scanning framework in Unity for generating synthetic 3D scan datasets of indoor scenes, addressing the challenge of acquiring large, labeled datasets for 3D reconstruction and object completion. The framework simulates realistic scanner behavior through ray-based scanning, occlusion modeling, and panoramic image-based coloring. They generate the V-Scan dataset, comprising synthetic indoor scans with object-level partial point clouds, occlusion grids, and complete ground truth, which can be used to train and evaluate learning-based methods.
Training data for 3D scene understanding doesn't have to be a bottleneck: V-Scan offers a scalable, realistic, and fully-labeled synthetic alternative.
Learning-based methods for 3D scene reconstruction and object completion require large datasets containing partial scans paired with complete ground-truth geometry. However, acquiring such datasets using real-world scanning systems is costly and time-consuming, particularly when accurate ground truth for occluded regions is required. In this work, we present a virtual scanning framework implemented in Unity for generating realistic synthetic 3D scan datasets. The proposed system simulates the behaviour of real-world scanners using configurable parameters such as scan resolution, measurement range, and distance-dependent noise. Instead of directly sampling mesh surfaces, the framework performs ray-based scanning from virtual viewpoints, enabling realistic modelling of sensor visibility and occlusion effects. In addition, panoramic images captured at the scanner location are used to assign colours to the resulting point clouds. To support scalable dataset creation, the scanner is integrated with a procedural indoor scene generation pipeline that automatically produces diverse room layouts and furniture arrangements. Using this system, we introduce the \textit{V-Scan} dataset, which contains synthetic indoor scans together with object-level partial point clouds, voxel-based occlusion grids, and complete ground-truth geometry. The resulting dataset provides valuable supervision for training and evaluating learning-based methods for scene reconstruction and object completion.