Search papers, labs, and topics across Lattice.
This paper introduces a human-in-the-loop pipeline for creating segmented 2D parameterized atlases from 3D models, addressing the challenge of application-dependent segmentation criteria that require user input. By employing a greedy set cover strategy to select a compact set of rendered views and utilizing tools like SAM~2 and Label Studio for interactive segmentation, the method produces unified segmented atlases that facilitate various downstream tasks. The evaluation on eight cultural heritage objects demonstrates the pipeline's effectiveness in generating usable segmented atlases while highlighting areas needing manual correction, such as fine structures and weak appearance boundaries.
A novel human-in-the-loop approach enables efficient segmentation of 3D assets, revealing critical areas where manual intervention is still necessary.
Segmenting 3D assets into meaningful regions remains challenging, especially when segmentation criteria are application-dependent and require user control. We present a human-in-the-loop pipeline for generating a segmented 2D parameterized atlas from a 3D model for interactive media, game, and XR content workflows. Our method first selects a compact set of rendered views using a greedy set cover strategy over sampled surface points, and then supports interactive segmentation of these views with SAM~2 and Label Studio. The resulting masks are back-projected onto the model's UV parameterization to produce a unified segmented atlas that supports downstream production tasks such as segment-wise material assignment, style transfer, and semantic labeling. We assess the pipeline through a demonstration-based technical evaluation on eight cultural heritage objects. The results show that the approach can generate usable segmented atlases across diverse geometries while revealing recurring sources of manual correction, particularly fine structures, cavities, and weak appearance boundaries.