Search papers, labs, and topics across Lattice.
This paper introduces Amodal SAM, a framework that adapts the Segment Anything Model (SAM) for amodal image and video segmentation, enabling prediction of complete object shapes including occluded regions. Amodal SAM incorporates a Spatial Completion Adapter for occluded region reconstruction, a Target-Aware Occlusion Synthesis (TAOS) pipeline to generate synthetic training data, and novel learning objectives for regional consistency and topological regularization. Experiments show Amodal SAM achieves state-of-the-art performance and robust generalization on standard benchmarks.
Amodal SAM unlocks zero-shot amodal segmentation by adapting the Segment Anything Model (SAM) to infer complete object shapes, even in the presence of occlusions.
Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these approaches often lack the generalization capacity to extend effectively to novel object categories and unseen contexts. This paper introduces Amodal SAM, a unified framework that leverages SAM (Segment Anything Model) for both amodal image and amodal video segmentation. Amodal SAM preserves the powerful generalization ability of SAM while extending its inherent capabilities to the amodal segmentation task. The improvements lie in three aspects: (1) a lightweight Spatial Completion Adapter that enables occluded region reconstruction, (2) a Target-Aware Occlusion Synthesis (TAOS) pipeline that addresses the scarcity of amodal annotations by generating diverse synthetic training data, and (3) novel learning objectives that enforce regional consistency and topological regularization. Extensive experiments demonstrate that Amodal SAM achieves state-of-the-art performance on standard benchmarks, while simultaneously exhibiting robust generalization to novel scenarios. We anticipate that this research will advance the field toward practical amodal segmentation systems capable of operating effectively in unconstrained real-world environments.
