Search papers, labs, and topics across Lattice.
This paper introduces GHOST, a geometry-guided preprocessing framework designed to transform transparent regions into opaque representations, addressing the challenges posed by transparent objects in depth estimation and 3D reconstruction. By leveraging visual foundation models such as TransDINO and TransDecomp for disentangling transparency properties and employing DAF-Net to recover surface normal priors, GHOST synthesizes texture-rich RGB images that maintain the 3D structure of transparent objects. Experimental results show that GHOST significantly improves the performance of existing depth estimation and reconstruction models, restoring critical photometric cues that are typically lost with transparent surfaces.
Transparent objects can now be accurately reconstructed without retraining models, thanks to a novel preprocessing framework that transforms them into opaque representations.
Transparent objects pose a fundamental challenge for depth estimation and 3D reconstruction due to their violation of Lambertian assumptions, leading to severe geometry degradation in downstream tasks. To address this, we propose a novel geometry-guided preprocessing framework \textbf{GHOST} that leverages visual foundation models to transform transparent regions into opaque, structurally consistent representations without requiring downstream model retraining. Specifically, our pipeline utilizes (1) \textbf{TransDINO} and (2) \textbf{TransDecomp} to disentangle masks and transparency physical properties, while (3) \textbf{DAF-Net} recovers surface normal priors to encode geometric curvature. Subsequently, (4) \textbf{GeoSemTransNet} integrates these multi-modal cues to synthesize a texture-rich opaque RGB image that preserves the transparent object's 3D structure. Extensive experiments demonstrate that our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.
