Search papers, labs, and topics across Lattice.
This paper introduces SatSplatDiff, a novel approach that enhances the visual fidelity of satellite imagery by minimizing geometric degradation during generative refinement. By integrating monocular depth supervision and multi-scale geometric refinement with shadow-guided generative techniques, the method ensures consistency with the underlying geometry, significantly improving the quality of reconstructed images. Evaluations on benchmark datasets reveal a reduction in geometric mean absolute error (MAE) by up to 18% and a visual fidelity improvement of 28-45% compared to existing methods, achieving up to 5x resolution enhancement with minimal hallucination.
Achieving up to 45% better visual fidelity while reducing geometric errors, SatSplatDiff redefines satellite image reconstruction by ensuring consistency with real-world geometry.
Gaussian Splatting has been recently explored for satellite 3D reconstruction, demonstrating flexibility and efficiency in representing radiometrically diverse satellite scenes. However, the limited top viewpoint of satellite imagery results in insufficient supervision on building facades, leaving surface holes and degraded visual fidelity. Generative refinement, which leverages pretrained generative priors to iteratively refine and update the rendered images used as supervision targets, has recently been investigated to improve the visual fidelity of Gaussian-rendered images. However, since these models refine each view independently, the resulting images can generate hallucinations and break photo-consistency, leading to geometric degradation. To address these limitations, we propose SatSplatDiff, which aims to minimize geometric degradation prevalent in generative refinement. Building on photogrammetric DSM initialization and 2DGS-based shadow casting established in our prior work SatSplat, we first introduce monocular depth supervision and multi-scale geometric refinement to establish a geometrically accurate and well-regularized surface representation. We then apply shadow-guided generative refinement, where geometrically calculated shadow maps guide the Gaussians to maintain consistency with the underlying geometry, improving visual fidelity while reducing geometric degradation. Extensive evaluations on the IARPA2016 and DFC2019 datasets demonstrate state-of-the-art performance, reducing geometric MAE by up to 18% and improving visual fidelity (FID-CLIP) by 28-45% over existing baselines. Our method delivers up to 5x resolution enhancement with minimal hallucination and sensor-consistent appearance, demonstrating seamless cross-tile consistency and strong scalability for large-scale reconstruction. Source code is available at https://github.com/GDAOSU/SatSplatDiff
