Search papers, labs, and topics across Lattice.
This paper introduces CarbonCLIP, a multimodal distillation framework designed to enhance urban carbon emission predictions from satellite imagery by integrating street-view semantics and temporal context. By employing dual-branch contrastive learning, CarbonCLIP bridges the gap between satellite data and ground-level human activities, allowing for more accurate estimations without requiring ground-level data during inference. Experiments in Beijing and Singapore show that CarbonCLIP significantly outperforms existing methods, validating its effectiveness in transferring contextual knowledge into satellite representations for urban carbon modeling.
Bridging satellite imagery with street-level semantics boosts urban carbon emission predictions, achieving superior accuracy without needing ground-level data at inference.
Accurately estimating urban carbon emissions is critical for sustainable urban planning, yet many existing approaches remain difficult to apply consistently across cities due to data-source heterogeneity and the lack of fine-grained semantic-temporal context in remote sensing data. We propose CarbonCLIP, a task-oriented multimodal distillation framework that improves satellite-based carbon emission prediction by transferring contextual knowledge into a unified satellite representation through dual-branch contrastive learning. Unlike conventional methods that rely on static visual features, CarbonCLIP explicitly bridges the gap between top-down satellite views and ground-level human activities. Specifically, the spatial branch uses fine-grained textual descriptions automatically generated from street-view images by Large Multimodal Models (LMMs) to provide semantic priors reflecting building functions, infrastructure, and urban activities, while the temporal branch employs a month encoder to encode temporal priors associated with monthly emission variation. CarbonCLIP requires multimodal data only during the pretraining phase; during inference, it relies solely on satellite imagery, thereby supporting scalable deployment when ground-level data are unavailable at inference. Experiments on Beijing and Singapore demonstrate that CarbonCLIP outperforms baselines in both study cities. The results validate that our method effectively transfers multimodal knowledge into satellite representations, offering a robust solution for satellite-based urban carbon modeling.
