Search papers, labs, and topics across Lattice.
This paper introduces MotifGen, a novel generative model designed to interpolate misaligned satellite images from multiple geospatial sources, specifically targeting the challenges posed by tropical cyclone monitoring. By employing a self-supervised learning approach where random sources are masked and reconstructed, the model significantly outperforms traditional supervised methods in terms of Continuous Ranked Probability Score. Notably, the integration of both microwave and infrared data enhances the model's performance, yielding results comparable to deterministic models while closely aligning with true observational power spectra.
Generative modeling can now effectively interpolate misaligned satellite imagery, drastically improving tropical cyclone monitoring capabilities.
Microwave satellite imagery plays a crucial role in monitoring tropical cyclone precipitation and intensity worldwide, but suffers from long revisit times, potentially missing rapid storm evolution phases. While this raises the need for an interpolation method, it is made challenging by the high level of heterogeneity of microwave data coming from different instruments. In this work, we introduce the first generative model that can be applied to multiple geospatial sources that change across samples, occur at irregular time intervals, are misaligned geographically, and come from instruments with varying characteristics. We apply this model to the case of spatio-temporal interpolation of tropical cyclone microwave images from other microwave and infrared instruments. We train using a self-supervised task in which a random source is masked and reconstructed, and show that it leads to a significant decrease in Continuous Ranked Probability Score over supervised training. We show a further improvement by combining infrared and microwave data compared to microwave only. Using these improvements, the generative model produces an ensemble mean on par with that of a deterministic model, while generating a power spectrum significantly closer to that of true observations. To the best of our knowledge, this is the first generative model that interpolates microwave images of cyclones by combining multiple microwave instruments and infrared observations at irregular time intervals.
