Search papers, labs, and topics across Lattice.
The authors introduce TIRAuxCloud, a novel multi-modal dataset combining thermal infrared (TIR), optical, and near-infrared bands from Landsat and VIIRS, along with auxiliary information like elevation and meteorological variables, for improved day and night cloud detection. This dataset addresses the limitations of existing cloud detection methods that struggle with nighttime conditions due to reliance on solar illumination and the scarcity of labeled TIR data. Experiments using supervised and transfer learning demonstrate the dataset's utility in establishing performance baselines and advancing cloud detection methods.
Finally, a dataset that tackles the hard problem of 24/7 cloud detection by fusing thermal infrared data with multispectral and auxiliary information, enabling more reliable remote sensing applications.
Clouds are a major obstacle in Earth observation, limiting the usability and reliability of critical remote sensing applications such as fire disaster response, urban heat island monitoring, and snow and ice cover mapping. Therefore, the ability to detect clouds 24/7 is of paramount importance. While visible and near-infrared bands are effective for daytime cloud detection, their dependence on solar illumination makes them unsuitable for nighttime monitoring. In contrast, thermal infrared (TIR) imagery plays a crucial role in detecting clouds at night, when sunlight is absent. Due to their generally lower temperatures, clouds emit distinct thermal signatures that are detectable in TIR bands. Despite this, accurate nighttime cloud detection remains challenging due to limited spectral information and the typically lower spatial resolution of TIR imagery. To address these challenges, we present TIRAuxCloud, a multi-modal dataset centered around thermal spectral data to facilitate cloud segmentation under both daytime and nighttime conditions. The dataset comprises a unique combination of multispectral data (TIR, optical, and near-infrared bands) from Landsat and VIIRS, aligned with auxiliary information layers. Elevation, land cover, meteorological variables, and cloud-free reference images are included to help reduce surface-cloud ambiguity and cloud formation uncertainty. To overcome the scarcity of manual cloud labels, we include a large set of samples with automated cloud masks and a smaller manually annotated subset to further evaluate and improve models. Comprehensive benchmarks are presented to establish performance baselines through supervised and transfer learning, demonstrating the dataset's value in advancing the development of innovative methods for day and night time cloud detection.
