Search papers, labs, and topics across Lattice.
This paper introduces MonoIR-RS, a novel large-scale dataset and benchmark for infrared remote-sensing vision-language learning, addressing the significant gap in existing resources that predominantly focus on visible-band semantics. By employing CLIP-style contrastive adaptation and VLM instruction tuning, the authors demonstrate that infrared-aware adaptation significantly enhances model performance, achieving up to a 12.8-point increase in CLIP mean recall and complete IR-cue coverage in VLM captioning. The study establishes MonoIR-RS as a controlled testbed that effectively isolates the infrared modality, facilitating reproducible research in aligning infrared imagery with language understanding.
Infrared-aware adaptation can boost CLIP performance by over 12 points, transforming how models interpret thermal imagery.
Infrared remote-sensing imagery captures intensity structure, object-background contrast, and illumination-invariant cues often invisible in RGB imagery. Yet, most remote-sensing vision-language resources and models focus on visible-band semantics, leaving infrared vision-language understanding underexplored. We introduce MonoIR-RS, a large-scale infrared remote-sensing vision-language dataset and benchmark that couples IR-aware data construction with CLIP-style contrastive adaptation and VLM instruction tuning. Built from the same source pool and split as FusionRS, MonoIR-RS retains the infrared image as the model-facing modality, yielding 600,000 synthesized infrared images and 59,032 retained IR-aware caption records. The model experiments use this retained language-supervision subset, whose captions rewrite supervision around grayscale structure and infrared-style contrast instead of RGB appearance. We show that the synthesized infrared imagery is markedly closer to real thermal imagery than a grayscale conversion on the AVIID benchmark. We fine-tune five CLIP backbones and six VLM backbones, and calibrate them against zero-shot behavior: IR-aware adaptation lifts CLIP mean recall by up to 12.8 points and drives VLM captioning IR-cue coverage to 100% while reducing residual RGB-color leakage to near zero. By isolating the infrared modality from RGB-IR dual-modal learning, MonoIR-RS offers a controlled, reproducible testbed for aligning infrared remote-sensing evidence with language.
