Search papers, labs, and topics across Lattice.
This study introduces RSVideo-10K, a comprehensive dataset designed for evaluating vision-language models on continuous remote-sensing video understanding, comprising over 10,000 instances and 1.47 million frames. The authors identify significant performance gaps in existing models, particularly in recovering small local evidence and tracking short-lived states, which are critical for real-time analysis. To address these challenges, they propose RSVideo, a reinforcement learning framework that enhances spatiotemporal focusing, achieving up to a 9.01% improvement in accuracy with specific model backbones.
Vision-language models struggle with remote-sensing videos, but a new framework boosts their accuracy by over 9% in critical tasks.
Remote-sensing videos enable real-time observation of changes in target attributes, short-term activities, and scene evolution. They record motion, actions, interactions, and scene changes that cannot be captured by isolated images. Existing models primarily target single images or discrete temporal observations spanning a long time range. However, a unified evaluation setting for assessing vision-language models on continuous remote-sensing video understanding remains lacking. We introduce RSVideo-10K, a remote-sensing video dataset comprising 10,773 instances, 1.47 million frames, and 17.02 hours of footage, containing both unmanned aerial vehicles and satellite platforms. Its fixed evaluation benchmark, RSVideo-Bench, contains 2,731 test instances and evaluates two complementary aspects of remote-sensing video understanding: L1 Perception and L2 Reasoning, spanning seven capability groups and 17 tasks. Evaluations show that current vision-language models still struggle to recover small local evidence, track short-lived states, and use scene-constrained spatial relations. Based on this analysis, we further propose RSVideo, a reinforcement learning framework for small-target spatiotemporal focusing that selects question-relevant regions across frames and suppresses redundant background tokens. RSVideo achieves a maximum absolute improvement of 9.01% with InternVL3.5-14B and attains the highest accuracy of 40.63% with Qwen3.6-27B across 26 open-source vision-language backbones.Codes will be available at https://github.com/HongjieZhou0329/RSVideo.
