Search papers, labs, and topics across Lattice.
This paper introduces UAV-OVO, a new benchmark for evaluating out-of-viewpoint generalization in UAV action recognition, designed to expose viewpoint-specific shortcuts learned by models. The benchmark isolates viewpoint as a key distribution shift by creating in-distribution (low-depression views) and out-of-distribution (high-depression views) test sets matched by class distribution. The authors also propose LATER, a LoRA-based test-time adaptation method, which mitigates viewpoint-induced drift by re-centering features using the orthogonal complement of the learned LoRA subspace.
Models trained on standard UAV footage can fail dramatically when deployed on drones with different camera angles, revealing hidden viewpoint biases.
UAV action recognition faces a deployment shift that standard benchmarks often obscure: a model trained on UAV footage captured from low-depression viewpoints may be required to recognize the same action classes from high-depression viewpoints. While the action labels remain unchanged, this shift alters body visibility, motion projection, and scene context, encouraging models to rely on viewpoint-specific shortcuts. We introduce UAV-OVO, an Out-of-Viewpoint generalization benchmark for UAV action recognition. UAV-OVO derives view scores from uncalibrated videos, uses a view-isolation band to assign low-depression videos to the training and in-distribution test splits while reserving high-depression videos for out-of-distribution testing, and constructs ID/OOD test sets matched by class distribution so that performance differences reflect viewpoint shift rather than label imbalance. Across representative video recognizers, UAV-OVO reveals a substantial ID/OOD gap: models that fit the low-depression training distribution well often fail to transfer to held-out high-depression views, exposing viewpoint shortcuts hidden by aggregate accuracy. We further propose LATER, LoRA-Anchored Test-time Re-centering, which first adapts the recognizer with Low-Rank Adaptation (LoRA) and then uses the learned LoRA subspace as a semantic anchor for online feature re-centering. Specifically, LATER projects target-domain displacement onto the orthogonal complement of the LoRA subspace before re-centering features, reducing viewpoint-induced drift while preserving task-relevant semantics. Together, UAV-OVO and LATER provide a controlled testbed and a practical adaptation method for viewpoint-robust UAV video understanding.
