Search papers, labs, and topics across Lattice.
To tackle subtle, low-intensity visual cues and extreme class imbalance in video understanding, the authors develop SoftRerank by end-to-end fine-tuning InternVideo2.5 with hierarchical classification heads. The architecture enforces prediction consistency via group-conditional soft fusion and applies a lightweight video-label matching reranker to resolve ambiguous, easily confused hard samples. On the long-tailed MA-52 benchmark, the method achieved a 79.99% F1-mean, securing first place in the 3rd Micro-Action Analysis Grand Challenge at ACM Multimedia.
Resolving visually indistinguishable human micro-actions requires more than raw foundation model scale: hierarchical coarse-to-fine soft fusion paired with targeted candidate reranking pushes long-tailed micro-action recognition to a benchmark-winning 79.99% F1-mean.
Micro-actions are subtle, low-intensity non-verbal behaviors that provide cues to fine-grained human states, including emotions and intentions. Recognizing them remains difficult because they are brief, contain weak visual changes, and often exhibit similar motion patterns across categories. This paper addresses these challenges with a fine-grained micro-action recognition method that combines full fine-tuning of InternVideo2.5, hierarchical soft fusion, and a lightweight candidate-label reranker. For the long-tailed label distribution in MA-52, we use class-balanced sampling and inverse-frequency reweighting to reduce the effect of frequent classes during training. We fine-tune InternVideo2.5 end to end and attach coarse and group-conditional fine-grained classification heads to the shared video representation, improving the consistency between coarse and fine predictions. For ambiguous samples, the candidate-label reranker uses hard samples and video-label matching to focus on easily confused fine-grained actions. Experiments validate the proposed method, which achieves a 79.99% F1-mean on MA-52 and ranks first in the 3rd Micro-Action Analysis Grand Challenge at ACM Multimedia 2026.
