Search papers, labs, and topics across Lattice.
This paper introduces Fine-Grained Semantic Guidance Learning (FG-SGL), a framework that enhances micro-gesture recognition by integrating fine-grained and category-level semantics to guide vision-language models. To facilitate fine-grained semantic guidance, the authors created a new textual dataset describing micro-gesture dynamics across four semantic dimensions. FG-SGL, incorporating Fine-Grained Semantic Alignment (FG-SA) and Category Prototype Alignment (CP-A) modules optimized via Multi-Level Contrastive Optimization, achieves state-of-the-art performance in micro-gesture recognition.
Micro-gesture recognition gets a boost from a new method that uses fine-grained semantic guidance to capture subtle motion differences.
Micro-gesture recognition (MGR) is challenging due to subtle inter-class variations. Existing methods rely on category-level supervision, which is insufficient for capturing subtle and localized motion differences. Thus, this paper proposes a Fine-Grained Semantic Guidance Learning (FG-SGL) framework that jointly integrates fine-grained and category-level semantics to guide vision--language models in perceiving local MG motions. FG-SA adopts fine-grained semantic cues to guide the learning of local motion features, while CP-A enhances the separability of MG features through category-level semantic guidance. To support fine-grained semantic guidance, this work constructs a fine-grained textual dataset with human annotations that describes the dynamic process of MGs in four refined semantic dimensions. Furthermore, a Multi-Level Contrastive Optimization strategy is designed to jointly optimize both modules in a coarse-to-fine pattern. Experiments show that FG-SGL achieves competitive performance, validating the effectiveness of fine-grained semantic guidance for MGR.
