Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces MagPlus, a novel pipeline that enhances the generation of facial micro-expressions by magnifying subtle facial motions to align with standard facial animation models. By leveraging existing macro-expression models without the need for retraining, MagPlus effectively transforms weak micro-expressions into robust signals suitable for various facial expression tasks. The results demonstrate that the proposed method significantly improves the realism of generated micro-expressions across multiple animation frameworks, showcasing its potential for broader applications in emotion recognition and synthesis.
Transforming imperceptible micro-expressions into realistic animations without retraining existing models could revolutionize emotion synthesis in AI.
Facial micro-expressions are subtle and short-lived facial movements that provide important cues about genuine human emotions. However, modeling and generating them remains difficult because annotated micro-expression data is limited and the underlying facial motions are extremely weak. Existing micro-expression generation methods therefore often suffer from limited quality, weak robustness, and poor generalization. We propose MagPlus, a transferable micro-expression processing pipeline that connects micro-expression analysis with standard facial animation models. Instead of training a dedicated generator from scratch, MagPlus learns to magnify subtle facial motions into the range of regular facial expressions, transforming micro-expressions into signals that are compatible with existing facial expression processing models. The magnified sequence is then used by a standard facial expression model for tasks such as transfer and synthesis. A complementary DeMagPlus module then restores the generated motion back to realistic micro-expression intensity levels while preserving the synthesized dynamics. We evaluate the framework using four facial animation models: FOMM, FSRT, MetaPortrait, and EmoPortraits. None of these models are trained on micro-expression data. Experiments show that MagPlus-DeMagPlus enables pretrained macro-expression models to generate more realistic micro-expression motion without retraining the backbones.