Search papers, labs, and topics across Lattice.
This study introduces GlanceFace, an end-to-end framework that infers apparent personality traits from facial images, specifically targeting the MBTI personality model. By leveraging vision-language models and a semantic-enhanced facial representation module, the framework captures subtle cues related to personality while employing an uncertainty-aware learning strategy to address the challenges of noisy annotations. The extensive experiments validate GlanceFace's strong performance on MBTI benchmarks, revealing significant correlations between facial features and perceived personality traits, which can inform adaptive strategies for human-robot interactions.
Facial cues alone can reveal significant insights into personality traits, challenging the reliance on multimodal inputs in social AI applications.
Inferring apparent personality from facial images is important in social scenarios for embodied agents in human-robot interaction. Unlike inferring intrinsic personality traits via conversation, this task models first-impression personality perception based solely on facial appearance before interaction begins. Existing studies mainly focus on the Big Five personality model and often rely on language or multimodal inputs. As a result, it remains unclear whether facial cues alone can support meaningful associations with perceived personality traits. This question is particularly relevant for MBTI types, which are widely used in practice and more readily interpretable by large language models. To this end, we propose \textbf{GlanceFace}, an end-to-end framework for apparent personality inference leveraging vision-language models to introduce semantic priors and a semantic-enhanced facial representation module to capture subtle personality-related cues, together with an uncertainty-aware learning strategy to handle noisy and subjective annotations. Extensive experiments demonstrate strong performance on MBTI-based apparent personality benchmarks and reveal relationships between facial characteristics and perceived personality traits, highlighting its potential to support adaptive initial interaction strategies for embodied agents. The code and dataset are available at https://github.com/MrHuan3/GlanceFace.
