Search papers, labs, and topics across Lattice.
This paper introduces a computational model for analyzing social engagement through mutual visual attention, drawing on psychological theories to enhance interpretability. By explicitly modeling dyadic visual attention rather than relying on end-to-end learning, the framework aggregates visual cues into clear measures of engagement for individuals and groups. Evaluated through quantitative experiments and qualitative visualizations, the approach proves practical for educators and caregivers in monitoring and understanding social interactions.
Mutual visual attention can be transformed into interpretable engagement metrics that empower non-technical users to grasp complex social dynamics.
Understanding social interactions from non-verbal visual data is important for behavior analysis and activity monitoring. We propose an interpretable computational model of social engagement inspired by psychological theories of mutual visual attention. Rather than learning interaction patterns end-to-end, our framework explicitly models dyadic visual attention and aggregates these cues into interpretable measures of individual and group engagement. The resulting modular framework combines state-of-the-art head orientation estimation with lightweight geometric reasoning, producing explanations that remain accessible to non-technical users. We evaluate the proposed approach on a variety of data through quantitative experiments and demonstrate its practical usefulness with qualitative visualizations designed to support teachers, caregivers, and social workers in understanding group interaction dynamics.
