Search papers, labs, and topics across Lattice.
This survey explores the integration of human-centric intelligence with foundation models, highlighting the need for a cohesive framework that connects various methodologies and tasks. By introducing a comprehensive taxonomy that categorizes human context into six interconnected levels, the authors aim to clarify the conceptual landscape and promote collaboration across research communities. The paper also reviews existing methods, datasets, and challenges, ultimately providing a practical reference to advance scalable and trustworthy human-centric AI.
Bridging fragmented research, this survey offers a unified taxonomy that redefines human-centric intelligence in the age of foundation models.
Human-centric intelligence is evolving in the foundation-model era, with growing emphasis on scale, transferability, and general-purpose modeling. Yet it has not fully integrated with foundation models to achieve the comparable progress seen in them. More importantly, recent advances across this broad landscape remain fragmented across tasks, modalities, and research communities, leaving their intrinsic conceptual and methodological connections unclear. To bridge these divides and rethink human-centric intelligence in the foundation-model era, we introduce a full-spectrum human context taxonomy that integrates six interconnected levels by viewing humans as observable subjects through visual appearance and spatial geometry, as dynamic actors through kinematic dynamics and interaction modeling, and as situated agents through world simulation and embodied agency. We next present the methodological foundations of the field, covering human-centric data families, computational architecture paradigms, and representative training and inference optimization strategies. We then systematically review representative methods across these levels and organize the associated datasets, benchmarks, and evaluation metrics. We further discuss open challenges and promising research directions toward human-centric intelligence that is scalable, trustworthy, physically grounded, and deployable, aiming to provide a coherent framework and practical reference for advancing the field. Finally, we provide a systematically organized and continuously updated collection of human-centric AI literature and resources on our project page.