Search papers, labs, and topics across Lattice.
This survey systematically examines the evolution of AI semantic intelligence, highlighting the transition from Basic-Level Semantic Intelligence (BLSI) to High-Level Semantic Intelligence (HLSI) as AI systems increasingly tackle complex cognitive tasks such as humor, sarcasm, and empathy. The authors synthesize existing research across various modalities, including text, speech, and vision, to identify key methodologies in data construction, modeling, and evaluation for HLS tasks. By addressing this gap in the literature, the paper underscores the importance of HLS for achieving human-like intelligence in AI systems.
The shift from basic to high-level semantic intelligence in AI mirrors human cognitive development, revealing critical insights for future advancements in machine understanding and generation.
Recent advances in AI have substantially expanded its cognitive and reasoning capabilities. From the perspective of semantic complexity, the development of AI reveals a clear trajectory from simple to complex semantic processing. While early AI systems mainly addressed tasks involving direct and literal semantic perception or expression, contemporary systems are increasingly expected to perform more sophisticated cognitive reasoning, enabling the understanding and generation of High-Level Semantics (HLS). A similar trajectory can also be observed in human cognitive development. We define this transition as the shift from Basic-Level Semantic Intelligence (BLSI) to High-Level Semantic Intelligence (HLSI). However, this issue has not yet been systematically and comprehensively examined in prior work. Motivated by this gap, this survey reviews the development of AI semantic intelligence from the perspective of semantic complexity. We systematically survey existing research on HLS tasks, including humor, sarcasm, metaphor, empathy, persuasion, narrative, and other general HLS phenomena, across text, speech, vision, and multimodal scenarios. Specifically, we summarize data construction methods, modeling and optimization strategies, and evaluation methodologies for both understanding and generation. HLS is essential for advancing AI toward genuinely human-like intelligence. By synthesizing existing methods and insights from the perspective of semantic intelligence, this survey aims to support the continued development of AI toward HLSI.