Search papers, labs, and topics across Lattice.
This paper explores the integration of Small Language Models (SLMs) with edge computing to enhance the Cognitive Embodied Agent Architecture (CEAA) for virtual agents, focusing specifically on the "Think" and "Memory" processes. By developing an edge-based virtual agent gateway system evaluated on NVIDIA Jetson Orin NX, the authors conducted simulation experiments to assess routing accuracy, memory-read performance, and latency. The results indicate that the SLM-driven prototype can effectively support cognitive processes in virtual agents, enabling more adaptive and context-aware interactions in immersive environments.
SLMs can empower virtual agents to maintain contextual awareness and memory-driven conversations, enhancing their cognitive capabilities in real-time interactions.
Embodied intelligent virtual agents are expected to operate as persistent, adaptive, and context-aware entities within complex virtual and Metaverse worlds. However, implementing cognitively capable agents in such environments is conceptually and technologically challenging. Among a range of blueprints and development approaches, the Cognitive Embodied Agent Architecture (CEAA) has been developed as an implementation-oriented framework for architecting components of perception, memory, reasoning, planning, and embodied action. Considering the recent advances in edge computing and generative AI language models, this paper explores the use of Small Language Models (SLMs) to support edge-based operation of selected CEAA components, focusing on"Think"and"Memory"as processes central to cognitive orchestration and persistence of virtual agents in interactive virtual worlds. An edge-based virtual agent gateway system was developed and evaluated on an NVIDIA Jetson Orin NX using Qwen2.5 models of different sizes, exploring the system's capability to process service requests and handle memory-driven conversations. A series of simulation experiments evaluated routing accuracy, memory-read performance, and latency, demonstrating an SLM-driven prototype agent system that partially implements selected CEAA processes to support the development of embodied agents whose cognitive"brain"can operate efficiently and contextually for interactive experiences in immersive virtual worlds.
