Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To bridge the gap between rigid read-think-act interaction loops and real-time environments, this work formalizes a general asynchronous agent framework where inference processes run as coroutines with overlapping memory states. This unifies fragmented, domain-specific concurrency solutions—such as dedicated voice architectures and streaming VLAs—into a single software abstraction that can be driven by user specifications or model self-orchestration. Evaluated on off-the-shelf Qwen 3.x models, the approach enables robust multi-stream execution across streaming video comprehension, real-time gaming, and monitoring tasks without requiring task-specific fine-tuning.
Real-time multi-stream interaction does not require bespoke model architectures: off-the-shelf LLMs can natively interleave perception and action in dynamic environments when configured with overlapping-memory inference coroutines.
Modern LLMs are increasingly capable as autonomous agents, but they follow sequential interaction cycles: read, think, reply or call tools, repeat. Many real-world use cases are not sequential: voice assistants, embodied agents, and monitoring systems receive new inputs while they think or perform another task. Modern LLMs address this with specialized architectures for voice interaction and video streams, VLAs for robot control, asynchronous tool calling for API usage, and others. In this work, we generalize from different asynchronous tasks to general asynchronous agents that can adapt to different types of concurrency. To achieve this, we develop an asynchronous LLM framework that lets users (or the agents themselves) define inference coroutines with overlapping memory states. We showcase that Qwen 3.x models are capable of asynchronous operation for streaming video understanding, videogames, and monitoring, without task-specific training.