Search papers, labs, and topics across Lattice.
Tsinghua AICASChina Telecom Research InstituteFudanHKUSTMeituanOhio StateUSTCApr 29, 2026arXiv:2604.26752GLM-5V-Turbo is introduced as a native foundation model designed for multimodal agents, integrating multimodal perception directly into reasoning, planning, and action execution. The model incorporates advancements in model design, multimodal training, reinforcement learning, and toolchain expansion, resulting in enhanced performance in multimodal coding, visual tool use, and framework-based agentic tasks. The authors emphasize the importance of multimodal perception, hierarchical optimization, and end-to-end verification in developing such agents.
Multimodal agents can now reason, plan, and execute actions more effectively by integrating perception as a core component, not just an auxiliary interface.
We present GLM-5V-Turbo, a step toward native foundation models for multimodal agents. As foundation models are increasingly deployed in real environments, agentic capability depends not only on language reasoning, but also on the ability to perceive, interpret, and act over heterogeneous contexts such as images, videos, webpages, documents, GUIs. GLM-5V-Turbo is built around this objective: multimodal perception is integrated as a core component of reasoning, planning, tool use, and execution, rather than as an auxiliary interface to a language model. This report summarizes the main improvements behind GLM-5V-Turbo across model design, multimodal training, reinforcement learning, toolchain expansion, and integration with agent frameworks. These developments lead to strong performance in multimodal coding, visual tool use, and framework-based agentic tasks, while preserving competitive text-only coding capability. More importantly, our development process offers practical insights for building multimodal agents, highlighting the central role of multimodal perception, hierarchical optimization, and reliable end-to-end verification.
