Search papers, labs, and topics across Lattice.
This paper introduces AERIS, a novel framework that integrates small language models with lightweight perception and control modules for aerial robotic systems, enabling dynamic role assignment and resource management at runtime. By employing an attention-subgoal alignment mechanism, AERIS effectively decomposes long-horizon instructions, facilitating real-time decision-making in resource-constrained environments. Evaluated on a UAV Vision-and-Language Navigation benchmark, AERIS successfully maintains a stable perception-decision-control loop, demonstrating its practical deployability in real-world scenarios.
AERIS enables real-time, role-driven intelligence for aerial robots, adapting dynamically to resource constraints while maintaining high-performance navigation capabilities.
Integrating large language models into robotic systems holds promise for enhancing autonomy, yet practical deployment remains constrained by strict heartbeat-constrained scheduling and limited computational power. We propose AERIS: an edge deployment framework for aerial platforms. It organizes dedicated small language models combined with lightweight perception and control modules into roles that can be instantiated at runtime, and dynamically rebinds them across different executors as resources change, thereby pushing intelligent capabilities to the edge. AERIS achieves long-horizon instruction decomposition through an attention-subgoal alignment mechanism, which involves annotating the currently active instruction step in messages, thereby progressively approaching long-term objectives. We evaluate AERIS on a high-fidelity UAV Vision-and-Language Navigation benchmark. Under a heartbeat-timed execution mechanism, AERIS maintains a stable perception-decision-control loop between a low-frequency planner and a high-frequency controller, supporting real-time closed-loop operation. We further validate its deployability through two real-world experiments focused on planning and fast response. A demonstration video is provided in the supplementary materials.
