Search papers, labs, and topics across Lattice.
The paper introduces VULCAN, a multi-agent cooperative navigation framework leveraging vision-language models (VLMs) for enhanced performance in indoor fire disaster response. They extend the Habitat-Matterport3D benchmark to simulate realistic fire scenarios, including smoke, thermal hazards, and sensor degradation. Experiments reveal significant performance degradation of existing vision-based multi-agent systems in fire scenarios, highlighting the need for robust perception and hazard-aware planning.
Existing multi-agent navigation systems crumble in realistic fire scenarios, but VULCAN points the way towards more robust, VLM-enhanced solutions.
Indoor fire disasters pose severe challenges to autonomous search and rescue due to dense smoke, high temperatures, and dynamically evolving indoor environments. In such time-critical scenarios, multi-agent cooperative navigation is particularly useful, as it enables faster and broader exploration than single-agent approaches. However, existing multi-agent navigation systems are primarily vision-based and designed for benign indoor settings, leading to significant performance degradation under fire-driven dynamic conditions. In this paper, we present VULCAN, a multi-agent cooperative navigation framework based on multi-modal perception and vision-language models (VLMs), tailored for indoor fire disaster response. We extend the Habitat-Matterport3D benchmark by simulating physically realistic fire scenarios, including smoke diffusion, thermal hazards, and sensor degradation. We evaluate representative multi-agent cooperative navigation baselines under both normal and fire-driven environments. Our results reveal critical failure modes of existing methods in fire scenarios and underscore the necessity of robust perception and hazard-aware planning for reliable multi-agent search and rescue.
