Search papers, labs, and topics across Lattice.
This paper introduces the TEA-AgriVLN method, which enhances Vision-and-Language Navigation in Continuous Environments (VLN-CE) by integrating a traversability estimation module specifically designed for agricultural scenes. Unlike indoor environments where traversability is often clear-cut, agricultural landscapes present ambiguous conditions that can mislead navigation decisions. The proposed TEA module significantly improves navigation success rates and reduces navigation errors, achieving state-of-the-art performance on the A2A benchmark with a Success Rate increase from 0.47 to 0.54 and a Navigation Error reduction from 2.91 m to 2.70 m.
Agricultural navigation systems can now better handle ambiguous traversability, improving success rates by 15% in challenging environments.
Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires an agent to follow a natural language instruction, predicting a sequence of low-level actions to navigate a robot from a starting point to a target location. The A2A benchmark and the AgriVLN method pioneeringly extended VLN-CE from indoor scenes to agricultural scenes, while we observed a challenging distinction: In indoor scenes, whether a zone is traversable tends to be clear to classify, such as wood floors are traversable but concrete walls are not. In agricultural scenes, however, this issue tends to be ambiguous, such as an unripe cornfield might be traversable for a robotic dog but might be non-traversable for a human. To address this issue, we propose the TEA module, which estimates the traversability of the camera image, then alarm the decision-maker for rethinking when the predicted action does not align with the traversability map. We integrate it into the AgriVLN backbone to build our TEA-AgriVLN method. When evaluated on A2A, it improves Success Rate (SR) from 0.47 to 0.54 and Navigation Error (NE) from 2.91 m to 2.70 m, showing the state-of-the-art performance in the agricultural VLN-CE domain. We further implement the ablation studies and the case study, discussing the effectiveness and limitations of TEA on different ground categories and scene classes. Code: https://github.com/AlexTraveling/TEA-AgriVLN.
