Search papers, labs, and topics across Lattice.
CoFL is introduced as an end-to-end policy for language-conditioned navigation that directly maps bird's-eye view observations and language instructions to a continuous flow field, eliminating the need for brittle modular components or costly action-sequence generation. This is achieved by predicting instantaneous velocities at arbitrary 2D locations, enabling smooth and reactive closed-loop control through numerical integration. Trained on a large-scale dataset of 500k BEV image-instruction pairs, CoFL outperforms VLM-based planners and generative policies, demonstrating successful zero-shot deployment in real-world environments.
Forget discrete actions: CoFL navigates with smooth, continuous flow fields, outperforming modular and generative baselines in language-conditioned tasks and even working zero-shot in the real world.
Language-conditioned navigation pipelines often rely on brittle modular components or costly action-sequence generation. To address these limitations, we present CoFL, an end-to-end policy that directly maps a bird's-eye view (BEV) observation and a language instruction to a continuous flow field for navigation. Instead of predicting discrete action tokens or sampling action chunks via iterative denoising, CoFL outputs instantaneous velocities that can be queried at arbitrary 2D projected locations. Trajectories are obtained by numerical integration of the predicted field, producing smooth motion that remains reactive under closed-loop execution. To enable large-scale training, we build a dataset of over 500k BEV image-instruction pairs, each procedurally annotated with a flow field and a trajectory derived from BEV semantic maps built on Matterport3D and ScanNet. By training on a mixed distribution, CoFL significantly outperforms modular Vision-Language Model (VLM)-based planners and generative policy baselines on strictly unseen scenes. Finally, we deploy CoFL zero-shot in real-world experiments with overhead BEV observations across multiple layouts, maintaining reliable closed-loop control and a high success rate.
