Search papers, labs, and topics across Lattice.
This paper introduces VecLang, a novel framework that reformulates multiclass vector mapping from remote sensing imagery into structured text generation, leveraging a GeoJSON-like vector language. By employing a progressive vision-language mapping approach and Hierarchical Vector Language Optimization, VecLang effectively captures heterogeneous geospatial entities while ensuring syntax validity and content fidelity. Extensive experiments reveal that VecLang excels in both single-class and multiclass vector mapping tasks, achieving robust generalization across datasets and open-vocabulary scenarios.
Transforming vector mapping into a language-based task unlocks unprecedented flexibility and generalization in remote sensing applications.
Remote sensing vector mapping aims to generate structured maps of geospatial entities, such as buildings, roads, and water bodies, from remote sensing imagery. In practice, vector maps usually contain multiple category layers and heterogeneous entity structures, requiring a unified model for diverse mapping needs. However, existing methods typically represent vector objects as polygons or graphs, making them suitable only for specific categories: polygons poorly capture topological relations, while graphs often blur instance boundaries. We observe that language, as a natural medium for human communication, offers a flexible and expressive representation that can accommodate heterogeneous map elements, including geometry, semantics, and topolog. Motivated by this insight, we propose Vector Map as Language (VecLang), a unified paradigm that reformulates multiclass vector mapping as structured text generation. VecLang encodes the common elements of different geospatial entities into a GeoJSON-like vector language, enabling cross-category modeling within a shared textual format. To generate this language reliably, we design a progressive vision-language mapping framework that first localizes vectorization units and then generates structured map elements. We further introduce Hierarchical Vector Language Optimization, which uses reinforcement learning to improve syntax validity, content fidelity, and map executability. We also build VecMap-Bench with 54K images and 800K instances, supporting training and evaluation across standard and generalization settings. Extensive experiments demonstrate that VecLang handles both single-class and multiclass vector mapping while achieving strong cross-dataset and open-vocabulary generalization. The model and dataset are publicly available at https://github.com/yyyyll0ss/VecLang.
