Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The EVEREST model introduces an egocentric exploration strategy for urban socio-semantic segmentation, addressing the limitations of existing methods that rely on passive aggregation of global cross-modal cues. By actively investigating boundary cues and employing reinforcement learning alongside discrete natural-language prompts as pseudocode, EVEREST enhances the model's structured reasoning capabilities. This approach results in optimal performance across all metrics on real-world urban datasets, significantly improving boundary delineation accuracy.
EVEREST's egocentric exploration strategy revolutionizes urban segmentation by actively refining boundary detection, outperforming traditional passive methods.
Urban socio-semantic segmentation leverages digital and satellite imagery to provide critical spatial semantic information for downstream applications such as urban resource allocation. Although existing methods achieve high segmentation accuracy, they still suffer from inaccurate delineation of target boundaries. The underlying issue is that current models primarily rely on passively aggregated global cross-modal cues, lacking active exploration of the environment. To address this limitation, we propose the EVEREST model, which adopts an egocentric exploration strategy that enables the model to actively investigate boundary cues and perform self-correction. In addition, we formulate discrete natural-language prompts as pseudocode to regularize the execution logic. Reinforcement learning is further employed to implement this irreducible process and elicit the model's structured reasoning capability. Our EVEREST achieves optimal performance on all metrics in the real world urban socio-semantic dataset, demonstrating the superiority of our model. Codes are available at https://anonymous.4open.science/r/EVEREST-9D21/.