Search papers, labs, and topics across Lattice.
GEAR-Seg introduces a decoupled framework for reasoning segmentation that enhances interpretability by translating visual inputs into detailed textual descriptions, thereby separating perception from deduction. This approach allows for explicit tracking of reasoning processes, leading to competitive performance in zero-shot inference across various benchmarks. Additionally, the framework supports the creation of GEAR-131K, a large-scale dataset that facilitates complex reasoning tasks, while lightweight models trained on this data can achieve performance comparable to human-annotated systems.
GEAR-Seg transforms reasoning segmentation by decoupling perception and deduction, enabling explicit logic tracking and competitive zero-shot performance.
Reasoning segmentation requires localizing targets based on complex, implicit queries. Current end-to-end models typically entangle perception and deduction into an opaque black box, severely limiting interpretability and scalability. To address this, we propose GEAR-Seg (Grounded Explainable Agent for Reasoning Segmentation), an explicitly decoupled agent that shifts the paradigm by translating visual pixels into dense, attribute-rich text. By decoupling class-agnostic segmentation, semantic description, and Large Language Model (LLM) deduction, GEAR-Seg transforms implicit reasoning into an explicit, trackable logic chain. As a zero-shot inference framework, it achieves highly competitive performance across diverse reasoning and fine-grained referring segmentation benchmarks. Furthermore, GEAR-Seg inherently functions as a highly scalable data engine. Utilizing this engine, we construct GEAR-131K, a massive benchmark (over 38k images, 656k QA-mask pairs) introducing a multifaceted taxonomy tailored for complex real-world manipulation-oriented reasoning. Finally, distillation experiments demonstrate that lightweight models supervised exclusively by our automated pipeline closely match the upper-bound performance of costly human-annotated baselines.
