Search papers, labs, and topics across Lattice.
This paper introduces a two-stage framework for voxel-level grounding of free-text findings in 3D chest CT scans, addressing the challenges posed by spatial complexity and text heterogeneity. By decoupling the tasks of lesion segmentation and text-volume reasoning, the model first identifies candidate sub-volumes before aligning them with textual descriptions using anatomical guidance. The approach outperforms existing methods on the ReXGroundingCT benchmark, achieving state-of-the-art grounding quality and highlighting the effectiveness of separating detection from reasoning in complex medical imaging tasks.
Decoupling lesion detection from text alignment leads to unprecedented accuracy in grounding free-text findings in 3D chest CT scans.
Automatic voxel-level grounding of free-text findings in 3D chest Computed Tomography (CT) is critical for clinical interpretability. However, this task remains highly challenging due to the intricate spatial complexity of large 3D volumes and the heterogeneity of free-text findings. Existing end-to-end approaches often struggle to simultaneously learn the localized feature representations required for accurate 3D segmentation and the complex semantic understanding needed for text alignment, leading to suboptimal grounding performance. To overcome this fundamental limitation, we propose a novel decoupled framework that disentangles the problem into two specialized stages: (1) class-agnostic lesion segmentation and (2) text-volume reasoning. This structural separation allows the model to first extract candidate sub-volumes by localizing potential abnormalities. Subsequently, intensive cross-modal reasoning is performed to align these localized sub-volumes with free-text medical findings. To resolve the spatial ambiguities inherent in local regions, the reasoning module is augmented with explicit anatomical guidance, utilizing relative spatial coordinates and lung lobe priors. Evaluated on the ReXGroundingCT benchmark, our method achieves state-of-the-art performance in overall grounding quality on the official leaderboard. These results demonstrate that decoupling detection from reasoning is a highly effective paradigm for handling the complexity of 3D medical visual grounding. Our code is publicly available at https://github.com/khuhm/DAGG.