Search papers, labs, and topics across Lattice.
This paper introduces CT-3GDINO, a lightweight 3D detector designed for reliable organ localization in abdominal CT scans by utilizing a query-based architecture with frozen pseudo-text class tokens. The model leverages a Swin3D visual backbone and a cross-modality decoder to effectively predict 3D bounding boxes for multiple organs, achieving a top-1 class-wise mAP of 0.5830 across various IoU thresholds. The results highlight its strong performance in coarse localization while indicating challenges in strict box alignment, establishing CT-3GDINO as a valuable open-source tool for future research in organ localization.
A novel lightweight 3D detector achieves high organ localization accuracy in abdominal CT scans using pseudo-text conditioning, setting a new open-source benchmark.
Reliable organ localization in abdominal CT can provide spatial priors for downstream trauma analysis. We propose CT-3GDINO, a lightweight 3D detector that adapts a Grounding-DINO-style query-based architecture to fixed organ localization using frozen pseudo-text class tokens instead of a real text encoder. The model combines a Swin3D visual backbone, bidirectional feature enhancement, pseudo-text-guided query selection, and a cross-modality decoder to predict normalized 3D boxes for liver, spleen, left kidney, right kidney, and bowel. We train and evaluate on 193 matched RSNA/RATIC CT volumes with segmentation-derived boxes. The best multi-scale model, trained from scratch, achieves 0.5830 overall top-1 class-wise mAP over 3D IoU thresholds from 0.1 to 0.7, outperforming fixed- and trainable-backbone classification-pretrained variants with 0.5570 and 0.4657 mAP. Performance is strong for coarse localization, with 0.9649 AP at IoU 0.1, but remains limited for strict box alignment, with 0.1552 AP at IoU 0.7. These results establish CT-3GDINO as an open-source baseline for pseudo-text-conditioned 3D organ localization and motivate future work on localization-aware pretraining, richer multimodal conditioning, and injury-focused detection.
