Search papers, labs, and topics across Lattice.
This paper introduces OCP-CT, an organ-conditioned pattern-token alignment framework designed to enhance vision-language pretraining for computed tomography (CT) by addressing the limitations of existing global scan-report contrast methods. By implementing a sparse Mixture-of-Experts (MoE) approach to route image and text tokens based on latent radiological patterns, OCP-CT achieves a finer alignment that captures the heterogeneous appearances of anatomy. The framework demonstrates significant improvements in zero-shot abnormality diagnosis, achieving AUROCs of 84.5% and 69.9% on CT-RATE and RAD-ChestCT benchmarks, respectively, surpassing previous state-of-the-art results.
OCP-CT achieves a remarkable 6.7 percentage point improvement in zero-shot abnormality diagnosis, showcasing the power of organ-conditioned pattern tokens in CT understanding.
Computed tomography (CT) vision-language pretraining from paired volumes and radiology reports is a scalable yet challenging task. Existing methods commonly adopt global scan-report contrast, which is scalable but obscures heterogeneous organ evidence. Meanwhile, direct organ-level alignment remains coarse, since the same anatomy can exhibit multiple distinct radiological appearances. Therefore, pretraining requires a finer alignment unit: the organ-conditioned radiological pattern. In this work, we propose OCP-CT, an organ-conditioned pattern-token alignment framework for CT vision-language pretraining. Specifically, OCP-CT preserves a stable global CT-report contrastive branch and introduces an organ pattern interface: sparse Mixture-of-Experts (MoE) routes image and text tokens according to latent radiological patterns, learnable slots query the routed tokens into continuous pattern tokens, and paired token contrast aligns image-text pattern tokens with structured soft targets built from report-derived clinical similarity. On the publicly available CT-RATE and RAD-ChestCT benchmarks, OCP-CT achieves average AUROCs of 84.5% and 69.9% for zero-shot abnormality diagnosis, respectively. Compared with the strongest prior reported results, these results yield absolute AUROC gains of 6.7 and 0.8 percentage points.
