Search papers, labs, and topics across Lattice.
This paper introduces CORTEX, a structured reasoning benchmark designed specifically for 3D chest CT multimodal large language models (MLLMs), addressing the critical gap in interpretability and traceability of diagnostic reasoning in medical imaging. By creating a four-stage diagnostic trace that aligns with a radiologist's workflow, the authors ensure that reasoning is not only captured but also verifiable through a robust evaluation protocol involving both automated scoring and expert review. The resulting dataset includes 76,177 validated reasoning traces, enabling the development and assessment of trustworthy reasoning models in a domain where accuracy and clarity are paramount.
CORTEX reveals that structured reasoning in 3D chest CT MLLMs can enhance diagnostic transparency and reliability, bridging a significant gap in medical imaging AI.
Reasoning in multimodal large language models (MLLMs) has shown strong promise in medical imaging. However, this reasoning is usually free-form text judged only by its final answer, making it hard to interpret and verify, especially in 3D radiology, where a diagnosis should be traceable to evidence in the scan. Existing chest CT question-answering datasets compound this by reducing expert radiology reports to answer-only pairs, dropping the reasoning that links findings to conclusions and omitting the patient history clinicians rely on. As a result, reasoning-capable 3D chest CT MLLMs remain out of reach, as neither the structured supervision needed to train them nor the protocol needed to verify their reasoning yet exists. We introduce CORTEX (Clinically Organized Reasoning and sTructured EXplanation), a structured reasoning benchmark for 3D chest CT. For each question, CORTEX restores the missing reasoning as a four-stage diagnostic trace mirroring a radiologist's workflow: task understanding, visual observation, diagnostic reasoning, and answer synthesis. We generate these traces using frontier large language models with broad medical and general-domain knowledge, then filter and verify them with a stage-level evaluation protocol combining automated rubric scoring with expert radiologist review. Crucially, both the reasoning structure and evaluation rubrics are designed in close collaboration with clinicians. Built on CT-RATE, a large, publicly available chest CT dataset without reasoning annotations, CORTEX comprises 76,177 validated reasoning traces across open-ended VQA, closed-ended VQA, and report generation, providing both the structured supervision and the stage-level evaluation protocol needed to build and evaluate trustworthy reasoning models for 3D chest CT. Our dataset and evaluation code will be made publicly available upon acceptance.
