Search papers, labs, and topics across Lattice.
This paper introduces OTCHA, a novel method for multi-view medical image classification that leverages optimal transport to align latent hub tokens across different views. By refining patch tokens before fusion and incorporating confidence-aware mechanisms, OTCHA effectively mitigates the impact of irrelevant artifacts and enhances the robustness of the classification process. Experimental results show that OTCHA consistently outperforms existing methods across multiple datasets and varying anatomical views, highlighting its effectiveness in clinical applications.
OTCHA's optimal transport-driven approach not only refines token representations but also filters out irrelevant information, leading to superior multi-view classification performance.
Multi-view imaging, such as mammography and chest radiography, is a standard component of clinical practice. However, medical images are often unregistered and contain view-specific artifacts or irrelevant background cues that can obscure diagnostically relevant findings. Many existing methods directly fuse per-view representations, allowing such irrelevant content to contaminate the fused embedding and reducing robustness under varying view configurations. We propose OTCHA, a confidence-aware latent hub token alignment module based on optimal transport (OT) that refines patch tokens before fusion for multi-view classification. OTCHA introduces a set of learnable latent hub tokens shared across views. For each view, we compute an OT plan between patch tokens and hub tokens that jointly considers feature similarity and geometry, and augment the OT formulation with token-conditional dustbins to enable partial matching and discard irrelevant tokens. The resulting transport plan provides token-wise matching confidence, which gates hub-mediated message passing and weights a novel optimal-transport-based representation alignment loss to stabilize refinement. Experiments on three multi-view medical image datasets demonstrate consistent improvements over competing baselines across diverse anatomies and view configurations. Our code is available at https://github.com/labhai/OTCHA.
