Search papers, labs, and topics across Lattice.
This paper introduces TriPAH, a novel Tri-Prompt Affinity Hashing framework designed to enhance cross-modal medical retrieval by addressing issues of semantic fragmentation in existing methods. By leveraging ontology-grounded, patient-level prompts and a lightweight prompt-token mixer, TriPAH achieves robust alignment between image and text representations while maintaining low-noise textual outputs. Experimental results on three public datasets reveal that TriPAH significantly surpasses state-of-the-art approaches in retrieval efficiency and accuracy, underscoring its potential for improving evidence-based diagnosis and case management.
TriPAH achieves unprecedented alignment in cross-modal medical retrieval, outperforming existing methods by effectively mitigating semantic fragmentation.
In the era of big medical data, efficient cross-modal retrieval is pivotal for evidence-based diagnosis and large-scale case management. Cross-modal medical hashing retrieval aims to enable efficient image-text search and support downstream tasks such as case-based reasoning and decision support by learning compact, semantically aligned binary codes. However, current methods suffer from semantic fragmentation due to noisy clinical language, long-tailed labels, and brittle quantization that weakens alignment. We propose TriPAH, a Tri-Prompt Affinity Hashing framework. TriPAH synthesizes ontology-grounded, patient-level prompts conditioned on normalized clinical cues to yield low-noise textual representations for initial alignment. A lightweight prompt-token mixer performs hierarchical, multi-granularity alignment and produces quantization-ready features under an asymmetric multi-task objective coupling multi-positive contrastive alignment, imbalance-aware classification, and progressive quantization regularization. A patient-level consistency module further stabilizes codes across complementary views. Extensive experiments on three public datasets demonstrate that TriPAH significantly outperforms state-of-the-art methods.
