Search papers, labs, and topics across Lattice.
Diagnosable ColBERT is introduced to improve the interpretability and debuggability of late-interaction retrieval models like ColBERT. It aligns ColBERT token embeddings to a reference latent space informed by clinical knowledge and conceptual similarity constraints. This alignment allows for inspecting document encodings as evidence of model understanding, facilitating error diagnosis and data curation.
Unlock the black box of late-interaction retrieval models: Diagnosable ColBERT lets you directly inspect what the model "understands" by aligning token embeddings to a clinically-grounded latent space.
Reliable biomedical and clinical retrieval requires more than strong ranking performance: it requires a practical way to find systematic model failures and curate the training evidence needed to correct them. Late-interaction models such as ColBERT provide a first solution thanks to the interpretable token-level interaction scores they expose between document and query tokens. Yet this interpretability is shallow: it explains a particular document--query pairwise score, but does not reveal whether the model has learned a clinical concept in a stable, reusable, and context-sensitive way across diverse expressions. As a result, these scores provide limited support for diagnosing misunderstandings, identifying irreasonably distant biomedical concepts, or deciding what additional data or feedback is needed to address this. In this short position paper, we propose Diagnosable ColBERT, a framework that aligns ColBERT token embeddings to a reference latent space grounded in clinical knowledge and expert-provided conceptual similarity constraints. This alignment turns document encodings into inspectable evidence of what the model appears to understand, enabling more direct error diagnosis and more principled data curation without relying on large batteries of diagnostic queries.
