Search papers, labs, and topics across Lattice.
This study systematically compares two reranking paradigms for medical procedure retrieval: a small cross-encoder fine-tuned with listwise learning-to-rank objectives and a larger instruction-based reranker optimized through an agentic loop. The results reveal that the smaller model, with only 109 million parameters, significantly outperforms the larger 4 billion parameter model in both NDCG@3 and Spearman correlation metrics. This finding highlights the efficiency and effectiveness of smaller models in high-stakes medical information retrieval tasks, challenging the assumption that larger models always yield better performance.
A 109M-parameter cross-encoder outperforms a 4B-parameter instruction reranker in medical procedure retrieval, proving smaller can be better.
Reranking medical procedures against patient queries is a critical component of health insurance information retrieval, complicated by a substantial lexical gap between patient language and clinical nomenclature. We present a systematic comparison of two reranking paradigms for this production task: (1) small cross-encoders (MedCPT, MiniLM-L12) fine-tuned with listwise learning-to-rank objectives across layer freezing configurations, and (2) Qwen3-Reranker-4B, a 4B-parameter instruction reranker whose prompt is iteratively refined via an agentic optimization loop driven by GPT-4.1. On a purpose-built dataset of 2,647 queries across 708 insurance services, we find that a 109M-parameter cross-encoder fine-tuned with ListNet outperforms the 4B-parameter model by 2.6 percentage points on NDCG@3 and 13.3 points on Spearman correlation - at 37x fewer parameters. We report practical findings, a scalable LLM based dataset construction pipeline, and deployment trade-offs relevant to production reranking systems. We release our code and a sample dataset to support reproducibility and adaptation to other domains.
