Search papers, labs, and topics across Lattice.
The paper introduces RANGER, a sparsely-gated Mixture-of-Experts (MoE) framework for pathology report generation from Whole Slide Images (WSIs). RANGER incorporates a sparsely gated MoE into the decoder with noisy top-$k$ routing and load-balancing regularization for dynamic expert specialization. It also includes an adaptive retrieval re-ranking module to refine retrieved knowledge from a knowledge base, reducing noise and improving semantic alignment. RANGER achieves state-of-the-art results on the PathText-BRCA dataset, demonstrating the effectiveness of dynamic expert routing and adaptive knowledge refinement.
Pathology report generation gets a boost from RANGER, a mixture-of-experts model that dynamically specializes and filters retrieved knowledge, significantly improving generation quality.
Pathology report generation remains a relatively under-explored downstream task, primarily due to the gigapixel scale and complex morphological heterogeneity of Whole Slide Images (WSIs). Existing pathology report generation frameworks typically employ transformer architectures, relying on a homogeneous decoder architecture and static knowledge retrieval integration. Such architectures limit generative specialization and may introduce noisy external guidance during the report generation process. To address these limitations, we propose RANGER, a sparsely-gated Mixture-of-Experts (MoE) framework with adaptive retrieval re-ranking for pathology report generation. Specifically, we integrate a sparsely gated MoE into the decoder, along with noisy top-$k$ routing and load-balancing regularization, to enable dynamic expert specialization across various diagnostic patterns. Additionally, we introduce an adaptive retrieval re-ranking module that selectively refines retrieved memory from a knowledge base before integration, reducing noise and improving semantic alignment based on visual feature representations. We perform extensive experiments on the PathText-BRCA dataset and demonstrate consistent improvements over existing approaches across standard natural language generation metrics. Our full RANGER model achieves optimal performance on PathText dataset, reaching BLEU-1 to BLEU-4 scores of 0.4598, 0.3044, 0.2036, and 0.1435, respectively, with METEOR of 0.1883, and ROUGE-L of 0.3038, validating the effectiveness of dynamic expert routing and adaptive knowledge refinement for semantically grounded pathology report generation.
