Search papers, labs, and topics across Lattice.
The paper introduces DeNuC, a method that decouples nuclei detection and classification in histopathology to improve the performance of pathology foundation models (FMs). DeNuC uses a lightweight model for nuclei localization, followed by a pathology FM to encode images and extract nucleus-specific features for classification based on the detected coordinates. Experiments on three benchmarks show that DeNuC unlocks the representational potential of FMs for nuclei detection and classification, achieving significant F1 score improvements with fewer trainable parameters compared to state-of-the-art methods.
Decoupling nuclei detection and classification in histopathology unlocks significant performance gains in pathology foundation models while drastically reducing the number of trainable parameters.
Pathology Foundation Models (FMs) have shown strong performance across a wide range of pathology image representation and diagnostic tasks. However, FMs do not exhibit the expected performance advantage over traditional specialized models in Nuclei Detection and Classification (NDC). In this work, we reveal that jointly optimizing nuclei detection and classification leads to severe representation degradation in FMs. Moreover, we identify that the substantial intrinsic disparity in task difficulty between nuclei detection and nuclei classification renders joint NDC optimization unnecessarily computationally burdensome for the detection stage. To address these challenges, we propose DeNuC, a simple yet effective method designed to break through existing bottlenecks by Decoupling Nuclei detection and Classification. DeNuC employs a lightweight model for accurate nuclei localization, subsequently leveraging a pathology FM to encode input images and query nucleus-specific features based on the detected coordinates for classification. Extensive experiments on three widely used benchmarks demonstrate that DeNuC effectively unlocks the representational potential of FMs for NDC and significantly outperforms state-of-the-art methods. Notably, DeNuC improves F1 scores by 4.2% and 3.6% (or higher) on the BRCAM2C and PUMA datasets, respectively, while using only 16% (or fewer) trainable parameters compared to other methods. Code is available at https://github.com/ZijiangY1116/DeNuC.
