Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study addresses the challenge of automating whole-slide image analysis for cancer characterization by refining noisy zero-shot predictions using a few-shot transduction approach. The authors introduce SlideCRF, a method that integrates spatial and biological cues while accommodating class imbalances and absent classes in whole-slide images. Their results demonstrate a significant improvement in macro F1 scores, achieving enhancements of +24.2% and +37.5% with minimal annotations, thereby showcasing the effectiveness of their approach in realistic clinical settings.
SlideCRF achieves a remarkable +37.5% improvement in predictive accuracy with just 16 clicks, transforming how pathologists can interact with AI in cancer diagnostics.
Automating the analysis of whole-slide images has high clinical value, since characterizing cancers requires examining them in detail. Such analysis increasingly relies on vision-language models that provide patch-level zero-shot predictions. However, these predictions remain noisy and must be refined with a few annotations. A promising paradigm for this refinement is few-shot transduction. Rather than treating each patch independently, these methods leverage the relations between patches, together with a few annotations, to refine all predictions jointly. However, current transductive methods are evaluated under conditions that overlook key properties of whole-slide images: (i) datasets consist of independent patches extracted from multiple slides, ignoring the complex tissue organization; (ii) datasets are mostly balanced, whereas a single whole-slide image exhibits severe class imbalance, with several classes absent; and (iii) annotations are sampled at random, without reflecting how a pathologist annotates a limited number of regions. To align the transduction paradigm to realistic whole-slide settings, we introduce the following contributions. First, we propose SlideCRF, which adapts conditional random fields for whole-slide images by combining spatial and biological cues while accounting for classes that may be absent from a given slide. Second, we provide a set of realistic annotation protocols, based on spatially localized clicks and scribbles, modeling different pathologist interactions, such as the iterative correction of model errors. Across four datasets, we show that SlideCRF outperforms current transductive methods in macro F1, improving over the zero-shot predictions by +24.2% and +37.5% with one and 16 clicks per present class, respectively.