Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To eliminate the prohibitive latency of gigapixel pathology foundation models, the authors distill the large-scale UNI2-h vision transformer into a 34.7M-parameter ConvNeXt-Tiny student via output-level knowledge distillation. The compressed student model retains 98.8% of the teacher's task performance (0.519 mPQ on PanNuke and 0.668 zero-shot bPQ on MoNuSeg) while unlocking a 21.8x inference speedup at 634.3 images per second. Crucially, the work shows that architectural modifications like multi-scale gated convolutions provide zero empirical gain under foundation ViT teachers, proving simple output logit transfer is sufficient to close the capacity gap.
Compressing a giant pathology ViT into a 20x smaller ConvNeXt retains 98.8% of segmentation accuracy while delivering a 21.8x speedup, showing that lightweight convolutional backbones can match foundation-scale models via simple output-level distillation alone.
Nuclei instance segmentation is a core task in digital pathology, yet high-accuracy models rely on large vision transformer (ViT) encoders whose inference speed cannot meet real-time clinical demands. We propose a lightweight scheme that distills the UNI2-h pathology foundation model into a ConvNeXt-Tiny student (Ours-T, 34.7M parameters, 1/20 of the teacher) via output-level knowledge distillation. Ours-T achieves an mPQ of 0.519 on PanNuke (98.8% of the teacher), a zero-shot bPQ of 0.668 on MoNuSeg, and an inference speed of 634.3 img/s, requiring only 0.045 s for full-resolution 1024^2 analysis (21.8x speedup). Experiments further show that multi-scale gated convolution (MALA) yields no gain under ViT encoders, and output-level distillation alone suffices for efficient knowledge transfer.