Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SALT (Spatially Adaptive Label-guided Temperature), a novel self-distillation method that enhances lesion detection in CT scans by adapting the training signal based on weak spatial annotations. By sharpening the teacher's softmax temperature and up-weighting losses in compact regions defined by box-derived labels, the model improves its focus on relevant features while maintaining unchanged objectives and masking policies. The results demonstrate significant improvements in patch-level separability and 3D detection across multiple cohorts, showcasing the method's effectiveness in real-world applications without requiring extensive label conditioning.
Weak spatial annotations can dramatically enhance lesion detection performance in CT imaging, achieving superior results with minimal additional labeling effort.
Self-supervised pretraining objectives are spatially uniform: the teacher temperature and the per-patch loss weight are identical everywhere in the image, so a lesion a few patches wide contributes no more to the training signal than the surrounding parenchyma. Prior work biases the views toward annotated regions, which changes what the model sees but adds no pressure on the objective. We instead condition the targets of self-distillation, a method we call SALT (Spatially Adaptive Label-guided Temperature). Weak, box-derived labels, available only during pretraining, define a compact region on the encoder's patch grid, inside which the teacher's softmax temperature is sharpened and the masked-patch loss is up-weighted. The objectives, the masking policy and the centering statistics are otherwise unchanged, and at every downstream use the encoder is a plain feature extractor with no labels and no conditioning. We evaluate by freezing the encoder and training only a lightweight multi-depth CenterNet-style head, detecting lesions in 3D on four CT cohorts, and we isolate the mechanism against a backbone identical in architecture, pretraining data, schedule and label-guided cropping but with no target conditioning. We report patch-level separability, 3D detection stratified by cohort and by lesion size, box quality, and a detector-free probe in which a single frozen patch embedding re-identifies a lesion in a follow-up scan without registration, masks or fine-tuning. Because the conditioning is expressed through a spatial indicator rather than through label semantics, the formulation admits any weak spatial annotation; we instantiate and validate it for lesions.