Search papers, labs, and topics across Lattice.
This paper introduces Class-Contrastive Influence (C2I), a novel criterion for evaluating and optimizing the usefulness of synthetic samples generated by diffusion models for few-shot medical image classification. By quantifying a sample's influence on classifier gradients, the authors demonstrate that high-C2I samples, which are boundary-proximal and challenging, significantly enhance decision boundary refinement and model robustness. The approach, validated across multiple benchmarks, shows that steering diffusion models towards class-informative samples leads to substantial improvements in downstream accuracy compared to traditional augmentation methods focused solely on image quality.
Class-Contrastive Influence reveals that the most effective synthetic samples for medical classification are not just realistic but strategically challenging, enhancing model robustness and accuracy.
When labeled data are scarce, off-the-shelf diffusion models can augment training sets for few-shot medical image classification, but not all generated samples are equally useful for the downstream task. Existing approaches largely improve synthetic data by increasing realism, diversity, or domain adaptation, while overlooking a more fundamental question: how should sample usefulness for classification be measured and optimized? We address this with Class-Contrastive Influence (C2I), a criterion that quantifies a sample's usefulness through its gradient-based influence on the classifier. We find that effective samples exhibit a strong C2I gap: their loss gradients align with validation gradients from the same class and oppose those from other classes. Our analysis further suggests that such high-C2I samples are hard, boundary-proximal examples that help refine the decision boundary and improve robustness. Building on this insight, we fine-tune diffusion models with reinforcement learning using a C2I-based reward to steer generation toward class-informative samples. Across several few-shot medical imaging benchmarks, C2I-guided generation improves downstream accuracy and robustness over diffusion-based augmentation baselines, showing that synthetic augmentation is most effective when guided by task usefulness rather than image quality alone.
