Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of bias detection and mitigation in medical image classifiers, particularly for minority subgroups, by utilizing a demographically-conditioned synthetic image generator. The authors demonstrate that using a synthetic cohort for pretraining significantly enhances classifier performance, achieving approximately 100 times the efficiency of real data while surpassing the baseline accuracy. Additionally, the synthetic estimator reliably reproduces subgroup rankings from a well-powered real oracle, providing a robust tool for bias audits in medical imaging.
A synthetic image generator can not only enhance training efficiency but also provide accurate bias detection in medical classifiers, outperforming traditional methods.
Per-subgroup fairness audits of medical image classifiers face a sample-size problem: minority subgroups in held-out test sets have so few samples that the resulting confidence intervals on per-subgroup performance are wider than the bias the audit is meant to detect. We argue that a demographically-conditioned synthetic generator can do both: mitigate bias on the training side and detect bias on the evaluation side. Working on COVID-19 chest CT classification with an end-to-end fine-tuned Stable Diffusion 2.1 generator, we make two findings. For bias mitigation (training), a demographically-balanced synthetic cohort is most useful as a pretraining prior, not as joint augmentation: with the same fixed data, sequential pretraining followed by fine-tuning substantially outperforms joint augmentation, and the resulting classifier surpasses the full-real baseline at $\sim$$100\times$ real-data efficiency. For bias detection (evaluation), across five synthetic minority cohorts and five classifier seeds, the synthetic estimator reproduces the subgroup ranking of a well-powered real oracle (Spearman $\rho = 1.00$ on MCC and Recall) and gives the more reliable per-cell estimate where the small real test set runs out of samples. The synthetic cohort is therefore most useful in exactly the cells that fairness audits care about, as both a fix for and a measure of subgroup bias.