Search papers, labs, and topics across Lattice.
The paper introduces SynthBH, a new multiple hypothesis testing procedure that leverages synthetic data to improve power while controlling the False Discovery Rate (FDR). SynthBH guarantees finite-sample, distribution-free FDR control under a PRDS-type positive dependence condition, even when the pooled-data p-values are not valid under the null. Empirical results on tabular outlier detection and genomic analyses demonstrate that SynthBH adapts to the quality of synthetic data, boosting power when synthetic data is high quality and maintaining FDR control regardless of its quality.
Injecting synthetic data into multiple hypothesis testing can boost statistical power without sacrificing false discovery rate control, even when the synthetic data is noisy.
Multiple hypothesis testing with false discovery rate (FDR) control is a fundamental problem in statistical inference, with broad applications in genomics, drug screening, and outlier detection. In many such settings, researchers may have access not only to real experimental observations but also to auxiliary or synthetic data -- from past, related experiments or generated by generative models -- that can provide additional evidence about the hypotheses of interest. We introduce SynthBH, a synthetic-powered multiple testing procedure that safely leverages such synthetic data. We prove that SynthBH guarantees finite-sample, distribution-free FDR control under a mild PRDS-type positive dependence condition, without requiring the pooled-data p-values to be valid under the null. The proposed method adapts to the (unknown) quality of the synthetic data: it enhances the sample efficiency and may boost the power when synthetic data are of high quality, while controlling the FDR at a user-specified level regardless of their quality. We demonstrate the empirical performance of SynthBH on tabular outlier detection benchmarks and on genomic analyses of drug-cancer sensitivity associations, and further study its properties through controlled experiments on simulated data.
