Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors introduce a normalizing flow architecture decomposition that learns near-pivotal test statistics directly from simulator samples to perform likelihood-free inference over parameters of interest in the presence of nuisance parameters. By minimizing the average KL-divergence between the resulting p-values and a uniform distribution, the framework automates nuisance-invariant inference while naturally embedding prior group symmetries like scale and translation invariance. Empirically, the method autonomously rediscovers the one-sample $t$-test from data, beats Welch's test on worst-case size, and provides higher statistical power at a fraction of the computational cost of profile likelihood-ratio methods on small-to-moderate sample sizes.
Black-box simulator data is all a normalizing flow needs to automatically rediscover optimal, nuisance-invariant test statistics like the $t$-test—surpassing standard profile likelihoods in both statistical power and inference speed.
We present a simple decomposition of a neural-network-based normalizing flow that naturally uncovers a pivotal statistic (or something close) in the presence of nuisance parameters, based only on a sample generator from the distribution of interest. We show that the statistic is near-pivotal in the sense of minimum average KL-divergence of its $p$-values versus uniform and we argue that it can be expected to have good power when the dimension of the statistic equals the dimension of the parameter. It is able to incorporate prior knowledge about group invariances such as translation and scale. It can discover the one-sample $t$-test almost exactly, outperforms the Welch test in terms of worst-case size over a constrained variance-ratio range and achieves good calibration on partial biserial correlations, while showing higher power (and being much faster) on small-to-moderate samples than profile likelihood-ratio techniques.