Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a general framework for amortized Bayesian inference on arbitrary multilevel models, automatically deriving posterior factorizations and neural network architectures from a directed acyclic graph specification. By employing graph expansion and inversion, the method constructs inference networks that amortize over group and within-group observation counts, preserving all conditional independence and exchangeability assumptions. The approach achieves performance comparable to gold-standard samplers on complex models with over 6,500 parameters, reducing inference to a rapid forward pass after training.
Arbitrary multilevel models can now be amortized with neural networks that precisely preserve their full conditional independence structure, outperforming samplers on large-scale problems.
We develop a general method for amortized Bayesian inference on multilevel models of arbitrary structure. Given a generative model specified as a directed acyclic graph, our method automatically derives valid factorizations of the joint posterior and matching neural network architectures. The key steps, graph expansion and graph inversion, yield an inverse graph that determines how inference networks are stacked and conditioned, producing factorizations that amortize over the number of groups and the number of observations within each group. Unlike approaches that simplify the dependency structure to speed up learning or inference, our method preserves all conditional independence and exchangeability assumptions of the generative model. Across three case studies, it closely matches gold-standard samplers on models with more than 6,500 parameters while reducing inference to a near-instant forward pass once trained.