Search papers, labs, and topics across Lattice.
The authors develop a symbolic distillation pipeline that converts black-box amortized neural likelihoods into closed-form, interpretable mathematical expressions for simulation-based inference. By guiding symbolic regression with an objective explicitly tied to downstream parameter recovery rather than passive function fitting, the distilled likelihoods avoid common fidelity-utility trade-offs. Evaluated on diffusion decision models and empirical hierarchical Bayesian inference, the resulting symbolic expressions run over 100 times faster than both the original neural approximations and exact analytical likelihoods with minimal loss in estimation precision.
Distilling neural likelihoods directly for parameter recovery yields compact, closed-form equations that evaluate over 100x faster than even analytical ground truth with negligible precision loss.
Amortized neural likelihoods enable computationally expensive inference for models with analytically intractable or unspecified likelihoods, but their black-box nature limits interpretability. We introduce a symbolic distillation pipeline that converts trained neural likelihoods into explicit, interpretable expressions optimized for efficient parameter estimation. Our approach uses a recovery-directed objective to guide symbolic regression toward expressions that preserve parameter-recovery accuracy rather than merely approximating the likelihood function. Candidate expressions are evaluated on held-out datasets and selected using a criterion that jointly accounts for expression complexity, parameter-recovery performance, and distributional distance from the learned likelihood. We evaluate the pipeline on the diffusion decision model, a classical cognitive model, whose analytically tractable likelihood provides ground truth for controlled evaluation. The proposed recovery-directed objective improves parameter recovery over standard symbolic-regression objectives. The resulting symbolic likelihoods enable over 100 times faster parameter evaluation than both neural likelihoods and, when available, the exact likelihood, while maintaining a manageable loss in precision. We further demonstrate these computational benefits in Bayesian hierarchical inference on empirical data. Our pipeline provides a lightweight interface for integrating symbolic distillation with existing neural-likelihood estimation methods and can be adapted to a range of simulation-based inference settings.