Search papers, labs, and topics across Lattice.
This paper introduces a novel framework that leverages large language models (LLMs) for program synthesis in the context of simulation-based inference, allowing for both model selection and parameter estimation. By generating and refining candidate simulator programs based on natural language descriptions and iterative feedback, the approach enables exploration of a diverse set of models rather than being constrained to a single fixed structure. The framework demonstrates high accuracy across various benchmarks, effectively identifying plausible model families that align with the data's information content and the identifiability of the models.
LLMs can autonomously generate and refine simulation models, revealing complex relationships in data that traditional methods might overlook.
Neural simulation-based inference enables parameter estimation for complex models, but typically requires the user to specify a simulator encoding a fixed model structure. We present a framework for joint model selection and parameter estimation that combines large language models for program synthesis with neural simulation-based inference. Given a natural language description of the system and data under investigation, an LLM proposes candidate simulator programs which are iteratively refined via feedback-driven mutation and evaluated using neural density estimation. The approach enables simulation-based inference over a pool of models, not just parameters within a fixed model. On benchmarks spanning deterministic dynamics, stochastic epidemic models, and dark matter substructure inference from gravitational-lensing images, the method identifies plausible model families from open-ended prompts, with accuracy that reflects the information content of the data and identifiability of candidate models.
