Search papers, labs, and topics across Lattice.
This paper explores the use of in-context learning (ICL) for imputing missing survey data, addressing the common issue of partial non-response in public opinion datasets. By systematically evaluating various ICL design choices across different missingness mechanisms, the authors demonstrate that their approach significantly outperforms traditional imputation methods like MICE PMM, particularly in scenarios with non-random missingness (MNAR). The best-performing model, utilizing gpt-oss-120b with 100 in-context examples, achieves near-nominal aggregate coverage and produces much narrower confidence intervals than conventional methods.
ICL for imputing missing survey data not only outperforms traditional methods but also offers confidence intervals that are two to five times narrower.
Large language models have been widely evaluated as simulators of individual survey responses. In practice, however, fully unobserved responses are rare; the dominant problem is partial non-response. Imputation aims to restore the overall structure of a survey dataset by filling in these missing values. It has its own well-defined evaluation criteria and differs fundamentally from prediction. We propose to impute missing survey data through in-context learning (ICL). We systematically evaluate ICL design choices across different missingness mechanisms (MCAR, MAR, MNAR) on 150 opinion variables spanning 15 waves of the American Trends Panel. Compared to well-established statistical methods for data imputation like MICE PMM, our ICL approach consistently reduces absolute error across all missingness mechanisms, with the largest gains under non-random missingness (MNAR). Notably, the best-performing specification (gpt-oss-120b with 100 in-context examples) achieves near-nominal aggregate coverage (approaching the 95% level) with confidence intervals two to five times narrower than MICE PMM. We publish a Python package with an sklearn-like API to enable easy deployment of our method using local and proprietary LLMs.
