Search papers, labs, and topics across Lattice.
This paper reviews the transformative role of AI in economic measurement, highlighting how AI models can efficiently convert unstructured data into structured variables, thereby enabling scalable measurement that was previously unfeasible. It shifts the focus from merely identifying scalable measures to critically selecting among multiple plausible options that may yield different empirical insights. The authors emphasize the necessity of rigorous validation processes to ensure credible inference from AI-generated variables, advocating for explicit criteria over informal proxies to anchor measurement accuracy.
AI-driven measurement could redefine empirical research by shifting the focus from finding measures to selecting among diverse, potentially conflicting options.
Artificial intelligence (AI) is transforming measurement in economics. AI models convert unstructured data, such as text and images, into structured variables at low cost, making previously prohibitive measurement feasible at scale. This shifts the bottleneck from finding any scalable measure of a phenomenon to choosing among many plausible ones, which may support different empirical conclusions. This review provides guidance for navigating that shift. We describe three stages at which AI enters the measurement pipeline---discovery, construct definition, and observation---and what each demands of researchers. We argue that credible inference with AI-generated variables requires appropriately designed validation: anchoring measurement to explicit criteria, rather than informal claims that a proxy is reasonable. We then examine how validation samples support valid inference even when AI predictions are arbitrarily biased, and what can be done when a random validation sample is unavailable.
