Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper rigorously examines the conditions under which text embeddings can be effectively used for empirical analysis, particularly focusing on their validity in clustering and controlling for high-dimensional text data. By framing the use of embeddings within a generative model of document topic mixtures, the author establishes a clear link between embedding clusters and interpretable economic archetypes. The findings reveal that embedding-based clusters outperform traditional methods in distinguishing local employment dynamics across 363 U.S. metropolitan areas, highlighting the practical utility of embeddings in economic analysis.
Embedding-based clusters can reveal interpretable economic archetypes that traditional methods miss, enhancing our understanding of local employment dynamics.
When do text embeddings work as inputs to empirical analysis? Their use rests on an assumption: that we can trade text for its low-dimensional embedding, and lose little in doing so. I make that assumption precise under a generative model in which documents are mixtures of latent topics. I study two uses---clustering units in embedding space and controlling for high-dimensional text. A cluster of embeddings is a set of documents with similar topic mixtures; controlling for the embedding is equivalent to controlling for the topic mixture, so validity reduces to whether that mixture captures the confounding. In an application to 363 U.S. metropolitan areas, embedding-based clusters of LLM-generated economic descriptions recover interpretable economic archetypes and separate local employment dynamics more sharply than clustering on model residuals, or on a curated set of industry and demographic covariates.