Search papers, labs, and topics across Lattice.
This paper introduces the concept of hybrid panels, a novel AI-enabled survey infrastructure that integrates large language models (LLMs) with human participants to enhance the quality and efficiency of longitudinal surveys. By iteratively refining the alignment between LLMs and target populations, the hybrid panel aims to address critical issues such as declining response rates and nonresponse bias while maintaining data integrity. The pilot study reveals both the potential benefits and challenges of implementing this approach, highlighting the need for careful design and participant recruitment strategies.
Hybrid panels could revolutionize survey research by leveraging AI to improve participant engagement and data quality in real-time.
Large-scale population surveys are essential for generating robust social and scientific insights, yet they face significant challenges, including declining response rates, increasing data collection costs, long delays between data collection and data provision, and the risk of nonresponse bias. Advances in artificial intelligence (AI) have opened up new opportunities for AI-supported survey infrastructures where the goal is to overcome these challenges without limiting the data quality. A promising AI-enabled survey infrastructure for which we build a first pilot is a hybrid panel. A hybrid panel is a longitudinal AI-enabled survey which allows to iteratively improve the alignment between large language models (LLMs) and the population they aim to simulate and use the errors to inform the design and implementation of the next survey wave (e.g., inform the participant recruitment, assignment of questions to participants). It incorporates both human participants and LLMs as fundamental elements of its design. In this research note, we introduce the concept of a hybrid panel by providing a definition and outlining an overarching framework, spanning data collection to data validation. We detail results from a first pilot study to illustrate (open) challenges that we identify for hybrid panels.
