Search papers, labs, and topics across Lattice.
This paper introduces Information Elicitation Agents (IEAs), conversational agents designed to proactively elicit information from users to support institutional objectives. To facilitate IEA research, the authors present YIELD, a 26M-token dataset of human-to-human dialogues focused on information elicitation. Experiments demonstrate that fine-tuning foundation LLMs on YIELD improves their ability to align with real-world elicitation behaviors, as validated by both automated metrics and human evaluations.
Forget passive chatbots – YIELD unveils how to build agents that proactively extract information, mirroring real-world scenarios like investigative journalism and legal proceedings.
Most conversational agents (CAs) are designed to satisfy user needs through user-driven interactions. However, many real-world settings, such as academic interviewing, judicial proceedings, and journalistic investigations, involve broader institutional decision-making processes and require agents that can elicit information from users. In this paper, we introduce Information Elicitation Agents (IEAs) in which the agent's goal is to elicit information from users to support the agent's institutional or task-oriented objectives. To enable systematic research on this setting, we present YIELD, a 26M-token dataset of 2,281 ethically sourced, human-to-human dialogues. Moreover, we formalize information elicitation as a finite-horizon POMDP and propose novel metrics tailored to IEAs. Pilot experiments on multiple foundation LLMs show that training on YIELD improves their alignment with real elicitation behavior and findings are corroborated by human evaluation. We release YIELD under CC BY 4.0. The dataset, project code, evaluation tools, and fine-tuned model adapters are available at: https://github.com/infosenselab/yield.
