Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper critically examines the use of synthetic agents based on LLMs in various representational contexts, highlighting the ethical and political implications of substituting human participants. Through three case studies—local policy, enterprise jury deliberation, and global diplomacy—the authors argue that legitimacy and personhood are intertwined, raising concerns about the representational integrity of these processes. The findings underscore the need for careful oversight and the establishment of boundaries when integrating synthetic agents into participatory frameworks.
Substituting human participants with synthetic agents in critical decision-making processes risks undermining the very legitimacy of democratic institutions.
Synthetic agents built atop LLM-based foundation models are gaining popularity as substitutes for human participants across research contexts, including user-testing, market-research, computational social science, surveys, and qualitative research. We are also witnessing an extension of synthetic agents into experimental implementations of policy consultation, jury deliberation, humanitarian diplomacy, and similar contexts where human participation and representation are central to the perceived legitimacy of the institutional processes. The value of participation extends beyond informational contributions and consensus generation; participation is a necessary, legitimizing condition for democratic political institutions and processes. Treating synthetic agents as human substitutes raises serious political, representational, and ethical concerns. Participatory Design's modes of engagement --- probing, priming, understanding, and generating --- offer helpful tools for engaging with representational questions of personhood. We apply the lens to three case studies of synthetic agents substituting for personhood at varying representational scales: local policy, enterprise jury deliberation, and global diplomacy. We argue that legitimacy and personhood are integral and mutually constitutive while identifying the ethical, representational, and methodological risks of using synthetic agents in representational processes. We conclude by proposing soft and hard boundaries for designing oversight on LLMs and synthetic agents in representational processes.