Search papers, labs, and topics across Lattice.
This paper investigates why LLMs produce less diverse ideas than humans, identifying fixation and lack of knowledge partitioning as key mechanisms. They show that Chain-of-Thought prompting reduces fixation in LLMs by encouraging structured reasoning, while using ordinary personas improves knowledge partitioning by anchoring generation in distinct semantic regions. Combining these interventions yields higher idea diversity than humans, offering a path to improve human-AI collaborative ideation.
LLMs can actually outperform humans in generating diverse ideas, but only if you strategically prompt them to overcome fixation with Chain-of-Thought and mimic human knowledge partitioning with diverse personas.
Ideas generated by independent samples of humans tend to be more diverse than ideas generated from independent LLM samples, raising concerns that widespread reliance on LLMs could homogenize ideation and undermine innovation at a societal level. Drawing on cognitive psychology, we identify (both theoretically and empirically) two mechanisms undermining LLM idea diversity. First, at the individual level, LLMs exhibit fixation just as humans do, where early outputs constrain subsequent ideation. Second, at the collective level, LLMs aggregate knowledge into a unified distribution rather than exhibiting the knowledge partitioning inherent to human populations, where each person occupies a distinct region of the knowledge space. Through four studies, we demonstrate that targeted prompting interventions can address each mechanism independently: Chain-of-Thought (CoT) prompting reduces fixation by encouraging structured reasoning (only in LLMs, not humans), while ordinary personas (versus "creative entrepreneurs" such as Steve Jobs) improve knowledge partitioning by serving as diverse sampling cues, anchoring generation in distinct regions of the semantic space. Combining both approaches produces the highest idea diversity, outperforming humans. These findings offer a theoretically grounded framework for understanding LLM idea diversity and practical strategies for human-AI collaborations that leverage AI's efficiency without compromising the diversity essential to a healthy innovation ecosystem.
