Search papers, labs, and topics across Lattice.
This paper addresses the challenge of maintaining long-horizon logical consistency in interactive narratives generated by Large Language Models (LLMs), introducing the concept of Narrative Commitment Preservation (NCP). The authors present NCP-Bench, a benchmark consisting of 100 narrative environments derived from movie synopses, which allows for automated checking of narrative integrity during user interactions. Experimental results reveal a significant consistency gap, with the best-performing model achieving only a 42% survival rate after 20 turns, highlighting that high linguistic quality does not ensure commitment preservation in LLMs.
Even the most advanced LLMs struggle to maintain narrative consistency, with a staggering 68% of generated content conflicting under user interventions.
The rapid advancement of Large Language Models (LLMs) is revolutionizing AI for Games by enabling open-ended and fluid interactive storytelling. However, existing research has largely overlooked the critical challenge of maintaining long-horizon logical consistency and narrative integrity against unconstrained user interventions. To address this, we formulate this challenge as Narrative Commitment Preservation (NCP), and take interactive narrative as our testbed. We introduce NCP-Bench, a benchmark of 100 narrative environments derived from movie synopses. Each environment includes a structured narrative specification (trajectory, commitments, and initial facts) that we can automatically check throughout the interaction between the player agent and the narrator agent. Experiments across state-of-the-art LLMs reveal a substantial long-horizon consistency gap: high linguistic quality does not guarantee commitment preservation; even strong models frequently generate logically conflicting content under adversarial interventions, with the best-performing model (GPT-5.2) achieving only 42% survival rate after 20 turns and fact conflict rates ranging from 40% to 68% across models, and only isolated runs satisfying all achievement commitments within the 100-turn limit.
Tsinghua AI