Search papers, labs, and topics across Lattice.
The paper introduces "One Sentence, One Drama," a hierarchical multi-agent framework for generating short dramas from a single sentence prompt. This framework addresses limitations in existing approaches by focusing on narrative pacing, spatial consistency, and production-level quality control through iterative refinement and structured intermediate modules. Experiments using the new Short-Drama-Bench benchmark demonstrate that the proposed method significantly outperforms existing pipelines in narrative quality, cross-clip consistency, and overall viewing experience.
Forget clunky pipelines: this multi-agent system crafts compelling short dramas from a single sentence, nailing narrative pacing and spatial consistency in ways LLMs alone can't.
Existing approaches for digital short-drama production typically rely on one-shot LLM generated scripts and loosely coupled pipelines, which fail to satisfy three key requirements of short-drama generation: (1) narrative pacing, resulting in weak hooks, insufficient escalation, and unattractive endings; (2) spatial consistency, leading to drifting scene layouts and inconsistent character positions across clips; and (3) production-level quality control, requiring extensive manual review and correction across script and visual stages. We present One Sentence, One Drama, a hierarchical multi-agent framework that transforms a user's single-sentence idea into a fully produced short drama through structured intermediate modules and iterative refinement. Our approach is built upon three key components: (1) a multi-agent debate-based story generation module that enforces short-drama pacing and narrative coherence; (2) a 3D-grounded first-frame generation mechanism that establishes a shared spatial reference for consistent character positioning and scene layout across clips; and (3) multi-stage reviewer loops that perform comprehensive error detection and targeted revision across script, visual, and video generation stages. We also introduce scene-level BGM matching and scene transition planning to improve the audience's immersive experience. To systematically evaluate this task, we introduce Short-Drama-Bench, a benchmark that extends standard video quality metrics with short-drama-specific criteria. Experimental results demonstrate that our method significantly outperforms existing pipelines in narrative quality, cross-clip consistency, and overall viewing experience.
NUS