Search papers, labs, and topics across Lattice.
This paper introduces GEIS, a Generation-Evaluation-Improvement loop designed to enhance long-form article generation by integrating modular skills for writing, evaluation, and iterative improvement. By implementing GEIS in the Tasi Harness, the authors demonstrate an 8.0-point increase in quality scores on a 100-point rubric compared to the default writer and outperform STORM in structural and content quality. The findings indicate that long-form generation can be effectively reframed into a flexible, inspectable process that allows for continuous enhancement based on evaluation feedback.
Long-form article generation can achieve a significant quality boost through a modular improvement loop that adapts based on structured evaluations.
Long-form article generation remains difficult for large language models because it combines long context, long instructions, and long outputs. Existing multi-agent pipelines such as STORM improve information coverage by simulating role-specialized agents, but their capabilities are often entangled in prompts and fixed procedures, making them hard to inspect, reuse, or iteratively improve. This paper presents GEIS (Generation-Evaluation-Improvement loop of agent Skills), a loop of named and declarative skills for Wikipedia-style long-form article generation. Implemented and evaluated in Tasi Harness, GEIS composes skills for article writing, browser-based evidence and image collection, diagram rendering, PDF-aware pairwise evaluation, and rule-level skill improvement. Its core writing skill follows Request, Plan, Draft, Audit, Refine, and Deliver; the pairwise evaluation skill produces structured quality reports; and the improvement skill maps recurrent findings into permanent patches to the writing skill in our 20-topic experiment. We evaluate GEIS on 20 Wikipedia Featured Article topics. Under the same generation backend, GEIS improves over the Tasi Harness default writer by 8.0 points on a 100-point PDF quality rubric and outperforms STORM on the two comparable writing dimensions, structural quality and content quality. In the 20-topic improvement experiment, the patched writing skill raises the average score from 82.90 to 86.95, with 17 out of 20 topics improved and the gain mainly coming from content quality. These results show that long-form generation can be reframed from a fixed workflow into an inspectable, modular, and evaluation-guided improvement loop.
Tsinghua AI