Search papers, labs, and topics across Lattice.
This paper introduces MT-Web2Code, a novel benchmark designed to evaluate coding agents on multi-turn tasks involving Macro-Level Regional Reconstruction and Micro-Level Localized Modification in web UI generation. By utilizing a Reverse-Corruption Trajectory Engine, the authors create a set of 102 tasks across 16 domains that simulate real-world iterative coding workflows without the need for extensive human annotation. Experimental results reveal that current coding agents struggle with maintaining fidelity in target-region reconstruction and visual-code alignment during localized modifications, highlighting significant limitations in their performance over multiple interactions.
Current coding agents falter in preserving content integrity while reconstructing UI regions, revealing critical gaps in their iterative coding capabilities.
Recent advances in Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in web UI generation. However, existing benchmarks predominantly focus on single-turn full-page generation from scratch, overlooking the iterative workflow of real-world frontend engineering, where developers repeatedly reconstruct missing regions and modify localized elements within existing codebases. To bridge this gap, we introduce MT-Web2Code, the first multimodal coding benchmark for multi-turn Macro-Level Regional Reconstruction and Micro-Level Localized Modification, which contains 102 tasks spanning 16 vertical domains. To construct deterministic repair trajectories without costly turn-level human annotation, we develop a scalable Reverse-Corruption Trajectory Engine that iteratively injects structural and stylistic defects into golden pages. We further propose a dual-axis evaluation protocol that measures target-region fidelity and the preservation of unaffected content, where regional reconstruction is assessed by a 5-dimensional VLM-based rubric and localized modification by deterministic pixel-grounded alignment. Experiments on 13 frontier coding agents reveal that current agents struggle to faithfully reconstruct target regions while preserving unaffected content, lack fine-grained visual-code alignment for localized edits, and suffer from error snowballing over multiple turns. Beyond benchmarking, our deterministic evaluation metrics provide fine-grained feedback signals that may facilitate future research on training iterative UI coding agents. Our evaluation code and data will soon be released.
