Search papers, labs, and topics across Lattice.
This paper introduces Edit2TikZ, a benchmark designed to evaluate scientific figure editing through TikZ code, addressing the complexities of visual structure recovery, change grounding, and code generation. The benchmark consists of 1,548 diverse samples and incorporates a human-aligned evaluation framework to assess the accuracy of edits while preserving unrelated content. Evaluations of 14 mainstream MLLMs reveal that current models struggle with compilation success and edit correctness, but a mixed training set and curriculum learning significantly enhance performance, particularly for smaller models.
Current MLLMs achieve only a 75% compilation success rate in scientific figure editing, but targeted training can boost performance to over 83%.
Although multimodal large language models (MLLMs) have shown substantial potential in visual understanding and graphic code generation, editing scientific figures through code presents a greater challenge: a model must jointly recover visual structure, ground the requested change, generate compilable code, and preserve all unrelated content. While existing TikZ benchmarks mainly focus on figure reconstruction and generation, few systematically evaluate instruction-guided scientific figure editing with compilable code. We introduce Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples. Edit2TikZ combines real-world and controlled synthetic edit cases, supports both textual and visual localization request, and contains multi-step editing, each with step-level annotations. We further construct a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved. Utilizing Edit2TikZ, we evaluate 14 mainstream MLLMs and find that current systems remain unreliable: on average, proprietary models achieve a compilation success rate of merely 75% and remain limited in both figure restoration and edit correctness, while compact models below 9B struggle further with instruction following and complete figure generation. Therefore, we build a mixed training set TikZEditMix and adopt reconstruction-then-editing curriculum learning for compact models. On Qwen3.5-4B, this training improves the compilation success rate from 45.35% to 83.40% and yields an average improvement of 18.7 points across our proposed evaluation metrics. The code and data will be released at https://github.com/Solunny/Edit2TikZ.
