Search papers, labs, and topics across Lattice.
SciFigure2Code introduces a benchmark of 6,740 expert-reviewed panels and a 337-panel test suite (SciFigureBench) designed to evaluate multimodal models on generating editable Python plotting code that reproduces scientific figure visual hierarchy, layout, and styling. By targeting presentation recovery rather than ill-posed raw measurement extraction, the framework establishes an auditable protocol that captures visual encodings, multi-component layouts, and domain-specific annotations across 31 chart subtypes. Across evaluations of 14 zero-shot models, even frontier systems like Claude Opus struggled significantly with complex multi-panel arrangements, legends, and scientific labels, though two-stage plan-then-code prompting provided consistent execution and fidelity gains.
Turning published scientific figures back into executable Python remains a brittle frontier for top VLMs, with even frontier models routinely failing on multi-component layouts, precise axis semantics, and domain typography.
Scientific figures are the interface through which research claims are inspected and reused, but final published panels rarely expose the data or plotting code that produced them. Recovering this hidden provenance from pixels is therefore underdetermined. We introduce SciFigure2Code, an AI-reconstructed benchmark that instead evaluates presentation recovery: generating editable Python programs that preserve how a scientific panel is arranged and read. Role-specialized Codex agents generate, execute, visually refine, and audit silver-standard presentation programs that capture geometry, visual hierarchy, encodings, annotations, and typography without claiming to recover original measurements or author source code. This reconstruction-and-audit protocol turns final published panels into auditable reference packages; the resulting resource contains 6,740 reviewed panels and SciFigureBench, a balanced 337-panel test set across 31 chart subtypes, five domains, and three complexity levels. Across 14 zero-shot models in image-only and caption-assisted settings, execution, multi-component layouts, axes, legends, and scientific labels remain weak. Claude Opus 4.7 achieves the highest image-only Overall score, Claude Opus 4.6 leads caption-assisted reconstruction, and two-stage plan-then-code prompting improves Overall for all four tested models. SciFigure2Code provides an auditable testbed for agents that construct editable, visually faithful scientific figure presentations.
Tsinghua AI