Search papers, labs, and topics across Lattice.
This paper introduces CoCoEvolve, a novel framework designed to enhance consistency in cross-representation learning among charts, tables, and visualization code by establishing explicit one-to-one correspondences. By optimizing models based on agreement between these representations without requiring additional annotations, CoCoEvolve effectively addresses the inherent one-to-many mapping challenges. The results demonstrate significant performance improvements across four benchmarks during both training and test phases, showcasing the framework's robustness and adaptability.
Achieving unprecedented consistency in cross-representation learning, CoCoEvolve outperforms existing methods by leveraging one-to-one correspondences without extra annotations.
As chart images, tabular data, and visualization code play increasingly important roles across diverse domains, cross-representation understanding across these modalities poses fundamental challenges for AI systems: the relationships across representations are inherently \textit{one-to-many}, supervision is ambiguous and costly, and model optimization lacks a principled signal that is both direction-adaptive and representation-generalizable beyond task-specific objectives. We introduce CoCoEvolve to improve consistency across chart, table, and code representations. Instead of treating cross-representation mapping as a one-to-many problem, we define explicit one-to-one correspondences and optimize models using agreement between representations, without additional annotations. During training, CoCoEvolve@Train performs co-evolution across the chart-table-code cycle, while CoCoEvolve@Test applies the same consistency objective at inference time for test-time co-optimization. We also present CoCoEvolve@Eval, an evaluation suite covering all six cross-representation tasks. Across four benchmarks, CoCoEvolve improves performance in both training-time and test-time settings. Our project page: https://xhguo7.github.io/CoCoEvolve/.
AI2