Search papers, labs, and topics across Lattice.
This paper introduces DiARC, a novel method that enhances the reasoning abilities of large language models (LLMs) on ARC-like tasks by incorporating negative sample supervision alongside positive samples. By constructing preference pairs through innovative methods such as output-level visual transformations and task-specific rule editing, DiARC allows models to better distinguish between correct and incorrect outputs. Experimental results demonstrate that DiARC significantly outperforms baseline models across various ARC-like benchmarks, highlighting the importance of negative sample differentiation in improving reasoning capabilities.
Distinguishing negative samples can boost LLM reasoning performance on ARC-like tasks by providing critical near-miss alternatives.
The Abstraction and Reasoning Corpus (ARC;~\citealp{chollet2019measure}) contains tasks that require summarizing patterns from limited grid samples and predicting output grids. Recently, many large language model based approaches have attempted to transform it into a text-based reasoning task. However, methods based on open-source models have generally yielded unsatisfactory results, while those relying on closed-source models are too costly. Current efforts mainly focus on data augmentation, constructing ARC-like data for more comprehensive supervised fine-tuning. In this work, we argue that solving ARC-like problems requires not only \textit{positive} sample supervision but also the ability to improve model reasoning by distinguishing \textit{negative} samples. To this end, we draw on the idea of preference alignment and propose \textsc{DiARC}, a method that constructs preference pairs to enable the model to distinguish between them. Specifically, we propose three ways to construct negative samples, including output-level visual transformations, DSL-level rule inversion, and task-specific rule editing. The resulting negative samples provide informative near-miss alternatives while keeping the observed demonstrations unchanged. Experimental results across multiple ARC-like benchmarks show that \textsc{DiARC} consistently improves performance over baseline models. The code is released at https://github.com/szu-tera/DiARC.
