Search papers, labs, and topics across Lattice.
The paper introduces QAQ, a novel data selection framework for synthetic code instruction data that leverages Reverse Mutual Information (RMI) to assess the semantic coherence between answers and queries ($Q|A$). QAQ identifies both low-quality data (low RMI indicating semantic misalignment) and over-simplified data (high RMI indicating defect patterns). Experiments on the WarriorCoder dataset show that selecting 25% of the data using stratified RMI achieves performance comparable to full-data training and outperforms existing data selection methods.
Forget instruction-following difficulty; this paper shows that evaluating how well the *answer* predicts the *query* is a surprisingly effective way to filter noisy synthetic code data.
Synthetic data has become essential for training code generation models, yet it introduces significant noise and hallucinations that are difficult to detect with current metrics. Existing data selection methods like Instruction-Following Difficulty (IFD) typically assess how hard a model generates an answer given a query ($A|Q$). However, this metric is ambiguous on noisy synthetic data, where low probability can distinguish between intrinsic task complexity and model-generated hallucinations. Here, we propose QAQ, a novel data selection framework that evaluates data quality from the reverse direction: how well can the answer predict the query ($Q|A$)? We define Reverse Mutual Information (RMI) to quantify the information gain about the query conditioned on the answer. Our analyses reveal that both extremes of RMI signal quality issues: low RMI indicates semantic misalignment, while excessively high RMI may contain defect patterns that LLMs easily recognize. Furthermore, we introduce a selection strategy based on the disagreement between strong and weak models to identify samples that are valid yet challenging. Experiments on the WarriorCoder dataset demonstrate that selecting just 25% of data using stratified RMI achieves comparable performance to full-data training, significantly outperforming existing data selection methods. Our approach highlights the importance of bidirectional semantic coherence in synthetic data curation, offering a scalable pathway to reduce computational costs without sacrificing model capability.
