Search papers, labs, and topics across Lattice.
The paper introduces CoDA, a novel domain adaptation technique for improving LLM reasoning in low-resource domains by transferring knowledge from high-resource domains. CoDA uses a lightweight adapter to align the latent reasoning representations of source and target domains through feature-based distillation of Chain-of-Thought (CoT) enriched representations and Maximum Mean Discrepancy (MMD). Experiments across multiple logical reasoning tasks demonstrate that CoDA significantly outperforms existing cross-domain transfer methods.
LLMs can now reason far better in low-resource domains, thanks to a new method that aligns their thinking with high-resource domains using "reasoning representation alignment."
Large language models (LLMs) have achieved substantial advances in logical reasoning, yet they continue to lag behind human-level performance. In-context learning provides a viable solution that boosts the model's performance via prompting its input with expert-curated, in-domain exemplars. However, in many real-world, expertise-scarce domains, such as low-resource scientific disciplines, emerging biomedical subfields, or niche legal jurisdictions, such high-quality in-domain demonstrations are inherently limited or entirely unavailable, thereby constraining the general applicability of these approaches. To mitigate this limitation, recent efforts have explored the retrieval of cross-domain samples as surrogate in-context demonstrations. Nevertheless, the resulting gains remain modest. This is largely attributable to the pronounced domain shift between source and target distributions, which impedes the model's ability to effectively identify and exploit underlying shared structures or latent reasoning patterns. Consequently, when relying solely on raw textual prompting, LLMs struggle to abstract and transfer such cross-domain knowledge in a robust and systematic manner. To address these issues, we propose CoDA, which employs a lightweight adapter to directly intervene in the intermediate hidden states. By combining feature-based distillation of CoT-enriched reference representations with Maximum Mean Discrepancy (MMD) for kernelized distribution matching, our method aligns the latent reasoning representation of the source and target domains. Extensive experimental results on multiple logical reasoning tasks across various model families validate the efficacy of CoDA by significantly outperforming the previous state-of-the-art baselines by a large margin.
