Search papers, labs, and topics across Lattice.
The paper introduces a method for generating synthetic instruction datasets tailored to specific domains, focusing on enhancing reasoning capabilities in LLMs. They create a large-scale (9.5B tokens) financial domain dataset with Chain-of-Thought reasoning traces using domain-specific vocabulary as a starting point. Experiments demonstrate that fine-tuning on this synthetic data improves performance on financial benchmarks, and the study analyzes the impact of reasoning trace length.
Unlock domain-specific LLM reasoning by generating synthetic instruction data from vocabulary alone, achieving gains on financial benchmarks.
In adapting LLMs to specific domains, achieving both domain expertise and reasoning ability remains an urgent challenge. This study proposes a general method for constructing high-quality synthetic instruction data for any domain, starting from domain-specific vocabulary. As a demonstration, we applied this method to the financial domain and constructed a large-scale instruction dataset totaling approximately 9.5 billion tokens with Chain-of-Thought reasoning traces. Evaluation results confirmed performance improvements over baseline models on financial benchmarks, demonstrating the effectiveness of our approach. We also report findings on the impact of reasoning trace length on performance and its limitations. Lastly, we open-source our models and datasets on https://huggingface.co/nri-ai .
