Search papers, labs, and topics across Lattice.
The authors construct a data-centric post-training pipeline for financial reasoning that pairs knowledge-graph-guided synthetic generation and trace mining with classifier-based filtering for rule-verifiable tasks. Mitigating capability loss during domain adaptation is critical, as standard supervised fine-tuning often destroys existing reasoning capabilities in foundational checkpoints. Evaluated on FINESSE-Bench, standard SFT degraded accuracy by 3.2–4.0 percentage points, whereas self-distilled SFT gained 1.0–2.8 points and targeted GRPO delivered up to a 3.0-point improvement.
Standard SFT degrades financial reasoning benchmarks by up to 4 percentage points, but pairing self-distillation with rule-verified GRPO transforms domain post-training from a capability tax into a 3-point gain.
Financial text, textbooks, and question-answer pairs are abundant, but only a small fraction is directly usable for reasoning-focused post-training. Existing QA pairs often lack explicit reasoning, sufficient context, or reliably verifiable answers, while textbooks must first be transformed into synthetic training examples. We present a data-centric pipeline that constructs complementary corpora by mining open-source reasoning traces, distilling financial instruction data, and generating knowledge-graph-guided question-answer pairs from financial educational material. After semantic deduplication, three lightweight sequence classifiers select finance-relevant examples, reject under-specified questions, and identify tasks suitable for reinforcement learning with compact rule-based verifiers. For model adaptation, we study supervised fine-tuning and reinforcement learning, while self-distilled fine-tuning and post-training model merging are used to prevent the loss of financial capabilities already present in the starting model. We evaluate the adapted language models using FINESSE-Bench, reporting aggregate performance and changes relative to their starting checkpoints. Across the selected comparisons, ordinary SFT reduces FINESSE-Bench accuracy by 3.2-4.0 percentage points, whereas self-distilled SFT improves over the corresponding starting models by 1.0-2.8 points. Equal-weight merging recovers 3.0 points over its SFT parent and finishes 0.9 points above the original model; GRPO on hard tasks adds 0.4 points after self-distilled SFT or 3.0 points when applied directly to verifiable tasks. These results show that retention-aware adaptation can improve financial reasoning without the regressions observed after ordinary SFT.
