Search papers, labs, and topics across Lattice.
This paper introduces NebulaExp, an empirical post-training pipeline that enhances the performance of the Qwen3-8B-base model through a detailed ablation study. By curating a diverse corpus of 3.84 million samples and employing a multi-faceted data processing approach, the authors achieve significant improvements in both instruction-following and reasoning capabilities, with benchmark scores rising from 55.01 to 61.85 for the instruct model and from 73.88 to 75.17 for the reasoning model. The findings highlight the effectiveness of systematic data curation and the use of multi-teacher reinforcement learning in optimizing large language models for specific tasks.
NebulaExp reveals that a meticulously curated dataset and innovative reinforcement learning strategies can boost LLM performance significantly, achieving up to 4.43 points improvement in instruction-following tasks with minimal data.
Post-training alignment determines the reasoning and human preference following capabilities of large language models, yet most existing works withhold detailed data construction, filtering rules and training recipes, which hinders community reproducibility and lightweight model optimization. This work presents NebulaExp, a fully transparent, ablation-driven post-training pipeline built on Qwen3-8B-base, covering two orthogonal model branches: general instruct model and complex reasoning-specialized model. We curate a raw corpus of 3.84M multi-source SFT samples and a 200K verifiable RL candidate pool, and design an end-to-end data processing stack including response distillation, multi-dimensional cross-verification filtering, fine-grained difficulty grading, task classification and diversity-aware sampling. For the Instruct branch, our three-stage optimized supervised fine-tuning approach NebulaExp-Ins-SFT improves the average benchmark score from the 55.01 baseline of Qwen3-8B-nothink to 60.99. GRPO reinforcement learning then further elevates the average score to 61.85. For the Reasoning branch, medium-difficulty GRPO RL improves average reasoning score from 73.88 to 75.17. To address RL's dependency on task verifiers, we systematically investigate single-teacher and multi-teacher OPD (MOPD): utilizing merely 4K instruction-following samples and outperforms RL baseline by 3.26 points on IFEval with +4.43 average overall gain; MOPD fuses four domain-specialist teachers with merely 10K samples, lifting average performance by 4.18 over the base model. This report provides a fully reproducible empirical post-training recipe for 8B-scale LLMs, and comprehensively dissects the capability trade-offs among instruction adherence, mathematical reasoning, code generation and general knowledge.
