Search papers, labs, and topics across Lattice.
This paper enhances task-oriented dialogue systems by adapting the ReAct framework to improve dynamic information retrieval and reduce hallucinations in responses. By implementing an unsupervised fine-tuning pipeline that leverages in-context learning and LLM-based filtering, the authors construct a high-quality training set that enables LLMs to access external knowledge effectively. Experiments reveal that their fine-tuned 8B model significantly outperforms a larger 70B in-context model, showcasing superior reasoning and tool utilization capabilities.
Fine-tuned 8B models can outperform 70B counterparts in reasoning and tool use, challenging assumptions about model size superiority.
Current dialogue systems struggle with dynamic information retrieval, often leading to hallucinations and lower response accuracy. We address this by adapting the ReAct framework for Task-Oriented Dialogue, enabling Large Language Models (LLMs) to access external knowledge and produce factual responses. Mainly, we propose an unsupervised fine-tuning pipeline that harvests reasoning trajectories via in-context learning inference. High-quality samples are filtered using an LLM-based judge to construct a robust training set. This is enhanced by a unsupervised self-improvement loop, where improved checkpoints generate increasingly better trajectories for subsequent fine-tuning iterations. Experiments on the SIMMC dataset demonstrate that ReAct-based systems outperform baselines due to superior reasoning and tool use. Notably, our fine-tuned 8B model surpasses a 70B in-context system. Finally, we present an error analysis, impact of scene complexity, and cross-domain generalization.
