Search papers, labs, and topics across Lattice.
This paper introduces Deep Interaction, a novel human intervention mechanism designed to efficiently correct reasoning errors in large language models (LLMs) during Chain-of-Thought (CoT) tasks. By allowing users to directly edit erroneous parts of the model's responses while maintaining accurate reasoning steps, the method significantly enhances the correction process. Experimental results demonstrate a more than 25% improvement in correction success rates and a 40% reduction in token usage for STEM reasoning tasks compared to existing methods.
Directly editing LLM responses can boost correction success rates by over 25% while slashing token usage by nearly 40%.
The emergence of Chain-of-Thought (CoT) reasoning has significantly enhanced the ability of large language models (LLMs) to tackle complex, multi-step tasks. However, when errors occur, current interaction approaches typically involve re-generating another response that may make mistakes again, or users laboriously flag the faulty step in follow-up turns that may get responses <You are right, I made a mistake here> followed by similar errors recurring. To address this issue, we propose an efficient human intervention mechanism for precisely correcting reasoning errors in LLMs, termed Deep Interaction. Our approach enables direct editing of the original response, allowing erroneous parts to be corrected while preserving accurate reasoning steps. We refine the edited CoT into a distilled prompt, which then steers the LLM along the corrected reasoning path. Experimental results show that our method achieves over a 25% improvement in correction success rate and reduces token usage by approximately 40% on STEM tasks reasoning compared to baseline approaches.
