Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models
Provides a more efficient human-AI interaction method for correcting reasoning errors in large language models, reducing user effort and token waste.
Deep Interaction enables direct editing of erroneous steps in LLM chain-of-thought reasoning, achieving over 25% higher correction success rate and 40% token reduction on STEM tasks.
The emergence of Chain-of-Thought (CoT) reasoning has significantly enhanced the ability of large language models (LLMs) to tackle complex, multi-step tasks. However, when errors occur, current interaction approaches typically involve re-generating another response that may make mistakes again, or users laboriously flag the faulty step in follow-up turns that may get responses <You are right, I made a mistake here> followed by similar errors recurring. To address this issue, we propose an efficient human intervention mechanism for precisely correcting reasoning errors in LLMs, termed Deep Interaction. Our approach enables direct editing of the original response, allowing erroneous parts to be corrected while preserving accurate reasoning steps. We refine the edited CoT into a distilled prompt, which then steers the LLM along the corrected reasoning path. Experimental results show that our method achieves over a 25% improvement in correction success rate and reduces token usage by approximately 40% on STEM tasks reasoning compared to baseline approaches.