Diverge to Induce Prompting: Multi-Rationale Induction for Zero-Shot Reasoning
For LLM users, DIP offers a more stable and accurate zero-shot reasoning method by leveraging multi-rationale induction.
DIP improves zero-shot reasoning accuracy by generating multiple diverse rationales per question and inducing them into a final plan, outperforming single-strategy prompting without resource-intensive sampling.
To address the instability of unguided reasoning paths in standard Chain-of-Thought prompting, recent methods guide large language models (LLMs) by first eliciting a single reasoning strategy. However, relying on just one strategy for each question can still limit performance across diverse tasks. We propose Diverge-to-Induce Prompting (DIP), a framework that first prompts an LLM to generate multiple diverse high-level rationales for each question. Each rationale is then elaborated into a detailed, step-by-step draft plan. Finally, these draft plans are induced into a final plan. DIP enhances zero-shot reasoning accuracy without reliance on resource-intensive sampling. Experiments show that DIP outperforms single-strategy prompting, demonstrating the effectiveness of multi-plan induction for prompt-based reasoning.