IAO Prompting: Making Knowledge Flow Explicit in LLMs through Structured Reasoning Templates
This work addresses the challenge of understanding and validating knowledge application in LLMs for researchers and practitioners, offering a method to trace and verify reasoning, though it is incremental over existing prompting techniques.
The authors tackled the problem of making knowledge utilization in Large Language Models (LLMs) explicit and verifiable by introducing IAO prompting, a structured template-based method that decomposes reasoning into input-action-output steps, which improved zero-shot performance and enhanced transparency in knowledge flow.
While Large Language Models (LLMs) demonstrate impressive reasoning capabilities, understanding and validating their knowledge utilization remains challenging. Chain-of-thought (CoT) prompting partially addresses this by revealing intermediate reasoning steps, but the knowledge flow and application remain implicit. We introduce IAO (Input-Action-Output) prompting, a structured template-based method that explicitly models how LLMs access and apply their knowledge during complex reasoning tasks. IAO decomposes problems into sequential steps, each clearly identifying the input knowledge being used, the action being performed, and the resulting output. This structured decomposition enables us to trace knowledge flow, verify factual consistency, and identify potential knowledge gaps or misapplications. Through experiments across diverse reasoning tasks, we demonstrate that IAO not only improves zero-shot performance but also provides transparency in how LLMs leverage their stored knowledge. Human evaluation confirms that this structured approach enhances our ability to verify knowledge utilization and detect potential hallucinations or reasoning errors. Our findings provide insights into both knowledge representation within LLMs and methods for more reliable knowledge application.