ChatLogic: Integrating Logic Programming with Large Language Models for Multi-Step Reasoning
This addresses a specific bottleneck in LLM reasoning for AI applications, but appears incremental as it builds on existing logic programming methods.
The paper tackles the problem of large language models (LLMs) struggling with multi-step deductive reasoning due to memory limitations, and introduces ChatLogic, a framework integrating logic programming to enhance performance, showing significant improvements in these tasks.
Large language models (LLMs) such as ChatGPT and GPT-4 have demonstrated impressive capabilities in various generative tasks. However, their performance is often hampered by limitations in accessing and leveraging long-term memory, leading to specific vulnerabilities and biases, especially during long interactions. This paper introduces ChatLogic, an innovative framework specifically targeted at LLM reasoning tasks that can enhance the performance of LLMs in multi-step deductive reasoning tasks by integrating logic programming. In ChatLogic, the language model plays a central role, acting as a controller and participating in every system operation stage. We propose a novel method of converting logic problems into symbolic integration with an inference engine. This approach leverages large language models' situational understanding and imitation skills and uses symbolic memory to enhance multi-step deductive reasoning capabilities. Our results show that the ChatLogic framework significantly improves the multi-step reasoning capabilities of LLMs. The source code and data are available at \url{https://github.com/Strong-AI-Lab/ChatLogic}