Tree-of-Code: A Hybrid Approach for Robust Complex Task Planning and Execution
This addresses the challenge of robust complex task planning and execution for LLM-based agents, representing an incremental improvement over existing methods.
The paper tackles the problem of instability in LLM-based agents for complex tasks by proposing Tree-of-Code, a hybrid approach that integrates Tree-of-Thought and CodeAct to enhance solution exploration, resulting in improved robustness and consistency in agent applications.
The exceptional capabilities of large language models (LLMs) have substantially accelerated the rapid rise and widespread adoption of agents. Recent studies have demonstrated that generating Python code to consolidate LLM-based agents' actions into a unified action space (CodeAct) is a promising approach for developing real-world LLM agents. However, this step-by-step code generation approach often lacks consistency and robustness, leading to instability in agent applications, particularly for complex reasoning and out-of-domain tasks. In this paper, we propose a novel approach called Tree-of-Code (ToC) to tackle the challenges of complex problem planning and execution with an end-to-end mechanism. By integrating key ideas from both Tree-of-Thought and CodeAct, ToC combines their strengths to enhance solution exploration. In our framework, each final code execution result is treated as a node in the decision tree, with a breadth-first search strategy employed to explore potential solutions. The final outcome is determined through a voting mechanism based on the outputs of the nodes.