Linear Feedback Control Systems for Iterative Prompt Optimization in Large Language Models
This addresses the challenge of achieving desired outputs in LLMs for users needing precise control, though it appears incremental by applying existing control theory concepts to a new context.
The paper tackles the problem of iterative prompt refinement in Large Language Models by proposing a novel approach that treats the deviation between LLM output and desired result as an error term, akin to feedback control systems, and explores different controllers within this framework.
Large Language Models (LLMs) have revolutionized various applications by generating outputs based on given prompts. However, achieving the desired output requires iterative prompt refinement. This paper presents a novel approach that draws parallels between the iterative prompt optimization process in LLMs and feedback control systems. We iteratively refine the prompt by treating the deviation between the LLM output and the desired result as an error term until the output criteria are met. This process is akin to a feedback control system, where the LLM, despite being non-linear and non-deterministic, is managed using principles from linear feedback control systems. We explore the application of different types of controllers within this framework, providing a mathematical foundation for integrating linear feedback control mechanisms with LLMs.