Editing Large Language Models: Problems, Methods, and Opportunities
It addresses the challenge of maintaining LLM relevancy and accuracy for researchers and practitioners, but is incremental as it focuses on synthesizing and evaluating existing editing techniques rather than introducing a novel method.
This paper tackles the problem of efficiently editing large language models to correct errors or update knowledge without degrading overall performance, by providing a comprehensive survey, empirical analysis of existing methods, and a new benchmark dataset for robust evaluation.
Despite the ability to train capable LLMs, the methodology for maintaining their relevancy and rectifying errors remains elusive. To this end, the past few years have witnessed a surge in techniques for editing LLMs, the objective of which is to efficiently alter the behavior of LLMs within a specific domain without negatively impacting performance across other inputs. This paper embarks on a deep exploration of the problems, methods, and opportunities related to model editing for LLMs. In particular, we provide an exhaustive overview of the task definition and challenges associated with model editing, along with an in-depth empirical analysis of the most progressive methods currently at our disposal. We also build a new benchmark dataset to facilitate a more robust evaluation and pinpoint enduring issues intrinsic to existing techniques. Our objective is to provide valuable insights into the effectiveness and feasibility of each editing technique, thereby assisting the community in making informed decisions on the selection of the most appropriate method for a specific task or context. Code and datasets are available at https://github.com/zjunlp/EasyEdit.