CLAILGMay 8

Position: The Term "Machine Unlearning" Is Overused in LLMs

arXiv:2606.27379
Originality Synthesis-oriented
AI Analysis

For researchers and practitioners in LLM safety and compliance, this paper clarifies terminology to prevent misuse of metrics and benchmarks, ensuring that evaluations match the claimed objective.

This position paper argues that the term 'machine unlearning' is overused in LLM research and should be reserved for dataset-defined deletion, while many tasks labeled as unlearning (e.g., refusal, knowledge removal) pursue different objectives and require distinct terminology and evaluation.

Large language models increasingly face demands to "forget" training data, knowledge, or behaviors due to regulatory deletion obligations, copyright/licensing disputes, and safety or product-policy requirements. This position paper argues that machine unlearning is overused as a term in LLM research and should be reserved for dataset-defined deletion: removing the training influence of a precisely specified forget set such that the resulting model is approximately indistinguishable from retraining without that data. We contend that many tasks currently labeled "unlearning" (e.g., refusal for harmful requests, entity/knowledge removal, or targeted suppression) pursue different, often policy-dependent objectives and therefore require different terminology and baselines (e.g., alignment, suppression, editing, obfuscation). We further argue that this confusion is not cosmetic: because papers make different implicit guarantees under the same label, metrics and benchmarks are frequently reused outside their intended scope, rewarding surface-level non-disclosure (e.g., low ROUGE/forget accuracy) even when retraining-equivalence is not tested and derived capabilities remain. We conclude by calling for stricter terminology tied to explicit guarantees and reference models, and for evaluations that match the claimed objective.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes