Machine Learners Should Acknowledge the Legal Implications of Large Language Models as Personal Data
This addresses a critical legal and ethical problem for ML researchers and developers using LLMs, highlighting regulatory risks and proposing community-level solutions, though it is incremental in building on existing legal frameworks.
The paper tackles the problem of large language models (LLMs) potentially containing personal data from training, showing that this triggers data protection laws like GDPR, which grant rights such as access and erasure. It argues that ML researchers must acknowledge these legal implications throughout the development lifecycle and proposes ways to improve alignment between law and technology.
Does GPT know you? The answer depends on your level of public recognition; however, if your information was available on a website, the answer could be yes. Most Large Language Models (LLMs) memorize training data to some extent. Thus, even when an LLM memorizes only a small amount of personal data, it typically falls within the scope of data protection laws. If a person is identified or identifiable, the implications are far-reaching. The LLM is subject to EU General Data Protection Regulation requirements even after the training phase is concluded. To back our arguments: (1.) We reiterate that LLMs output training data at inference time, be it verbatim or in generalized form. (2.) We show that some LLMs can thus be considered personal data on their own. This triggers a cascade of data protection implications such as data subject rights, including rights to access, rectification, or erasure. These rights extend to the information embedded within the AI model. (3.) This paper argues that machine learning researchers must acknowledge the legal implications of LLMs as personal data throughout the full ML development lifecycle, from data collection and curation to model provision on e.g., GitHub or Hugging Face. (4.) We propose different ways for the ML research community to deal with these legal implications. Our paper serves as a starting point for improving the alignment between data protection law and the technical capabilities of LLMs. Our findings underscore the need for more interaction between the legal domain and the ML community.