Criminal Liability of Generative Artificial Intelligence Providers for User-Generated Child Sexual Abuse Material
This addresses a critical legal gray area for AI developers and policymakers, though it is incremental as it applies existing German laws to new AI scenarios.
The study tackled the problem of assessing criminal liability for Generative AI providers when users generate Child Sexual Abuse Material (CSAM), finding that such generation can lead to legal consequences not only for users but also for developers, researchers, and company representatives, with liability influenced by factors like image type and content moderation policies.
The development of more powerful Generative Artificial Intelligence (GenAI) has expanded its capabilities and the variety of outputs. This has introduced significant legal challenges, including gray areas in various legal systems, such as the assessment of criminal liability for those responsible for these models. Therefore, we conducted a multidisciplinary study utilizing the statutory interpretation of relevant German laws, which, in conjunction with scenarios, provides a perspective on the different properties of GenAI in the context of Child Sexual Abuse Material (CSAM) generation. We found that generating CSAM with GenAI may have criminal and legal consequences not only for the user committing the primary offense but also for individuals responsible for the models, such as independent software developers, researchers, and company representatives. Additionally, the assessment of criminal liability may be affected by contextual and technical factors, including the type of generated image, content moderation policies, and the model's intended purpose. Based on our findings, we discussed the implications for different roles, as well as the requirements when developing such systems.