Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models
It addresses safety and ethical issues for users and developers of diffusion models, but as a survey, it is incremental in synthesizing existing knowledge rather than introducing new methods.
This survey tackles the problem of safety, ethics, and trust threats in diffusion models by comprehensively examining their framework, threats, and countermeasures, aiming to accelerate progress in both technical capabilities and responsible application of generative AI.
Diffusion models (DMs) have been investigated in various domains due to their ability to generate high-quality data, thereby attracting significant attention. However, similar to traditional deep learning systems, there also exist potential threats to DMs. To provide advanced and comprehensive insights into safety, ethics, and trust in DMs, this survey comprehensively elucidates its framework, threats, and countermeasures. Each threat and its countermeasures are systematically examined and categorized to facilitate thorough analysis. Furthermore, we introduce specific examples of how DMs are used, what dangers they might bring, and ways to protect against these dangers. Finally, we discuss key lessons learned, highlight open challenges related to DM security, and outline prospective research directions in this critical field. This work aims to accelerate progress not only in the technical capabilities of generative artificial intelligence but also in the maturity and wisdom of its application.