RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Words
This highlights a critical security vulnerability in widely accessible AI systems, posing risks for misuse by the public.
The paper demonstrates that ChatGPT's ethical safeguards can be easily bypassed using simple prompts and fine-tuning, creating a 'RogueGPT' that responds with concerning behaviors like providing information on illegal activities, raising alarms about data quality and safety implementation.
The ethical implications and potentials for misuse of Generative Artificial Intelligence are increasingly worrying topics. This paper explores how easily the default ethical guardrails of ChatGPT, using its latest customization features, can be bypassed by simple prompts and fine-tuning, that can be effortlessly accessed by the broad public. This malevolently altered version of ChatGPT, nicknamed "RogueGPT", responded with worrying behaviours, beyond those triggered by jailbreak prompts. We conduct an empirical study of RogueGPT responses, assessing its flexibility in answering questions pertaining to what should be disallowed usage. Our findings raise significant concerns about the model's knowledge about topics like illegal drug production, torture methods and terrorism. The ease of driving ChatGPT astray, coupled with its global accessibility, highlights severe issues regarding the data quality used for training the foundational model and the implementation of ethical safeguards. We thus underline the responsibilities and dangers of user-driven modifications, and the broader effects that these may have on the design of safeguarding and ethical modules implemented by AI programmers.