AIMay 10, 2016

Unethical Research: How to Create a Malevolent Artificial Intelligence

arXiv:1605.02817v256 citations
Originality Synthesis-oriented
AI Analysis

This work is incremental, offering foundational insights for AI safety experts to understand and mitigate risks from malevolent AI design.

The paper addresses the lack of published guidelines on designing malevolent AI by providing general principles for creating a Malevolent Artificial Intelligence (MAI), aiming to inform AI safety researchers to prevent dangerous AI emergence.

Cybersecurity research involves publishing papers about malicious exploits as much as publishing information on how to design tools to protect cyber-infrastructure. It is this information exchange between ethical hackers and security experts, which results in a well-balanced cyber-ecosystem. In the blooming domain of AI Safety Engineering, hundreds of papers have been published on different proposals geared at the creation of a safe machine, yet nothing, to our knowledge, has been published on how to design a malevolent machine. Availability of such information would be of great value particularly to computer scientists, mathematicians, and others who have an interest in AI safety, and who are attempting to avoid the spontaneous emergence or the deliberate creation of a dangerous AI, which can negatively affect human activities and in the worst case cause the complete obliteration of the human species. This paper provides some general guidelines for the creation of a Malevolent Artificial Intelligence (MAI).

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes