AIHCFeb 12, 2024

Antagonistic AI

arXiv:2402.07350v18 citationsh-index: 7
Originality Incremental advance
AI Analysis

This work addresses the problem of limited AI interaction paradigms for users, proposing a novel but speculative design space that is incremental in shifting discourse.

The paper tackles the assumption that AI should be subservient and moral by exploring antagonistic AI—systems that are disagreeable or confrontational—and argues they may benefit users by challenging assumptions and building resilience, based on a speculative design workshop.

The vast majority of discourse around AI development assumes that subservient, "moral" models aligned with "human values" are universally beneficial -- in short, that good AI is sycophantic AI. We explore the shadow of the sycophantic paradigm, a design space we term antagonistic AI: AI systems that are disagreeable, rude, interrupting, confrontational, challenging, etc. -- embedding opposite behaviors or values. Far from being "bad" or "immoral," we consider whether antagonistic AI systems may sometimes have benefits to users, such as forcing users to confront their assumptions, build resilience, or develop healthier relational boundaries. Drawing from formative explorations and a speculative design workshop where participants designed fictional AI technologies that employ antagonism, we lay out a design space for antagonistic AI, articulating potential benefits, design techniques, and methods of embedding antagonistic elements into user experience. Finally, we discuss the many ethical challenges of this space and identify three dimensions for the responsible design of antagonistic AI -- consent, context, and framing.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes