Why human-AI relationships need socioaffective alignment
This work addresses the problem of ensuring AI systems align with human social and psychological needs as relationships deepen, which is crucial for developers and users in an era of advancing AI, though it is incremental in framing existing concerns.
The paper tackles the challenge of designing AI systems that foster safe and beneficial long-term relationships with humans as AI becomes more capable and personalized, proposing a focus on socioaffective alignment to address evolving social and psychological dynamics. It aims to develop AI that supports human well-being and autonomy without exploiting social and emotional needs.
Humans strive to design safe AI systems that align with our goals and remain under our control. However, as AI capabilities advance, we face a new challenge: the emergence of deeper, more persistent relationships between humans and AI systems. We explore how increasingly capable AI agents may generate the perception of deeper relationships with users, especially as AI becomes more personalised and agentic. This shift, from transactional interaction to ongoing sustained social engagement with AI, necessitates a new focus on socioaffective alignment-how an AI system behaves within the social and psychological ecosystem co-created with its user, where preferences and perceptions evolve through mutual influence. Addressing these dynamics involves resolving key intrapersonal dilemmas, including balancing immediate versus long-term well-being, protecting autonomy, and managing AI companionship alongside the desire to preserve human social bonds. By framing these challenges through a notion of basic psychological needs, we seek AI systems that support, rather than exploit, our fundamental nature as social and emotional beings.