11.2HCJun 23
"GenAI Defaults to Bias!" Gamify AI Literacy Through Reflections on PromptsQianou Ma, Megan Chai, Yike Tan et al.
As Generative AI (GenAI) becomes widespread, it is increasingly important for the public to understand the model's behaviors and biases. However, existing AI literacy efforts miss opportunities to engage the general public to reflect on enduring GenAI bias and behaviors (e.g., how GenAI defaults to its internal bias in response to ambiguous or challenging prompts). In this work, we introduce ImaginAItion, a multiplayer game to help adults better reflect on GenAI bias and understand GenAI behaviors. ImaginAItion is grounded in reflective play to surface GenAI limitations by encouraging players to manipulate prompt specificity (e.g., an underspecified prompt "CEO" defaults to a white man). From ten sessions (n=30), we find that the game significantly improved players' understanding of GenAI behaviors by 35% in accuracy. Qualitative analysis showed how game mechanisms supported player reflections, including on prompting strategies to mitigate GenAI bias. Our work demonstrates a viable pathway to scale GenAI literacy through playful, social interventions resilient to rapidly evolving technologies.
3.2HCFeb 9
Large Language Models in Peer-Run Community Behavioral Health Services: Understanding Peer Specialists and Service Users' Perspectives on Opportunities, Risks, and Mitigation StrategiesCindy Peng, Megan Chai, Gao Mo et al.
Peer-run organizations (PROs) provide critical, recovery-based behavioral health support rooted in lived experience. As large language models (LLMs) enter this domain, their scale, conversationality, and opacity introduce new challenges for situatedness, trust, and autonomy. Partnering with Collaborative Support Programs of New Jersey (CSPNJ), a statewide PRO in the Northeastern United States, we used comicboarding, a co-design method, to conduct workshops with 16 peer specialists and 10 service users exploring perceptions of integrating an LLM-based recommendation system into peer support. Findings show that depending on how LLMs are introduced, constrained, and co-used, they can reconfigure in-room dynamics by sustaining, undermining, or amplifying the relational authority that grounds peer support. We identify opportunities, risks, and mitigation strategies across three tensions: bridging scale and locality, protecting trust and relational dynamics, and preserving peer autonomy amid efficiency gains. We contribute design implications that center lived-experience-in-the-loop, reframe trust as co-constructed, and position LLMs not as clinical tools but as relational collaborators in high-stakes, community-led care.