Toward a Unified Framework for Collaborative Design of Human-AI Interaction
This work provides a conceptual framework for designers and researchers to ensure user understanding and control remain central in proactive AI systems, but it is incremental as it synthesizes existing principles without empirical validation.
The paper proposes a unified framework integrating multimodal alignment, interaction-centric explainability, and agency-preserving mechanisms for human-AI interaction, demonstrated through two scenarios (collaborative design and XR warehouse robot collaboration) to address gaps in transparency and user control.
Human computer interaction is shifting from screen-based systems to multimodal interfaces where artificial intelligence powered systems increasingly interpret user intent through speech, gesture, and gaze. Yet users rarely understand how these interpretations are made, compromising trust and control. Existing approaches treat multimodal alignment, explainability, and human agency as separate concerns, leaving critical gaps in transparency and user oversight. We propose a Human Artificial Intelligence collaboration framework integrating these three principles as interdependent design requirements: 1) multimodal alignment for accurate intent interpretation, 2) interaction centric explainability delivering real time visual, textual, and audio feedback, and 3) agency preserving mechanisms enabling users to accept, reject, or modify artificial intelligence suggestions at any time. We presented the framework through two scenarios, collaborative design and extended reality warehouse robot collaboration, chosen to span differences in time pressure and error reversibility, with the latter situated in a domain where misinterpretation carries documented safety consequences. This approach reframes collaboration as a continuous interaction property, benefiting designers, researchers, and end users by ensuring that as artificial intelligence systems grow more proactive, user understanding and control remain first class design properties.