Timothy Merritt

HC
h-index22
3papers
7citations
Novelty40%
AI Score36

3 Papers

HCMay 4
Interactive Inference: A Neuromorphic Theory of Human-Computer Interaction

Roel Vertegaal, Timothy Merritt, Saul Greenberg et al.

Neuromorphic Human-Computer Interaction (HCI) is a theoretical approach to designing better user experiences (UX) motivated by advances in the understanding of the neurophysiology of the brain. Inspired by the neuroscientific theory of Active Inference, Interactive Inference is a first example of such an approach. It offers a simplified interpretation of Active Inference that allows designers to more readily apply this theory to design and evaluation. The basic premise in Interactive Inference is that the user predicts a result prior to performing a task. User behaviour is modeled as Bayesian inference on progress and goal distributions that predicts the next action. The difference between the observed result and the prediction is what is processed by the brain. This error between goal and progress distributions, or Bayesian surprise, can be modeled as a simple mean square error of the signal-to-noise ratio (SNR) of a task. The problem is that the user's capacity to process Bayesian surprise follows the logarithm of this SNR. This means errors rise quickly once average capacity is exceeded. Our model allows the quantitative analysis of performance and error using one framework that can provide real-time estimates of the mental load in users that needs to be minimized by design. We show how three basic laws of HCI, Hick's Law, Fitts' Law and the Power Law can be expressed using our model. We then test the validity of the model by empirically measuring how well it predicts human performance and error in a car following task. Results suggest that driver processing capacity indeed is a logarithmic function of the SNR of the distance to a lead car. This result provides initial evidence that Interactive Inference can be useful as a new theoretical design tool.

CYMar 11, 2025
When Discourse Stalls: Moving Past Five Semantic Stopsigns about Generative AI in Design Research

Willem van der Maden, Vera van der Burg, Brett A. Halperin et al.

This essay examines how Generative AI (GenAI) is rapidly transforming design practices and how discourse often falls into over-simplified narratives that impede meaningful research and practical progress. We identify and deconstruct five prevalent "semantic stopsigns" -- reductive framings about GenAI in design that halt deeper inquiry and limit productive engagement. Reflecting upon two expert workshops at ACM conferences and semi-structured interviews with design practitioners, we analyze how these stopsigns manifest in research and practice. Our analysis develops mid-level knowledge that bridges theoretical discourse and practical implementation, helping designers and researchers interrogate common assumptions about GenAI in their own contexts. By recasting these stopsigns into more nuanced frameworks, we provide the design research community with practical approaches for thinking about and working with these emerging technologies.

HCFeb 26, 2025
Static Vs. Agentic Game Master AI for Facilitating Solo Role-Playing Experiences

Nicolai Hejlesen Jørgensen, Sarmilan Tharmabalan, Ilhan Aslan et al.

This paper presents a game master AI for single-player role-playing games. The AI is designed to deliver interactive text-based narratives and experiences typically associated with multiplayer tabletop games like Dungeons & Dragons. We report on the design process and the series of experiments to improve the functionality and experience design, resulting in two functional versions of the system. While v1 of our system uses simplified prompt engineering, v2 leverages a multi-agent architecture and the ReAct framework to include reasoning and action. A comparative evaluation demonstrates that v2 as an agentic system maintains play while significantly improving modularity and game experience, including immersion and curiosity. Our findings contribute to the evolution of AI-driven interactive fiction, highlighting new avenues for enhancing solo role-playing experiences.