What We Measure in Mixed Reality Experiments
This is an incremental position paper for researchers in mixed reality, focusing on evaluation methodologies without presenting new data or methods.
The paper argues for different evaluation stances in mixed-reality experiments based on framing, drawing on the author's team's work, and suggests directions for developing more robust measures to advance the field.
There are many potential measures that one might use when evaluating mixed-reality experiences. In this position paper I will argue that there are various stances to take for evaluation, depending on the framing of the experience within a larger body of work. I will draw upon various types of work that my team has been involved with in order to illustrate these different stances. I will then sketch out some directions for developing more robust measures that can help the field move forward.