The Development and Validation of the Technology-Supported Reflection Inventory
This provides a tool for researchers and practitioners in HCI to compare reflection-supporting prototypes, addressing a specific evaluation bottleneck in the field.
The paper tackled the difficulty in evaluating and comparing interactive technologies that support reflection by developing the Technology-Supported Reflection Inventory (TSRI), a nine-item scale validated through expert review and factor analysis to assess system effectiveness in supporting reflection.
Reflection is an often addressed design goal in Human-Computer Interaction (HCI) research. An increasing number of artefacts for reflection have been developed in recent years. However, evaluating if and how an interactive technology helps a user reflect is still complex. This makes it difficult to compare artefacts (or prototypes) for reflection, impeding future design efforts. To address this issue, we developed the \emph{Technology-Supported Reflection Inventory} (TSRI), which is a scale that evaluates how effectively a system supports reflection. We first created a list of possible scale items based on past work in defining reflection. The items were then reviewed by experts. Next, we performed exploratory factor analysis to reduce the scale to its final length of nine items. Subsequently, we confirmed test-retest validity of our instrument, as well as its construct validity. The TSRI enables researchers and practitioners to compare prototypes designed to support reflection.