Multi-Faceted Evaluation of Modeling Languages for Augmented Reality Applications -- The Case of ARWFML
This work addresses the problem of developing and assessing modeling languages for augmented reality workflows, which is incremental as it builds on prior design cycles.
The paper tackled the challenge of evaluating modeling languages for augmented reality applications by refining the Augmented Reality Workflow Modeling Language (ARWFML) through two design iterations, including a comparative evaluation, 3D notation introduction, and a comprehensibility study, resulting in a maturity level suitable for empirical evaluations.
The evaluation of modeling languages for augmented reality applications poses particular challenges due to the three-dimensional environment they target. The previously introduced Augmented Reality Workflow Modeling Language (ARWFML) enables the model-based creation of augmented reality scenarios without programming knowledge. Building upon the first design cycle of the language's specification, this paper presents two further design iterations for refining the language based on multi-faceted evaluations. These include a comparative evaluation of implementation options and workflow capabilities, the introduction of a 3D notation, and the development of a new 3D modeling environment. On this basis, a comprehensibility study of the language was conducted. Thereby, we show how modeling languages for augmented reality can be evolved towards a maturity level suitable for empirical evaluations.