A Framework for Exploring and Evaluating Mechanics in Human Computation Games
This work addresses the need for generalizable design knowledge in HCGs to help developers create effective games for crowdsourcing tasks, though it appears incremental as it builds on prior HCG research.
The paper tackles the problem of designing human computation games (HCGs) by proposing a formal representation and methodology to explore and evaluate game mechanics, aiming to improve both player experience and task completion.
Human computation games (HCGs) are a crowdsourcing approach to solving computationally-intractable tasks using games. In this paper, we describe the need for generalizable HCG design knowledge that accommodates the needs of both players and tasks. We propose a formal representation of the mechanics in HCGs, providing a structural breakdown to visualize, compare, and explore the space of HCG mechanics. We present a methodology based on small-scale design experiments using fixed tasks while varying game elements to observe effects on both the player experience and the human computation task completion. Finally we discuss applications of our framework using comparisons of prior HCGs and recent design experiments. Ultimately, we wish to enable easier exploration and development of HCGs, helping these games provide meaningful player experiences while solving difficult problems.