Eliciting Gestures for Novel Note-taking Interactions
This work addresses the design of user interactions for stylus-based note-taking apps, but it is incremental as it builds on existing gesture studies without introducing new recognition methods.
The researchers conducted a gesture elicitation study with 21 participants to explore novel interactions for intelligent note-taking applications, finding that while common gestures like double taps were prevalent, more novel ones such as dragging to hotspots were also well-represented.
Handwriting recognition is improving in leaps and bounds, and this opens up new opportunities for stylus-based interactions. In particular, note-taking applications can become a more intelligent user interface, incorporating new features like autocomplete and integrated search. In this work we ran a gesture elicitation study, asking 21 participants to imagine how they would interact with an imaginary, intelligent note-taking application. We report agreement on the elicited gestures, finding that while existing common interactions are prevalent (like double taps and long presses) a number of more novel interactions (like dragging selected items to hotspots or using annotations) were also well-represented. We discuss the mental models participants drew on when explaining their gestures and what kind of feedback users might need to move to more stylus-centric interactions.