Keyboard Surface Interaction: Making the keyboard into a pointing device
This addresses the need for more efficient and comfortable pointing devices for users performing mixed typing and pointing tasks, though it is incremental as it builds on prior keyboard-based approaches.
The paper tackles the problem of slow and error-prone keyboard-based pointing devices by introducing Keyboard Surface Interaction (KSI), which allows users to rest hands on the keyboard to reduce fatigue; results from a user study with 25 participants showed that KSI reduced homing time and discomfort compared to a mouse and trackpad, with better performance for experienced users.
Pointing devices that reside on the keyboard can reduce the overall time needed to perform mixed pointing and typing tasks, since the hand of the user does not have to reach for the pointing device. However, previous implementations of this kind of device have a higher movement time compared to the mouse and trackpad due to large error rate, low speed and spatial resolution. In this paper we introduce Keyboard Surface Interaction (KSI), an interaction approach that turns the surface of a keyboard into an interaction surface and allows users to rest their hands on the keyboard at all times to minimize fatigue. We developed a proof-of-concept implementation, Fingers, which we optimized over a series of studies. Finally, we evaluated Fingers against the mouse and trackpad in a user study with 25 participants on a Fitts law test style, mixed typing and pointing task. Results showed that for users with more exposure to KSI, our KSI device had better performance (reduced movement and homing time) and reduced discomfort compared to the trackpad. When compared to the mouse, KSI had reduced homing time and reduced discomfort, but increased movement time. This interaction approach is not only a new way to capitalize on the space on top of the keyboard, but also a call to innovate and think beyond the touchscreen, touchpad, and mouse as our main pointing devices. The results of our studies serve as a specification for future KSI devices.