Multi-person Spatial Interaction in a Large Immersive Display Using Smartphones as Touchpads
This addresses the need for natural, interactive workspaces in display-wall environments, though it is incremental as it builds on existing technologies like smartphones and Kinect sensors.
The paper tackled the problem of enabling multi-user interaction on a large immersive display by developing an interface that uses smartphones as touchpads, with spatial tracking and WebSocket connections, and reported user experiments showing it supported simultaneous interactions for tasks like image selection and placement.
In this paper, we present a multi-user interaction interface for a large immersive space that supports simultaneous screen interactions by combining (1) user input via personal smartphones and Bluetooth microphones, (2) spatial tracking via an overhead array of Kinect sensors, and (3) WebSocket interfaces to a webpage running on the large screen. Users are automatically, dynamically assigned personal and shared screen sub-spaces based on their tracked location with respect to the screen, and use a webpage on their personal smartphone for touchpad-type input. We report user experiments using our interaction framework that involve image selection and placement tasks, with the ultimate goal of realizing display-wall environments as viable, interactive workspaces with natural multimodal interfaces.