Accessible Robot Control in Mixed Reality
This provides an accessible control method for individuals with physical disabilities, though it is incremental as it adapts existing technologies to a new application.
The paper tackles the problem of enabling people with physical disabilities to control a Spot robot using Hololens 2, achieving comparable time efficiency and user experience to traditional joystick control.
A novel method to control the Spot robot of Boston Dynamics by Hololens 2 is proposed. This method is mainly designed for people with physical disabilities, users can control the robot's movement and robot arm without using their hands. The eye gaze tracking and head motion tracking technologies of Hololens 2 are utilized for sending control commands. The movement of the robot would follow the eye gaze and the robot arm would mimic the pose of the user's head. Through our experiment, our method is comparable with the traditional control method by joystick in both time efficiency and user experience. Demo can be found on our project webpage: https://zhangganlin.github.io/Holo-Spot-Page/index.html