NeuGaze: Reshaping the future BCI
This provides a low-cost, accessible alternative to BCIs for motor-impaired users, enabling intuitive human-computer interaction in applications like assistive technology and entertainment.
The paper tackles the problem of complex and costly brain-computer interfaces (BCIs) by introducing NeuGaze, a webcam-based system that uses eye gaze, head movements, and facial expressions for real-time control, achieving performance comparable to conventional inputs with minimal calibration.
Traditional brain-computer interfaces (BCIs), reliant on costly electroencephalography or invasive implants, struggle with complex human-computer interactions due to setup complexity and limited precision. We present NeuGaze, a novel webcam-based system that leverages eye gaze, head movements, and facial expressions to enable intuitive, real-time control using only a standard 30 Hz webcam, often pre-installed in laptops. Requiring minimal calibration, NeuGaze achieves performance comparable to conventional inputs, supporting precise cursor navigation, key triggering via an efficient skill wheel, and dynamic gaming interactions, such as defeating formidable opponents in first-person games. By harnessing preserved neck-up functionalities in motor-impaired individuals, NeuGaze eliminates the need for specialized hardware, offering a low-cost, accessible alternative to BCIs. This paradigm empowers diverse applications, from assistive technology to entertainment, redefining human-computer interaction for motor-impaired users. Project is at \href{https://github.com/NeuSpeech/NeuGaze}{github.com/NeuSpeech/NeuGaze}.