Tom Chau

Javad Rahimipour Anaraki, Chelsea Anne Rauh, Jason Leung et al.

Brain-computer interfaces (BCIs) allow users to control computer applications by modulating their brain activity. Since BCIs rely solely on brain activity, they have enormous potential as an alternative access method for engaging children with severe disabilities and/or medical complexities in therapeutic recreation and leisure. In particular, one commercially available BCI platform is the Emotiv EPOC headset, which is a portable and affordable electroencephalography (EEG) device. Combined with the EmotivBCI software, the Emotiv system can generate a model to discern between different mental tasks based on the user's EEG signals in real-time. While the Emotiv system shows promise for use by the pediatric population in the setting of a BCI clinic, it lacks integrated support that allows users to directly control computer applications using the generated classification output. To achieve this, users would have to create their own program, which can be challenging for those who may not be technologically inclined. To address this gap, we developed a freely available and user-friendly BCI software application called EmoconLite. Using the classification output from EmotivBCI, EmoconLite allows users to play YouTube video clips and a variety of video games from multiple platforms, ultimately creating an end-to-end solution for users. Through its deployment in the Holland Bloorview Kids Rehabilitation Hospital's BCI clinic, EmoconLite is bridging the gap between research and clinical practice, providing children with access to BCI technology and supporting BCI-enabled play.

Javad Rahimipour Anaraki, Silvia Orlandi, Tom Chau

Children with severe disabilities and complex communication needs face limitations in the usage of access technology (AT) devices. Conventional ATs (e.g., mechanical switches) can be insufficient for nonverbal children and those with limited voluntary motion control. Automatic techniques for the detection of tongue gestures represent a promising pathway. Previous studies have shown the robustness of tongue detection algorithms on adult participants, but further research is needed to use these methods with children. In this study, a network architecture for tongue-out gesture recognition was implemented and evaluated on videos recorded in a naturalistic setting when children were playing a video-game. A cascade object detector algorithm was used to detect the participants' faces, and an automated classification scheme for tongue gesture detection was developed using a convolutional neural network (CNN). In evaluation experiments conducted, the network was trained using adults and children's images. The network classification accuracy was evaluated using leave-one-subject-out cross-validation. Preliminary classification results obtained from the analysis of videos of five typically developing children showed an accuracy of up to 99% in predicting tongue-out gestures. Moreover, we demonstrated that using only children data for training the classifier yielded better performance than adult's one supporting the need for pediatric tongue gesture datasets.

Javad Rahimipour Anaraki, Jae Moon, Tom Chau

Brain-computer interface (BCI) aims to establish and improve human and computer interactions. There has been an increasing interest in designing new hardware devices to facilitate the collection of brain signals through various technologies, such as wet and dry electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) devices. The promising results of machine learning methods have attracted researchers to apply these methods to their data. However, some methods can be overlooked simply due to their inferior performance against a particular dataset. This paper shows how relatively simple yet powerful feature selection/ranking methods can be applied to speech imagery datasets and generate significant results. To do so, we introduce two approaches, horizontal and vertical settings, to use any feature selection and ranking methods to speech imagery BCI datasets. Our primary goal is to improve the resulting classification accuracies from support vector machines, $k$-nearest neighbour, decision tree, linear discriminant analysis and long short-term memory recurrent neural network classifiers. Our experimental results show that using a small subset of channels, we can retain and, in most cases, improve the resulting classification accuracies regardless of the classifier.

Alborz Rezazadeh Sereshkeh, Rozhin Yousefi, Andrew T Wong et al.

Most brain-computer interfaces (BCIs) based on functional near-infrared spectroscopy (fNIRS) require that users perform mental tasks such as motor imagery, mental arithmetic, or music imagery to convey a message or to answer simple yes or no questions. These cognitive tasks usually have no direct association with the communicative intent, which makes them difficult for users to perform. In this paper, a 3-class intuitive BCI is presented which enables users to directly answer yes or no questions by covertly rehearsing the word 'yes' or 'no' for 15 s. The BCI also admits an equivalent duration of unconstrained rest which constitutes the third discernable task. Twelve participants each completed one offline block and six online blocks over the course of 2 sessions. The mean value of the change in oxygenated hemoglobin concentration during a trial was calculated for each channel and used to train a regularized linear discriminant analysis (RLDA) classifier. By the final online block, 9 out of 12 participants were performing above chance (p<0.001), with a 3-class accuracy of 83.8+9.4%. Even when considering all participants, the average online 3-class accuracy over the last 3 blocks was 64.1+20.6%, with only 3 participants scoring below chance (p<0.001). For most participants, channels in the left temporal and temporoparietal cortex provided the most discriminative information. To our knowledge, this is the first report of an online fNIRS 3-class imagined speech BCI. Our findings suggest that imagined speech can be used as a reliable activation task for selected users for the development of more intuitive BCIs for communication.