Positional-Spectral-Temporal Attention in 3D Convolutional Neural Networks for EEG Emotion Recognition
This work addresses emotion recognition from EEG signals, which is important for human-computer interaction, but it appears incremental as it builds on existing 3D-CNN methods with attention mechanisms.
The authors tackled EEG emotion recognition by proposing PST-Attention, a plug-in module for 3D-CNNs that uses positional, spectral, and temporal attention to capture discriminative features, achieving promising results on two real-world datasets.
Recognizing the feelings of human beings plays a critical role in our daily communication. Neuroscience has demonstrated that different emotion states present different degrees of activation in different brain regions, EEG frequency bands and temporal stamps. In this paper, we propose a novel structure to explore the informative EEG features for emotion recognition. The proposed module, denoted by PST-Attention, consists of Positional, Spectral and Temporal Attention modules to explore more discriminative EEG features. Specifically, the Positional Attention module is to capture the activate regions stimulated by different emotions in the spatial dimension. The Spectral and Temporal Attention modules assign the weights of different frequency bands and temporal slices respectively. Our method is adaptive as well as efficient which can be fit into 3D Convolutional Neural Networks (3D-CNN) as a plug-in module. We conduct experiments on two real-world datasets. 3D-CNN combined with our module achieves promising results and demonstrate that the PST-Attention is able to capture stable patterns for emotion recognition from EEG.