Expectation and Acoustic Neural Network Representations Enhance Music Identification from Brain Activity
This work addresses the problem of music identification from brain activity for researchers in predictive music cognition and neural decoding, and its incremental approach builds upon prior work in the field.
The authors tackled the problem of music identification from brain activity and achieved improved performance by using acoustic and expectation-related neural network representations, with combined models outperforming strong baselines. The approach yielded complementary gains, exceeding the performance of seed ensembles.
During music listening, cortical activity encodes both acoustic and expectation-related information. Prior work has shown that ANN representations resemble cortical representations and can serve as supervisory signals for EEG recognition. Here we show that distinguishing acoustic and expectation-related ANN representations as teacher targets improves EEG-based music identification. Models pretrained to predict either representation outperform non-pretrained baselines, and combining them yields complementary gains that exceed strong seed ensembles formed by varying random initializations. These findings show that teacher representation type shapes downstream performance and that representation learning can be guided by neural encoding. This work points toward advances in predictive music cognition and neural decoding. Our expectation representation, computed directly from raw signals without manual labels, reflects predictive structure beyond onset or pitch, enabling investigation of multilayer predictive encoding across diverse stimuli. Its scalability to large, diverse datasets further suggests potential for developing general-purpose EEG models grounded in cortical encoding principles.