Advancing Brainwave Modeling with a Codebook-Based Foundation Model
This work addresses a bottleneck in brain-computer interfaces and healthcare by improving model performance, though it appears incremental as an enhancement to an existing architecture.
The paper tackles the limitation of existing pre-trained EEG models in capturing neural oscillations by introducing LaBraM++, an enhanced large brainwave foundation model, which demonstrates substantial gains and competitive results across various BCI tasks.
Recent advances in large-scale pre-trained Electroencephalogram (EEG) models have shown great promise, driving progress in Brain-Computer Interfaces (BCIs) and healthcare applications. However, despite their success, many existing pre-trained models have struggled to fully capture the rich information content of neural oscillations, a limitation that fundamentally constrains their performance and generalizability across diverse BCI tasks. This limitation is frequently rooted in suboptimal architectural design choices which constrain their representational capacity. In this work, we introduce LaBraM++, an enhanced Large Brainwave Foundation Model (LBM) that incorporates principled improvements grounded in robust signal processing foundations. LaBraM++ demonstrates substantial gains across a variety of tasks, consistently outperforming its originally-based architecture and achieving competitive results when compared to other open-source LBMs. Its superior performance and training efficiency highlight its potential as a strong foundation for future advancements in LBMs.