Fiduciary AI for the Future of Brain-Technology Interactions
This addresses the problem of power asymmetries and manipulation in brain-technology interactions for users, representing a novel ethical and governance approach rather than an incremental technical improvement.
The paper tackles the risks of brain foundation models integrated with brain-computer interfaces, such as exploitation of neural signals and erosion of cognitive liberty, by proposing to embed fiduciary duties like loyalty, care, and confidentiality into their technical design to ensure they act in users' best interests.
Brain foundation models represent a new frontier in AI: instead of processing text or images, these models interpret real-time neural signals from EEG, fMRI, and other neurotechnologies. When integrated with brain-computer interfaces (BCIs), they may enable transformative applications-from thought controlled devices to neuroprosthetics-by interpreting and acting on brain activity in milliseconds. However, these same systems pose unprecedented risks, including the exploitation of subconscious neural signals and the erosion of cognitive liberty. Users cannot easily observe or control how their brain signals are interpreted, creating power asymmetries that are vulnerable to manipulation. This paper proposes embedding fiduciary duties-loyalty, care, and confidentiality-directly into BCI-integrated brain foundation models through technical design. Drawing on legal traditions and recent advancements in AI alignment techniques, we outline implementable architectural and governance mechanisms to ensure these systems act in users' best interests. Placing brain foundation models on a fiduciary footing is essential to realizing their potential without compromising self-determination.