Using Deep Learning for Visual Decoding and Reconstruction from Brain Activity: A Review
This is an incremental review paper summarizing existing research on visual decoding from brain activity for neuroscience and AI researchers.
This review examines how deep learning methods reconstruct images from fMRI brain activity data, finding that reconstruction quality depends on decoding and reconstruction architectures but these can struggle with complex objects. It concludes that deep neural network variations are highly optimal for this task.
This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction architectures. I will show that these structures can struggle with adaptability to various input stimuli due to complicated objects in images. Also, the significance of feature representation will be evaluated. This paper will conclude the use of deep learning within visual decoding and reconstruction is highly optimal when using variations of deep neural networks and will provide details of potential future work.