Exponential scaling of neural algorithms - a future beyond Moore's Law?
This addresses the potential for transformative shifts in computing and neuroscience interactions, but it is speculative and incremental in its projection of future impacts.
The paper explores how advances in neurotechnologies and computing are creating a positive feedback loop that could lead to exponential scaling in computing beyond Moore's Law, by integrating neural computation insights into new paradigms like deep learning and neuromorphic hardware.
Although the brain has long been considered a potential inspiration for future computing, Moore's Law - the scaling property that has seen revolutions in technologies ranging from supercomputers to smart phones - has largely been driven by advances in materials science. As the ability to miniaturize transistors is coming to an end, there is increasing attention on new approaches to computation, including renewed enthusiasm around the potential of neural computation. This paper describes how recent advances in neurotechnologies, many of which have been aided by computing's rapid progression over recent decades, are now reigniting this opportunity to bring neural computation insights into broader computing applications. As we understand more about the brain, our ability to motivate new computing paradigms with continue to progress. These new approaches to computing, which we are already seeing in techniques such as deep learning and neuromorphic hardware, will themselves improve our ability to learn about the brain and accordingly can be projected to give rise to even further insights. This paper will describe how this positive feedback has the potential to change the complexion of how computing sciences and neurosciences interact, and suggests that the next form of exponential scaling in computing may emerge from our progressive understanding of the brain.