Stanford Seminar: Neuromorphic Chips: Addressing the Nanostransistor Challenge

Video Description

EE380: Computer Systems Colloquium Seminar Neuromorphic Chips: Addressing the Nanostransistor Challenge by Combining Analog Computation with Digital Communication Speaker: Kwabena Boahen, Stanford University As transistors shrink to nanoscale dimensions, trapped electrons--blocking "lanes" of electron traffic--are making it difficult for digital computers to work. In stark contrast, the brain works fine with single-lane nanoscale devices that are intermittently blocked (ion channels). Conjecturing that it achieves error-tolerance by combining analog dendritic computation with digital axonal communication, neuromorphic engineers (neuromorphs) began emulating dendrites with subthreshold analog circuits and axons with asynchronous digital circuits in the mid-1980s. Three decades in, they achieved a consequential scale with Neurogrid, the first neuromorphic system with billions of synaptic connections. Neuromorphs then tackled the challenge of mapping arbitrary computations onto neuromorphic chips in a manner robust to lanes intermittently--or even permanently--blocked by trapped electrons. Having demonstrated scalability and programmability, they now seek to encode continuous signals with spike trains in a manner that promises greater energy efficiency than all-analog or all-digital computing across a five-decade precision range. About the Speaker: Kwabena Boahen is a Professor of Bioengineering and Electrical Engineering at Stanford University, where he directs the Brains in Silicon Lab. He is a neuromorphic engineer who is using silicon integrated circuits to emulate the way neurons compute, and linking the seemingly disparate fields of electronics and computer science with neurobiology and medicine. His lab developed Neurogrid, a specialized hardware platform created at Stanford that enables the cortex's inner workings to be simulated in real time--something outside the reach of even the fastest supercomputers. His interest in neural nets developed soon after he left his native Ghana to pursue undergraduate studies in Electrical and Computer Engineering at Johns Hopkins University, Baltimore, in 1985. He went on to earn a doctorate in Computation and Neural Systems at the California Institute of Technology in 1997. From 1997 to 2005 he was on the faculty of University of Pennsylvania, Philadelphia PA. With over ninety publications to his name, including a cover story in the May 2005 issue of Scientific American, his scholarship has been recognized by several distinguished honors, including the National Institute of Health Director's Pioneer Award in 2006. In 2016, he was named a fellow of the Institute of Electrical and Electronic Engineers and of the American Institute for Medical and Biological Engineering. His 2007 TED talk, A Computer that Works like the Brain, has been viewed over half-a-million times. For more information about this seminar and its speaker, you can visit http://ee380.stanford.edu/Abstracts/170405.html Support for the Stanford Colloquium on Computer Systems Seminar Series provided by the Stanford Computer Forum. Colloquium on Computer Systems Seminar Series (EE380) presents the current research in design, implementation, analysis, and use of computer systems. Topics range from integrated circuits to operating systems and programming languages. It is free and open to the public, with new lectures each week. Learn more: http://bit.ly/WinYX5 0:00 Introduction 0:18 Acknowledgments 0:57 A dollar bought more and more transistors until 2014 5:55 Beware of potholes! 6:30 Accidents happen! 16:32 Combining digital communication with analog computation 23:43 Digital versus Analog versus Neuromorphic 25:56 Neuromorphs' Five-Point "Secret" Master Plan 1. Implement dendritic computation with subthreshold analog 27:37 Overlapping dendrites eliminate axon's terminal branches 30:31 Hierarchical axonal branching minimizes wiring 33:15 Neurogrid's overlapping dendrites and hierarchical axons 34:25 Neurogrid versus TrueNorth 37:44 What is the "VHDL" neuromorphic chips? 1981: Wiring Gates 39:23 The Neuromorphics Project 39:59 Nengo, Neuromorph, and Brainstorm 43:54 The Neural Engineering Framework (NEF) 46:14 NEF vesus Conventional Neural Network 48:45 Approximating dynamic transformations with NEF 50:57 SPAUN: First whole-brain model built with spiking neurons 54:09 Vector rotation example 54:49 Works on a neuromorphic chip! 58:51 Robot-arm controller video