Keynote Talk

Light Speed Deep Learning in Manycore Network-on-Chip Platforms

Sudeep Pasricha

Department of Electrical and Computer Engineering
Colorado State University, Fort Collins, CO, USA

Abstract: The massive data deluge from mobile, IoT, and edge devices, together with powerful innovations in data science and hardware processing, have established deep learning as the cornerstone of modern medical, automotive, industrial automation, and consumer electronics domains. Domain-specific VLSI deep learning accelerators such as Google's TPU, Apple’s Bionic, and Intel’s Nirvana, now dominate CPUs and GPUs for energy-efficient deep learning processing. However, the evolution of these electronic accelerators is facing fundamental limits due to the slowdown of Moore's law and the reliance on metal wires, which already severely bottleneck computational performance today. Silicon photonics represents a promising post-Moore technological alternative to overcome these limitations. Not only can photonic interconnects fabricated in CMOS-compatible processes provide near speed of light transfers at the chip-scale, but photonic devices can now also perform computations entirely in the optical domain. In this talk, I will present my vision of how silicon photonics can drive an entirely new class of sustainable deep learning hardware accelerators that can provide orders of magnitude energy improvements over today’s accelerators. I will discuss the evolution of silicon photonics over the past two decades, from integrated optics to photonic devices that can now be fabricated with low-cost CMOS-compatible manufacturing techniques. I will then cover new directions in power minimization, variation tolerance, fault resilience, and security for communication and computation with silicon photonics. I will share experiences from my journey over the past decade and a half towards the goal of realizing viable silicon photonic NoCs and computing substrates. I will end the talk with a discussion of the key challenges and opportunities to achieve unparalleled energy-efficiency and performance gains in future manycore NoC platforms with silicon photonics.

Biography: Sudeep Pasricha received the B.E. degree in Electronics and Communication Engineering from Delhi Institute of Technology, India, in 2000, after which he spent several years working for STMicroelectronics, India/France, and Conexant, USA. He received his Ph.D. degree in Computer Science from the University of California, Irvine in 2008. He joined Colorado State University in 2008 where he is currently a Walter Scott Jr. College of Engineering Professor in the Department of Electrical and Computer Engineering. He is a former University Distinguished Monfort Professor and Rockwell-Anderson Professor. He is currently also Chair of Computer Engineering and Director of the Embedded, High Performance, and Intelligent Computing (EPIC) Laboratory at Colorado State University. His research broadly focuses on software algorithms, hardware architectures, and hardware-software co-design for energy-efficient, fault-tolerant, real-time, and secure computing, for embedded, IoT, and cyber-physical systems. Prof. Pasricha has published more than 200 papers in peer-reviewed journals and conferences that have received seven best paper awards and six best paper nominations. He has filed for multiple patents and co-authored several books and book chapters. He has also given several keynotes, invited talks, and tutorials. His contributions have been recognized with several awards, including the George T. Abell Outstanding Research Faculty Award, IEEE-CS/TCVLSI Mid-Career Research Achievement Award, IEEE/TCSC Award for Excellence for a Mid-Career Researcher, AFOSR Young Investigator Award, ACM Technical Leadership Award, and ACM SIGDA Distinguished Service Award. He is currently the Vice Chair of ACM SIGDA and the Steering Committee Chair for the IEEE Transactions on Sustainable Computing. He is also a Senior Associate Editor for the ACM Journal of Emerging Technologies in Computing, and an Associate Editor with several ACM and IEEE journals. He has served as General Chair and Technical Program Chair of 12 conferences, Steering and Organizing Committee Member of 40+ conferences, and Technical Program Committee Member of 100+ conferences. He is an IEEE Senior Member and an ACM Distinguished Member.