A Photonic-Electronic non-von Neumann Processor Core for Highly Efficient Computing (APT-NuCOM)
Lead Research Organisation:
University of Exeter
Department Name: Engineering
Abstract
Modern society depends massively on the generation, processing and transmission of vast amounts of data. It is predicted that by 2025, 175 zettabytes (175 trillion gigabytes) of data will be generated around the globe, with so-called 'edge computing' devices creating more than 90 zettabytes alone. Processing such huge amounts of data demands ever increasing computational power, memory and communication bandwidth - demands that cannot be sustainably met by conventional digital electronic technologies.
The growing gap between the needs and the capabilities of today's information technology is exemplified if we consider the historical trend in total number of computations (in units of #days of calculating at a rate of 1 PetaFLOP/s) needed to train various artificial intelligence (AI) systems. The trend followed Moore's Law (doubling approximately every two years) until 2012, after which the doubling time reduced to a mere 3.4 months!
This trend is compounded by the breakdown in Koomey's Law, which states that the number of computations per Joule of energy doubles around every 1.5 years. This law was also followed until quite recently, but we are now approaching a widely accepted computing efficiency-wall at around 10 GMAC/Joule (a MAC is a multiply-accumulate operation) for CMOS electronics and the von-Neumann architecture.
As a result, the energy consumption used in training modern AI systems is truly staggering, with consequent adverse effects for sustainability. This has led to a move away from standard CPU designs in AI towards the use of co-processors - GPUs, ASICs, FPGAs - with superior parallelism.
However, even here the limitations of electrical signalling lead to massive levels of energy consumption. It was recently estimated, for example, that the training of a large GPU-based natural language processing system used for accurate machine translation resulted in carbon dioxide emissions equivalent to lifetime use of 5 cars! Clearly, a new approach is needed. Thus, in the APT-NuCOM project we will develop a highly efficient novel non-von Neumann co-processor that exploits clear advantages offered by photonic computation, but at the same time links seamlessly with the electronic domain to enable integration with existing electronic computing infrastructure. The APT-NuCOM co-processor will exploit novel phase-change photonic in-memory computing concepts to deliver massively parallel computation at PetaMAC/s speeds and, ultimately, an energy budget approaching that of the human brain.
The growing gap between the needs and the capabilities of today's information technology is exemplified if we consider the historical trend in total number of computations (in units of #days of calculating at a rate of 1 PetaFLOP/s) needed to train various artificial intelligence (AI) systems. The trend followed Moore's Law (doubling approximately every two years) until 2012, after which the doubling time reduced to a mere 3.4 months!
This trend is compounded by the breakdown in Koomey's Law, which states that the number of computations per Joule of energy doubles around every 1.5 years. This law was also followed until quite recently, but we are now approaching a widely accepted computing efficiency-wall at around 10 GMAC/Joule (a MAC is a multiply-accumulate operation) for CMOS electronics and the von-Neumann architecture.
As a result, the energy consumption used in training modern AI systems is truly staggering, with consequent adverse effects for sustainability. This has led to a move away from standard CPU designs in AI towards the use of co-processors - GPUs, ASICs, FPGAs - with superior parallelism.
However, even here the limitations of electrical signalling lead to massive levels of energy consumption. It was recently estimated, for example, that the training of a large GPU-based natural language processing system used for accurate machine translation resulted in carbon dioxide emissions equivalent to lifetime use of 5 cars! Clearly, a new approach is needed. Thus, in the APT-NuCOM project we will develop a highly efficient novel non-von Neumann co-processor that exploits clear advantages offered by photonic computation, but at the same time links seamlessly with the electronic domain to enable integration with existing electronic computing infrastructure. The APT-NuCOM co-processor will exploit novel phase-change photonic in-memory computing concepts to deliver massively parallel computation at PetaMAC/s speeds and, ultimately, an energy budget approaching that of the human brain.
