AI Accelerator Survey and Trends
This provides an incremental update for researchers and industry professionals tracking hardware developments in AI.
The paper surveys and analyzes current commercial AI accelerators, compiling their peak performance and power consumption data, and discusses trends and computational efficiency based on benchmarking results.
Over the past several years, new machine learning accelerators were being announced and released every month for a variety of applications from speech recognition, video object detection, assisted driving, and many data center applications. This paper updates the survey of AI accelerators and processors from past two years. This paper collects and summarizes the current commercial accelerators that have been publicly announced with peak performance and power consumption numbers. The performance and power values are plotted on a scatter graph, and a number of dimensions and observations from the trends on this plot are again discussed and analyzed. This year, we also compile a list of benchmarking performance results and compute the computational efficiency with respect to peak performance.