DCAIPFSep 23, 2020

Applying the Roofline model for Deep Learning performance optimizations

arXiv:2009.11224v13 citations
Originality Synthesis-oriented
AI Analysis

This work addresses performance optimization for deep learning practitioners using Intel hardware, but it is incremental as it applies an existing model to a new system.

The paper tackles the problem of optimizing deep learning performance by automatically generating Roofline models for Non-Unified Memory Access systems, using Intel Xeon as an example, and evaluates the efficiency of deep learning primitives in the Intel oneDNN Library, showing performance improvements in specific benchmarks.

In this paper We present a methodology for creating Roofline models automatically for Non-Unified Memory Access (NUMA) using Intel Xeon as an example. Finally, we present an evaluation of highly efficient deep learning primitives as implemented in the Intel oneDNN Library.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes