LGAIMLJun 9, 2019

Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound

arXiv:1906.03593v297 citations
AI Analysis

This work addresses theoretical guarantees for over-parametrization in deep learning, which is incremental as it builds on existing results.

The paper tackles the problem of over-parametrization size in deep learning theory, improving upon prior results by Li and Liang (2018) and Du et al. (2019), with the outcome being a reduction to quadratic sufficiency as indicated by the title.

We improve the over-parametrization size over two beautiful results [Li and Liang' 2018] and [Du, Zhai, Poczos and Singh' 2019] in deep learning theory.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes