Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound
arXiv:1906.03593v297 citations
AI Analysis
This work addresses theoretical guarantees for over-parametrization in deep learning, which is incremental as it builds on existing results.
The paper tackles the problem of over-parametrization size in deep learning theory, improving upon prior results by Li and Liang (2018) and Du et al. (2019), with the outcome being a reduction to quadratic sufficiency as indicated by the title.
We improve the over-parametrization size over two beautiful results [Li and Liang' 2018] and [Du, Zhai, Poczos and Singh' 2019] in deep learning theory.