LGOCJul 29, 2015

Distributed Mini-Batch SDCA

arXiv:1507.08322v114.650 citations
Originality Synthesis-oriented
AI Analysis

This work provides an incremental improvement in optimization theory for machine learning practitioners working with distributed or large-scale datasets.

The paper tackles the problem of improving the analysis of mini-batched stochastic dual coordinate ascent for regularized empirical loss minimization, such as SVM objectives, by allowing flexible sampling schemes including distributed data and incorporating dependencies on loss smoothness and data spread.

We present an improved analysis of mini-batched stochastic dual coordinate ascent for regularized empirical loss minimization (i.e. SVM and SVM-type objectives). Our analysis allows for flexible sampling schemes, including where data is distribute across machines, and combines a dependence on the smoothness of the loss and/or the data spread (measured through the spectral norm).

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes