Perceptron Mistake Bounds
This work provides incremental improvements in theoretical machine learning by extending mistake bounds for the Perceptron algorithm to more general loss functions.
The authors tackled the problem of deriving mistake bounds for the Perceptron algorithm by introducing novel bounds that generalize beyond standard margin-loss types, allow for any convex and Lipschitz loss function, and feature a simple proof.
We present a brief survey of existing mistake bounds and introduce novel bounds for the Perceptron or the kernel Perceptron algorithm. Our novel bounds generalize beyond standard margin-loss type bounds, allow for any convex and Lipschitz loss function, and admit a very simple proof.