Ridge Regularization: an Essential Concept in Data Science
arXiv:2006.00371v2118 citations
AI Analysis
It is an incremental review aimed at data scientists to reinforce understanding of an established technique.
The paper discusses ridge regularization as a fundamental concept in data science, highlighting its importance and applications in statistics and machine learning over 40 years.
Ridge or more formally $\ell_2$ regularization shows up in many areas of statistics and machine learning. It is one of those essential devices that any good data scientist needs to master for their craft. In this brief ridge fest I have collected together some of the magic and beauty of ridge that my colleagues and I have encountered over the past 40 years in applied statistics.