Support estimation in high-dimensional heteroscedastic mean regression
This addresses robust support recovery for statisticians dealing with non-standard error distributions, though it is incremental as it adapts existing methods to a more challenging setting.
The paper tackles support estimation in high-dimensional linear regression with heavy-tailed, heteroscedastic errors by using a Huber loss variant and adaptive LASSO, achieving sign-consistency and optimal convergence rates comparable to homoscedastic, light-tailed settings.
A current strand of research in high-dimensional statistics deals with robustifying the available methodology with respect to deviations from the pervasive light-tail assumptions. In this paper we consider a linear mean regression model with random design and potentially heteroscedastic, heavy-tailed errors, and investigate support estimation in this framework. We use a strictly convex, smooth variant of the Huber loss function with tuning parameter depending on the parameters of the problem, as well as the adaptive LASSO penalty for computational efficiency. For the resulting estimator we show sign-consistency and optimal rates of convergence in the $\ell_\infty$ norm as in the homoscedastic, light-tailed setting. In our analysis, we have to deal with the issue that the support of the target parameter in the linear mean regression model and its robustified version may differ substantially even for small values of the tuning parameter of the Huber loss function. Simulations illustrate the favorable numerical performance of the proposed methodology.