Implicit Differentiation for Hyperparameter Tuning the Weighted Graphical Lasso
This work addresses hyperparameter tuning for the Graphical Lasso, which is incremental as it applies an existing implicit differentiation technique to a specific model.
The authors tackled the problem of hyperparameter tuning for the Graphical Lasso by developing a framework and algorithm based on implicit differentiation and bilevel optimization, resulting in a first-order method that computes the Jacobian of the solution with respect to hyperparameters.
We provide a framework and algorithm for tuning the hyperparameters of the Graphical Lasso via a bilevel optimization problem solved with a first-order method. In particular, we derive the Jacobian of the Graphical Lasso solution with respect to its regularization hyperparameters.