Risk-Averse Learning with Varying Risk Levels
This work addresses safety-critical decision-making for applications where environments and risk preferences change over time, presenting an incremental improvement with new metrics and analysis.
The paper tackles risk-averse online optimization in dynamic environments with varying risk levels, using Conditional Value-at-Risk, and develops algorithms with dynamic regret bounds analyzed in terms of function and risk-level variations, supported by numerical experiments.
In safety-critical decision-making, the environment may evolve over time, and the learner adjusts its risk level accordingly. This work investigates risk-averse online optimization in dynamic environments with varying risk levels, employing Conditional Value-at-Risk (CVaR) as the risk measure. To capture the dynamics of the environment and risk levels, we employ the function variation metric and introduce a novel risk-level variation metric. Two information settings are considered: a first-order scenario, where the learner observes both function values and their gradients; and a zeroth-order scenario, where only function evaluations are available. For both cases, we develop risk-averse learning algorithms with a limited sampling budget and analyze their dynamic regret bounds in terms of function variation, risk-level variation, and the total number of samples. The regret analysis demonstrates the adaptability of the algorithms in non-stationary and risk-sensitive settings. Finally, numerical experiments are presented to demonstrate the efficacy of the methods.