Trust-Region Methods with Low-Fidelity Objective Models
This work addresses optimization efficiency for researchers and practitioners, but it appears incremental as it builds on the existing MTR framework.
The paper tackles optimization problems by introducing two multifidelity trust-region methods, STR and SVDTR, which use low-fidelity models to determine secondary directions, resulting in potential efficiency gains as demonstrated in numerical examples.
We introduce two multifidelity trust-region methods based on the Magical Trust Region (MTR) framework. MTR augments the classical trust-region step with a secondary, informative direction. In our approaches, the secondary ``magical'' directions are determined by solving coarse trust-region subproblems based on low-fidelity objective models. The first proposed method, Sketched Trust-Region (STR), constructs this secondary direction using a sketched matrix to reduce the dimensionality of the trust-region subproblem. The second method, SVD Trust-Region (SVDTR), defines the magical direction via a truncated singular value decomposition of the dataset, capturing the leading directions of variability. Several numerical examples illustrate the potential gain in efficiency.