Diederik Beckers

Zhecheng Liu, Diederik Beckers, Jeff D. Eldredge

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes advantage of the exploratory aspects of reinforcement learning (RL) and the rich nonlinearity of a deep neural network, provides a promising approach to discover feasible control strategies. However, the typical model-free approach to reinforcement learning requires a significant amount of interaction between the flow environment and the RL agent during training, and this high training cost impedes its development and application. In this work, we propose a model-based reinforcement learning (MBRL) approach by incorporating a novel reduced-order model as a surrogate for the full environment. The model consists of a physics-augmented autoencoder, which compresses high-dimensional CFD flow field snaphsots into a three-dimensional latent space, and a latent dynamics model that is trained to accurately predict the long-time dynamics of trajectories in the latent space in response to action sequences. The accuracy and robustness of the model are demonstrated in the scenario of a pitching airfoil within a highly disturbed environment. Additionally, an application to a vertical-axis wind turbine in a disturbance-free environment is discussed in the Appendix Based on the model trained in the pitching airfoil problem, we realize an MBRL strategy to mitigate lift variation during gust-airfoil encounters. We demonstrate that the policy learned in the reduced-order environment translates to an effective control strategy in the full CFD environment.

Diederik Beckers, H. Jane Bae, Andres Goza

We introduce a refined immersed boundary (IB) methodology that is better-than-first-order accurate in practice, while preserving key properties of "continuous-forcing" IB approaches that retain a singular source term in the governing equations. Our method leverages a smoothed indicator (Heaviside) function, following ideas from multiphase flow and immersed layers formulations, to recast the IB solution as a composite of distinct interior and exterior fields. We demonstrate that, when cast through this composite-solution lens, prior continuous-forcing IB methods can be seen as neglecting terms in the governing and constraint equations that restrict the solution to first-order accuracy. We incorporate these terms to systematically improve accuracy without the need for heuristic corrections. In canonical Poisson problems, we empirically demonstrate second-order convergence, and in incompressible Navier-Stokes simulations the method achieves slightly sub-second-order performance. While our present study focuses on these cases, the framework suggests a path towards second-order accuracy or higher, with further extensions. This perspective reframes accuracy limitations typically attributed to IB schemes. Although continuous-forcing IB methods are often reported to be only first-order accurate, we show that neither smoothing nor interface interpolation inherently restricts attainable order. Moreover, we naturally incorporate this higher-order formulation into a projection-based solution process. The resulting algorithm simultaneously mitigates the spurious surface stresses produced by ill-conditioned linear systems and reduces sensitivity to geometric resolution, addressing both conditioning and accuracy concerns within a unified approach.