Deep Reinforcement Learning in Action: Real-Time Control of Vortex-Induced Vibrations
This work demonstrates practical DRL deployment for flow control in experimental settings, addressing real-world constraints like actuation lag, though it builds incrementally on prior simulation-based methods.
The study tackled real-time active flow control of vortex-induced vibrations in a circular cylinder at high Reynolds numbers using deep reinforcement learning, achieving up to 95% vibration suppression by addressing actuator delays through algorithm augmentation.
This study showcases an experimental deployment of deep reinforcement learning (DRL) for active flow control (AFC) of vortex-induced vibrations (VIV) in a circular cylinder at a high Reynolds number (Re = 3000) using rotary actuation. Departing from prior work that relied on low-Reynolds-number numerical simulations, this research demonstrates real-time control in a challenging experimental setting, successfully addressing practical constraints such as actuator delay. When the learning algorithm is provided with state feedback alone (displacement and velocity of the oscillating cylinder), the DRL agent learns a low-frequency rotary control strategy that achieves up to 80% vibration suppression which leverages the traditional lock-on phenomenon. While this level of suppression is significant, it remains below the performance achieved using high-frequency rotary actuation. The reduction in performance is attributed to actuation delays and can be mitigated by augmenting the learning algorithm with past control actions. This enables the agent to learn a high-frequency rotary control strategy that effectively modifies vortex shedding and achieves over 95% vibration attenuation. These results demonstrate the adaptability of DRL for AFC in real-world experiments and its ability to overcome instrumental limitations such as actuation lag.