Facilitating Reinforcement Learning for Process Control Using Transfer Learning: Overview and Perspectives
This is an incremental perspective paper for researchers and engineers in the process industry, focusing on improving DRL applications in industrial control through transfer learning.
The paper addresses the low sample efficiency and safety concerns of Deep Reinforcement Learning (DRL) in process control by proposing transfer learning as a solution to enhance generalization and adaptability, offering recommendations for future integration without presenting specific experimental results or numbers.
In the context of Industry 4.0 and smart manufacturing, the field of process industry optimization and control is also undergoing a digital transformation. With the rise of Deep Reinforcement Learning (DRL), its application in process control has attracted widespread attention. However, the extremely low sample efficiency and the safety concerns caused by exploration in DRL hinder its practical implementation in industrial settings. Transfer learning offers an effective solution for DRL, enhancing its generalization and adaptability in multi-mode control scenarios. This paper provides insights into the use of DRL for process control from the perspective of transfer learning. We analyze the challenges of applying DRL in the process industry and the necessity of introducing transfer learning. Furthermore, recommendations and prospects are provided for future research directions on how transfer learning can be integrated with DRL to enhance process control. This paper aims to offer a set of promising, user-friendly, easy-to-implement, and scalable approaches to artificial intelligence-facilitated industrial control for scholars and engineers in the process industry.