Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness
This addresses inventory management challenges for supply chain optimization, but it is incremental as it builds on existing RL and deep learning methods.
The paper tackles the multi-sourcing multi-period inventory management problem in supply chain optimization by applying reinforcement learning with intervention models to break down complex constraints into scalable deep learning modules, resulting in improved performance on large real-world datasets.
In this work, we study how to efficiently apply reinforcement learning (RL) for solving large-scale stochastic optimization problems by leveraging intervention models. The key of the proposed methodology is to better explore the solution space by simulating and composing the stochastic processes using pre-trained deep learning (DL) models. We demonstrate our approach on a challenging real-world application, the multi-sourcing multi-period inventory management problem in supply chain optimization. In particular, we employ deep RL models for learning and forecasting the stochastic supply chain processes under a range of assumptions. Moreover, we also introduce a constraint coordination mechanism, designed to forecast dual costs given the cross-products constraints in the inventory network. We highlight that instead of directly modeling the complex physical constraints into the RL optimization problem and solving the stochastic problem as a whole, our approach breaks down those supply chain processes into scalable and composable DL modules, leading to improved performance on large real-world datasets. We also outline open problems for future research to further investigate the efficacy of such models.