Enhancing Prediction Models with Reinforcement Learning
This work addresses the challenge of personalized and adaptive news recommendations for users at Ringier Axel Springer Polska, but it appears incremental as it combines existing methods like multi-armed bandits and LLMs.
The paper tackled the problem of improving news recommendation by integrating reinforcement learning with prediction models, resulting in significant improvements in online metrics in a real-world production system.
We present a large-scale news recommendation system implemented at Ringier Axel Springer Polska, focusing on enhancing prediction models with reinforcement learning techniques. The system, named Aureus, integrates a variety of algorithms, including multi-armed bandit methods and deep learning models based on large language models (LLMs). We detail the architecture and implementation of Aureus, emphasizing the significant improvements in online metrics achieved by combining ranking prediction models with reinforcement learning. The paper further explores the impact of different models mixing on key business performance indicators. Our approach effectively balances the need for personalized recommendations with the ability to adapt to rapidly changing news content, addressing common challenges such as the cold start problem and content freshness. The results of online evaluation demonstrate the effectiveness of the proposed system in a real-world production environment.