Retrosynthesis Planning via Worst-path Policy Optimisation in Tree-structured MDPs
This work addresses a critical bottleneck in chemical synthesis planning for researchers and industry by improving reliability and efficiency, though it is incremental as it builds on existing MDP frameworks.
The paper tackled retrosynthesis planning by reframing it as a worst-path optimization problem in tree-structured MDPs to address vulnerability to invalid synthetic routes, achieving state-of-the-art results including solving 100% of targets on a benchmark and shortening routes by 4.9%.
Retrosynthesis planning aims to decompose target molecules into available building blocks, forming a synthetic tree where each internal node represents an intermediate compound and each leaf ideally corresponds to a purchasable reactant. However, this tree becomes invalid if any leaf node is not a valid building block, making the planning process vulnerable to the "weakest link" in the synthetic route. Existing methods often optimise for average performance across branches, failing to account for this worst-case sensitivity. In this paper, we reframe retrosynthesis as a worst-path optimisation problem within tree-structured Markov Decision Processes (MDPs). We prove that this formulation admits a unique optimal solution and provides monotonic improvement guarantees. Building on this insight, we introduce Interactive Retrosynthesis Planning (InterRetro), a method that interacts with the tree MDP, learns a value function for worst-path outcomes, and improves its policy through self-imitation, preferentially reinforcing past decisions with high estimated advantage. Empirically, InterRetro achieves state-of-the-art results - solving 100% of targets on the Retro*-190 benchmark, shortening synthetic routes by 4.9%, and achieving promising performance using only 10% of the training data.