A Unified Deep Reinforcement Learning Approach for Close Enough Traveling Salesman Problem
This work addresses a specific variant of the traveling salesman problem for optimization and logistics applications, representing an incremental advancement in applying deep reinforcement learning to combinatorial optimization.
The paper tackles the close-enough traveling salesman problem (CETSP) by proposing a unified deep reinforcement learning framework called UD3RL, which outperforms conventional methods in solution quality and runtime while demonstrating strong generalization across problem scales and dynamic environments.
In recent years, deep reinforcement learning (DRL) has gained traction for solving the NP-hard traveling salesman problem (TSP). However, limited attention has been given to the close-enough TSP (CETSP), primarily due to the challenge introduced by its neighborhood-based visitation criterion, wherein a node is considered visited if the agent enters a compact neighborhood around it. In this work, we formulate a Markov decision process (MDP) for CETSP using a discretization scheme and propose a novel unified dual-decoder DRL (UD3RL) framework that separates decision-making into node selection and waypoint determination. Specifically, an adapted encoder is employed for effective feature extraction, followed by a node-decoder and a loc-decoder to handle the two sub-tasks, respectively. A k-nearest neighbors subgraph interaction strategy is further introduced to enhance spatial reasoning during location decoding. Furthermore, we customize the REINFORCE algorithm to train UD3RL as a unified model capable of generalizing across different problem sizes and varying neighborhood radius types (i.e., constant and random radii). Experimental results show that UD3RL outperforms conventional methods in both solution quality and runtime, while exhibiting strong generalization across problem scales, spatial distributions, and radius ranges, as well as robustness to dynamic environments.