ScheduleNet: Learn to solve multi-agent scheduling problems with reinforcement learning
This provides a general learning-based solution for real-time multi-agent scheduling, which is incremental as it applies existing RL and graph methods to this domain.
The authors tackled multi-agent scheduling problems by proposing ScheduleNet, a reinforcement learning-based scheduler that uses graph attention to coordinate agents, achieving effective performance on tasks like multiple traveling salesman and job shop scheduling.
We propose ScheduleNet, a RL-based real-time scheduler, that can solve various types of multi-agent scheduling problems. We formulate these problems as a semi-MDP with episodic reward (makespan) and learn ScheduleNet, a decentralized decision-making policy that can effectively coordinate multiple agents to complete tasks. The decision making procedure of ScheduleNet includes: (1) representing the state of a scheduling problem with the agent-task graph, (2) extracting node embeddings for agent and tasks nodes, the important relational information among agents and tasks, by employing the type-aware graph attention (TGA), and (3) computing the assignment probability with the computed node embeddings. We validate the effectiveness of ScheduleNet as a general learning-based scheduler for solving various types of multi-agent scheduling tasks, including multiple salesman traveling problem (mTSP) and job shop scheduling problem (JSP).