Cooperative MARL-Based Energy-Efficient Power Control for Two-Hop Relaying Networks
For relay network operators, it provides a practical method to maximize energy efficiency under realistic CSI constraints, with near-optimal performance.
This paper tackles energy-efficient power control in two-hop relaying networks with partial CSI, achieving performance within 5.2% of the optimal solution using a multi-agent deep Q network.
In this paper, we study a cooperative game in the cooperative communication network, where each relay makes decisions autonomously and aims to achieve the same optimization objective of maximizing energy efficiency. We consider the non-ideal situation where instantaneous channel state information (CSI) is difficult to obtain and only partially observable outdated CSI is available. To solve this game problem, we define a delayed reward-based state-action value function and propose a multi-agent deep Q network learning framework. Then, we prove analytically that utilities obtained by game-theoretic approaches with the instantaneous CSI serve as upper bounds for those of the proposed method. Simulation results reveal that our approach considerably outperforms its potential alternatives and is only about 5.2% away from the optimal solution.