Jian Zhao

Lin Liu, Jian Zhao, Cheng Hu et al.

Games are widely used as research environments for multi-agent reinforcement learning (MARL), but they pose three significant challenges: limited customization, high computational demands, and oversimplification. To address these issues, we introduce the first publicly available map editor for the popular mobile game Honor of Kings and design a lightweight environment, Mini Honor of Kings (Mini HoK), for researchers to conduct experiments. Mini HoK is highly efficient, allowing experiments to be run on personal PCs or laptops while still presenting sufficient challenges for existing MARL algorithms. We have tested our environment on common MARL algorithms and demonstrated that these algorithms have yet to find optimal solutions within this environment. This facilitates the dissemination and advancement of MARL methods within the research community. Additionally, we hope that more researchers will leverage the Honor of Kings map editor to develop innovative and scientifically valuable new maps. Our code and user manual are available at: https://github.com/tencent-ailab/mini-hok.

Suorong Yang, Peijia Li, Furao Shen et al.

Modern deep architectures often rely on large-scale datasets, but training on these datasets incurs high computational and storage overhead. Real-world datasets often contain substantial redundancies, prompting the need for more data-efficient training paradigms. Data selection has shown promise to mitigate redundancy by identifying the most representative samples, thereby reducing training costs without compromising performance. Existing methods typically rely on static scoring metrics or pretrained models, overlooking the combined effect of selected samples and their evolving dynamics during training. We introduce the concept of epsilon-sample cover, which quantifies sample redundancy based on inter-sample relationships, capturing the intrinsic structure of the dataset. Based on this, we reformulate data selection as a reinforcement learning (RL) process and propose RL-Selector, where a lightweight RL agent optimizes the selection policy by leveraging epsilon-sample cover derived from evolving dataset distribution as a reward signal. Extensive experiments across benchmark datasets and diverse architectures demonstrate that our method consistently outperforms existing state-of-the-art baselines. Models trained with our selected datasets show enhanced generalization performance with improved training efficiency.

Huanhai Xin, Ziheng Li, Wei Dong et al.

The output impedance matrix of a grid-connected converter plays an important role in analyzing system stability. Due to the dynamics of the DC-link control and the phase locked loop (PLL), the output impedance matrices of the converter and grid are difficult to be diagonally decoupled simultaneously, neither in the dq domain nor in the phase domain. It weakens the effectiveness of impedance-based stability criterion (ISC) in system oscillation analysis. To this end, this paper innovatively proposes the generalized-impedance based stability criterion (GISC) to reduce the dimension of the transfer function matrix and simplify system small-signal stability analysis. Firstly, the impedances of the converter and the grid in polar coordinates are formulated, and the concept of generalized-impedance of the converter and the grid is put forward. Secondly, through strict mathematical derivation, the equation that implies the dynamic interaction between the converter and the grid is then extracted from the characteristic equation of the grid-connected converter system. Using the proposed method, the small-signal instability of system can be interpreted as the resonance of the generalized-impedances of the converter and the grid. Besides, the GISC is equivalent to ISC when the dynamics of the outer-loop control and PLL are not considered. Finally, the effectiveness of the proposed method is further verified using the MATLAB based digital simulation and RT-LAB based hardware-in-the-loop (HIL) simulation.