Shuai Han

Shuai Han, Lukas Stelz, Horst Stoecker et al.

A physics-informed neural network (PINN) embedded with the susceptible-infected-removed (SIR) model is devised to understand the temporal evolution dynamics of infectious diseases. Firstly, the effectiveness of this approach is demonstrated on synthetic data as generated from the numerical solution of the susceptible-asymptomatic-infected-recovered-dead (SAIRD) model. Then, the method is applied to COVID-19 data reported for Germany and shows that it can accurately identify and predict virus spread trends. The results indicate that an incomplete physics-informed model can approach more complicated dynamics efficiently. Thus, the present work demonstrates the high potential of using machine learning methods, e.g., PINNs, to study and predict epidemic dynamics in combination with compartmental models.

You Zhou, Xiujing Lin, Xiang Zhang et al.

Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades, and is widely used in many areas including computing vision, natural language processing, time-series analysis, speech synthesis, etc. During the age of deep learning, especially with the arise of Large Language Models, a large majority of researchers' attention is paid on pursuing new state-of-the-art (SOTA) results, resulting in ever increasing of model size and computational complexity. The needs for high computing power brings higher carbon emission and undermines research fairness by preventing small or medium-sized research institutions and companies with limited funding in participating in research. To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic. In this survey, we give a systematic overview of the technologies used in Green Computing. We propose the framework of Green Computing and devide it into four key components: (1) Measures of Greenness, (2) Energy-Efficient AI, (3) Energy-Efficient Computing Systems and (4) AI Use Cases for Sustainability. For each components, we discuss the research progress made and the commonly used techniques to optimize the AI efficiency. We conclude that this new research direction has the potential to address the conflicts between resource constraints and AI development. We encourage more researchers to put attention on this direction and make AI more environmental friendly.

Junwei Zhang, Zhenghao Zhang, Shuai Han et al.

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability. For classical reinforcement learning, there are some schemes that make exploration more full and balanced with data exploitation, but they can't be applied in complex environments due to the complexity of algorithm. Based on continuous control tasks with dense reward, this paper analyzes the assumption of the original Gaussian action exploration mechanism in PPO algorithm, and clarifies the influence of exploration ability on performance. Afterward, aiming at the problem of exploration, an exploration enhancement mechanism based on uncertainty estimation is designed in this paper. Then, we apply exploration enhancement theory to PPO algorithm and propose the proximal policy optimization algorithm with intrinsic exploration module (IEM-PPO) which can be used in complex environments. In the experimental parts, we evaluate our method on multiple tasks of MuJoCo physical simulator, and compare IEM-PPO algorithm with curiosity driven exploration algorithm (ICM-PPO) and original algorithm (PPO). The experimental results demonstrate that IEM-PPO algorithm needs longer training time, but performs better in terms of sample efficiency and cumulative reward, and has stability and robustness.

Shuai Han, Wenbo Zhou, Jing Liu et al.

Deep reinforcement learning has been applied more and more widely nowadays, especially in various complex control tasks. Effective exploration for noisy networks is one of the most important issues in deep reinforcement learning. Noisy networks tend to produce stable outputs for agents. However, this tendency is not always enough to find a stable policy for an agent, which decreases efficiency and stability during the learning process. Based on NoisyNets, this paper proposes an algorithm called NROWAN-DQN, i.e., Noise Reduction and Online Weight Adjustment NoisyNet-DQN. Firstly, we develop a novel noise reduction method for NoisyNet-DQN to make the agent perform stable actions. Secondly, we design an online weight adjustment strategy for noise reduction, which improves stable performance and gets higher scores for the agent. Finally, we evaluate this algorithm in four standard domains and analyze properties of hyper-parameters. Our results show that NROWAN-DQN outperforms prior algorithms in all these domains. In addition, NROWAN-DQN also shows better stability. The variance of the NROWAN-DQN score is significantly reduced, especially in some action-sensitive environments. This means that in some environments where high stability is required, NROWAN-DQN will be more appropriate than NoisyNets-DQN.

Shuai Han, Sai Xu, Weixiao Meng et al.

An artificial-noise (AN)-aided beamformer specific to correlated main and wiretap channels is designed in this paper. We consider slow-fading multiple-input-single-output (MISO) wiretap channels with a passive single-antenna eavesdropper, in which independent transmitter-side and correlated receiver-side are assumed. Additionally, the source has accurate main channel information and statistical wiretap channel information. To reduce the secrecy loss due to receiver-side correlation, this paper proposes the scheme of channel-correlation-enabled transmit optimization. Particularly, the correlation is viewed as a resource to acquire more knowledge about wiretap channel. Based on this, the statistical distribution of wiretap channel is described more precisely. Then, the power of AN in the null space of main channel is placed more reasonably instead of simple uniform distribution and an elaborate beamformer for the information-bearing signal is designed. Finally, an efficient algorithm for power allocation between the information-bearing signal and the AN is developed. Simulation results show that the secrecy rate under transmit power and secrecy outage constraint is improved.

Shuai Han, Sai Xu, Weixiao Meng et al.

In physical layer security (PHY-security), the frequently observed high correlation between the main and wiretap channels can cause a significant loss of secrecy. This paper investigates a slow fading scenario, where a transmitter (Alice) sends a confidential message to a legitimate receiver (Bob) while a passive eavesdropper (Eve) attempts to decode the message from its received signal. It is assumed that Alice is equipped with multiple antennas while Bob and Eve each have a single antenna (i.e., a MISOSE system). In a MISOSE system, high correlation results in nearly collinear main and wiretap channel vectors, which help Eve to see and intercept confidential information. Unfortunately, the signal processing techniques at Alice, such as beamforming and artificial noise (AN), are helpless, especially in the extreme case of completely collinear main and wiretap channel vectors. On this background, we first investigate the achievable secrecy outage probability via beamforming and AN at Alice with the optimal power allocation between the information-bearing signal and AN. Then, an ingenious model, in which a cooperative jamming relay (Relay) is introduced, is proposed to effectively mitigate the adverse effects of high correlation. Based on the proposed model, the power allocation between the information-bearing signal at Alice and the AN at Relay is also studied to maximize secrecy. Finally, to validate our proposed schemes, numerical simulations are conducted, and the results show that a significant performance gain with respect to secrecy is achieved.