Yuquan Chen

Dian Sheng, Yiheng Wei, Yuquan Chen et al.

This paper proposes a fractional order gradient method for the backward propagation of convolutional neural networks. To overcome the problem that fractional order gradient method cannot converge to real extreme point, a simplified fractional order gradient method is designed based on Caputo's definition. The parameters within layers are updated by the designed gradient method, but the propagations between layers still use integer order gradients, and thus the complicated derivatives of composite functions are avoided and the chain rule will be kept. By connecting every layers in series and adding loss functions, the proposed convolutional neural networks can be trained smoothly according to various tasks. Some practical experiments are carried out in order to demonstrate fast convergence, high accuracy and ability to escape local optimal point at last.

Jiamin Wei, YangQuan Chen, Yongguang Yu et al.

Lévy flights is a random walk where the step-lengths have a probability distribution that is heavy-tailed. It has been shown that Lévy flights can maximize the efficiency of resource searching in uncertain environments, and also movements of many foragers and wandering animals have been shown to follow a Lévy distribution. The reason mainly comes from that the Lévy distribution, has an infinite second moment, and hence is more likely to generate an offspring that is farther away from its parent. However, the investigation into the efficiency of other different heavy-tailed probability distributions in swarm-based searches is still insufficient up to now. For swarm-based search algorithms, randomness plays a significant role in both exploration and exploitation, or diversification and intensification. Therefore, it's necessary to discuss the optimal randomness in swarm-based search algorithms. In this study, CS is taken as a representative method of swarm-based optimization algorithms, and the results can be generalized to other swarm-based search algorithms. In this paper, four different types of commonly used heavy-tailed distributions, including Mittag-Leffler distribution, Pareto distribution, Cauchy distribution, and Weibull distribution, are considered to enhance the searching ability of CS. Then four novel CS algorithms are proposed and experiments are carried out on 20 benchmark functions to compare their searching performances. Finally, the proposed methods are used to system identification to demonstrate the effectiveness.

Zhenlong Wu, Jie Yuan, Yuquan Chen et al.

To handle the control difficulties caused by high-order dynamics, a control structure based on fractional order [proportional integral] (PI) controller and fractional order Smith-like predictor for a class of high order systems in the type of K/(Ts+1)n is proposed in this paper. The analysis of the tracking and disturbance rejection is illustrated based on the terminal value theorem and shows that the proposed control structure can ensure that the closed-loop system converges to the set point without static error and the closed-loop system recovers to its original state when the input disturbance occurs. Then, simulations about the influence on the control performance and control signal with different are carried out based on multi-objective genetic algorithm (MO-GA). The results show that the control performance can be improved and the energy of the control signal can be reduced simultaneously when the order is chosen no more than one. This can verify that the fractional order Smith-like predictor with has an advantage over that of the integral order Smith-like predictor.