6.0CEMay 9
XNet-Enhanced Deep BSDE Method and Numerical AnalysisXiaotao Zheng, Xingye Yue, Zhihong Xia et al.
Semilinear parabolic partial differential equations (PDEs) are fundamental to modeling complex dynamical systems across scientific domains. The Deep Backward Stochastic Differential Equation (BSDE) method is a promising approach for high-dimensional PDEs; however, existing convergence results apply only to globally Lipschitz generators, excluding important cases such as Allen--Cahn and Hamilton--Jacobi--Bellman (HJB) equations. This paper presents both a theoretical and a computational advance for Deep BSDE methods. Theoretically, we establish the convergence theory for non--Lipschitz generators--covering Allen--Cahn equations with cubic nonlinearity and HJB equations with quadratic gradient growth--based on a bounded double--well lemma and a truncated-BSDE analysis within the Bouchard--Touzi--Zhang theory. Computationally, we instantiate the framework with XNet, a shallow architecture with $\mathcal O(L)$ parameters that preserves strong approximation while substantially reducing optimization and computational cost. Numerical experiments on 100--dimensional PDEs corroborate the predicted convergence behavior and demonstrate significant efficiency gains over standard feedforward implementations.
9.2LGSep 28, 2024
Cauchy activation function and XNetXin Li, Zhihong Xia, Hongkun Zhang
We have developed a novel activation function, named the Cauchy Activation Function. This function is derived from the Cauchy Integral Theorem in complex analysis and is specifically tailored for problems requiring high precision. This innovation has led to the creation of a new class of neural networks, which we call (Comple)XNet, or simply XNet. We will demonstrate that XNet is particularly effective for high-dimensional challenges such as image classification and solving Partial Differential Equations (PDEs). Our evaluations show that XNet significantly outperforms established benchmarks like MNIST and CIFAR-10 in computer vision, and offers substantial advantages over Physics-Informed Neural Networks (PINNs) in both low-dimensional and high-dimensional PDE scenarios.
11.4LGFeb 7, 2025
Complex Physics-Informed Neural NetworkChenhao Si, Ming Yan, Xin Li et al.
We propose compleX-PINN, a novel physics-informed neural network (PINN) architecture incorporating a learnable activation function inspired by the Cauchy integral theorem. By optimizing the activation parameters, compleX-PINN achieves high accuracy with just a single hidden layer. Empirically, we demonstrate that compleX-PINN solves high-dimensional problems that pose significant challenges for PINNs. Our results show that compleX-PINN consistently achieves substantially greater precision, often improving accuracy by an order of magnitude, on these complex tasks.
7.1LGJan 31, 2025
Enhancing Neural Function Approximation: The XNet Outperforming KANXin Li, Xiaotao Zheng, Zhihong Xia
XNet is a single-layer neural network architecture that leverages Cauchy integral-based activation functions for high-order function approximation. Through theoretical analysis, we show that the Cauchy activation functions used in XNet can achieve arbitrary-order polynomial convergence, fundamentally outperforming traditional MLPs and Kolmogorov-Arnold Networks (KANs) that rely on increased depth or B-spline activations. Our extensive experiments on function approximation, PDE solving, and reinforcement learning demonstrate XNet's superior performance - reducing approximation error by up to 50000 times and accelerating training by up to 10 times compared to existing approaches. These results establish XNet as a highly efficient architecture for both scientific computing and AI applications.