3.3NADec 11, 2022
A model-data asymptotic-preserving neural network method based on micro-macro decomposition for gray radiative transfer equationsHongyan Li, Song Jiang, Wenjun Sun et al.
We propose a model-data asymptotic-preserving neural network(MD-APNN) method to solve the nonlinear gray radiative transfer equations(GRTEs). The system is challenging to be simulated with both the traditional numerical schemes and the vanilla physics-informed neural networks(PINNs) due to the multiscale characteristics. Under the framework of PINNs, we employ a micro-macro decomposition technique to construct a new asymptotic-preserving(AP) loss function, which includes the residual of the governing equations in the micro-macro coupled form, the initial and boundary conditions with additional diffusion limit information, the conservation laws, and a few labeled data. A convergence analysis is performed for the proposed method, and a number of numerical examples are presented to illustrate the efficiency of MD-APNNs, and particularly, the importance of the AP property in the neural networks for the diffusion dominating problems. The numerical results indicate that MD-APNNs lead to a better performance than APNNs or pure data-driven networks in the simulation of the nonlinear non-stationary GRTEs.
1.2NAFeb 22, 2019
Weighted integral solvers for elastic scattering by open arcs in two dimensionsOscar P. Bruno, Liwei Xu, Tao Yin
We present a novel approach for the numerical solution of problems of elastic scattering by open arcs in two dimensions. Our methodology relies on the composition of weighted versions of the classical operators associated with Dirichlet and Neumann boundary conditions in conjunction with a certain "open-arc elastic Calderón relation" whose validity is demonstrated in this paper on the basis of numerical experiments, but whose rigorous mathematical proof is left for future work. Using this Calderón relation in conjunction with spectrally accurate quadrature rules and the Krylov-subspace linear algebra solver GMRES, the proposed overall open-arc elastic solver produces results of high accuracy in small number of iterations---for low and high frequencies alike. A variety of numerical examples in this paper demonstrate the accuracy and efficiency of the proposed methodology.
3.9CVMay 15, 2023
Learning More Discriminative Local Descriptors for Few-shot LearningQijun Song, Siyun Zhou, Liwei Xu
Few-shot learning for image classification comes up as a hot topic in computer vision, which aims at fast learning from a limited number of labeled images and generalize over the new tasks. In this paper, motivated by the idea of Fisher Score, we propose a Discriminative Local Descriptors Attention (DLDA) model that adaptively selects the representative local descriptors and does not introduce any additional parameters, while most of the existing local descriptors based methods utilize the neural networks that inevitably involve the tedious parameter tuning. Moreover, we modify the traditional $k$-NN classification model by adjusting the weights of the $k$ nearest neighbors according to their distances from the query point. Experiments on four benchmark datasets show that our method not only achieves higher accuracy compared with the state-of-art approaches for few-shot learning, but also possesses lower sensitivity to the choices of $k$.
Big-Data Clustering: K-Means or K-Indicators?Feiyu Chen, Yuchen Yang, Liwei Xu et al.
The K-means algorithm is arguably the most popular data clustering method, commonly applied to processed datasets in some "feature spaces", as is in spectral clustering. Highly sensitive to initializations, however, K-means encounters a scalability bottleneck with respect to the number of clusters K as this number grows in big data applications. In this work, we promote a closely related model called K-indicators model and construct an efficient, semi-convex-relaxation algorithm that requires no randomized initializations. We present extensive empirical results to show advantages of the new algorithm when K is large. In particular, using the new algorithm to start the K-means algorithm, without any replication, can significantly outperform the standard K-means with a large number of currently state-of-the-art random replications.