NAMay 16, 2016
A Splitting-free Vorticity Redistribution MethodMatthias Kirchhart, Shinnosuke Obi
We present a splitting-free variant of the vorticity redistribution method. Spatial consistency and stability when combined with a time-stepping scheme are proven. We propose a new strategy preventing excessive growth in the number of particles while retaining the order of consistency. The novel concept of small neighbourhoods significantly reduces the method's computational cost. In numerical experiments the method showed second order convergence, one order higher than predicted by the analysis. Compared to the fast multipole code used in the velocity computation, the method is about three times faster.
AIMar 26, 2024Code
Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUsKai Yuan, Christoph Bauinger, Xiangyi Zhang et al.
This paper presents a SYCL implementation of Multi-Layer Perceptrons (MLPs), which targets and is optimized for the Intel Data Center GPU Max 1550. To increase the performance, our implementation minimizes the slow global memory accesses by maximizing the data reuse within the general register file and the shared local memory by fusing the operations in each layer of the MLP. We show with a simple roofline model that this results in a significant increase in the arithmetic intensity, leading to improved performance, especially for inference. We compare our approach to a similar CUDA implementation for MLPs and show that our implementation on the Intel Data Center GPU outperforms the CUDA implementation on Nvidia's H100 GPU by a factor up to 2.84 in inference and 1.75 in training. The paper also showcases the efficiency of our SYCL implementation in three significant areas: Image Compression, Neural Radiance Fields, and Physics-Informed Machine Learning. In all cases, our implementation outperforms the off-the-shelf Intel Extension for PyTorch (IPEX) implementation on the same Intel GPU by up to a factor of 30 and the CUDA PyTorch version on Nvidia's H100 GPU by up to a factor 19. The code can be found at https://github.com/intel/tiny-dpcpp-nn.
NAJun 21, 2017
A Smooth Partition of Unity Finite Element Method for Vortex Particle RegularizationMatthias Kirchhart, Shinnosuke Obi
We present a new class of $C^\infty$-smooth finite element spaces on Cartesian grids, based on a partition of unity approach. We use these spaces to construct smooth approximations of particle fields, i.e., finite sums of weighted Dirac deltas. In order to use the spaces on general domains, we propose a fictitious domain formulation, together with a new high-order accurate stabilization. Stability, convergence, and conservation properties of the scheme are established. Numerical experiments confirm the analysis and show that the Cartesian grid-size $σ$ should be taken proportional to the square-root of the particle spacing $h$, resulting in significant speed-ups in vortex methods.