NAJan 31, 2016
Radial basis function ENO and WENO finite difference methods based on the optimization of shape parametersJingyang Guo, Jae-Hun Jung
We present adaptive finite difference ENO/WENO methods by adopting infinitely smooth radial basis functions (RBFs). This is a direct extension of the non-polynomial finite volume ENO/WENO method proposed by authors in \cite{GuoJung} to the finite difference ENO/WENO method based on the original smoothness indicator scheme developed by Jiang and Shu \cite{WENO}. The RBF-ENO/WENO finite difference method slightly perturbs the reconstruction coefficients with RBFs as the reconstruction basis and enhances accuracy in the smooth region by locally optimizing the shape parameters. The RBF-ENO/WENO finite difference methods provide more accurate reconstruction than the regular ENO/WENO reconstruction and provide sharper solution profiles near the jump discontinuity. Furthermore the RBF-ENO/WENO methods are easy to implement in the existing regular ENO/WENO code. The numerical results in 1D and 2D presented in this work show that the proposed RBF-ENO/WENO finite difference method better performs than the regular ENO/WENO method.
NAAug 23, 2011
Efficient determination of the critical parameters and the statistical quantities for Klein-Gordon and sine-Gordon equations with a singular potential using generalized polynomial chaos methodsDebananda Chakraborty, Jae-Hun Jung
We consider the Klein-Gordon and sine-Gordon type equations with a point-like potential, which describes the wave phenomenon in disordered media with a defect. The singular potential term yields a critical phenomenon--that is, the solution behavior around the critical parameter value bifurcates into two extreme cases. Pinpointing the critical value with arbitrary accuracy is even more challenging. In this work, we adopt the generalized polynomial chaos (gPC) method to determine the critical values and the mean solutions around such values. First, we consider the critical value associated with the strength of the singular potential for the Klein-Gordon equation. We expand the solution in the random variable associated with the parameter. The obtained partial differential equations are solved using the Chebyshev collocation method. Due to the existence of the singularity, the Gibbs phenomenon appears in the solution, yielding a slow convergence of the numerically computed critical value. To deal with the singularity, we adopt the consistent spectral collocation method. The gPC method, along with the consistent Chebyshev method, determines the critical value and the mean solution highly efficiently. We then consider the sine-Gordon equation, for which the critical value is associated with the initial velocity of the kink soliton solution. The critical behavior in this case is that the solution passes through (particle-pass), is trapped by (particle-capture), or is reflected by (particle-reflection) the singular potential if the initial velocity of the soliton solution is greater than, equal to, or less than the critical value, respectively. We use the gPC mean value rather than reconstructing the solution to find the critical parameter. Numerical results show that the critical value can be determined efficiently and accurately by using the proposed method.
NANov 16, 2011
Efficient determination of critical parameters of nonlinear Schrödinger equation with point-like potential using generalized polynomial chaos methodsDebananda Chakraborty, Jae-Hun Jung, Emmanuel Lorin
We consider the nonlinear Schrödinger equation with a point-like source term. The soliton interaction with such a singular potential yields a critical solution behavior. That is, for the given value of the potential strength and the soliton amplitude, there exists a critical velocity of the initial soliton solution, around which the solution is either trapped by or transmitted through the potential. In this paper, we propose an efficient method for finding such a critical velocity by using the generalized polynomial chaos method. For the proposed method, we assume that the soliton velocity is a random variable and expand the solution in the random space using the orthogonal polynomials. The proposed method finds the critical velocity accurately with spectral convergence. Thus the computational complexity is much reduced. Numerical results for the smaller and higher values of the potential strength confirm the spectral convergence of the proposed method.
NAMar 27
A Family of Even-Order Central-Upwind WENO Schemes with Averaged Downwind and Novel Global Smoothness IndicatorsJiaxi Gu, Bao-Shan Wang, Wai Sun Don et al.
We propose a simple yet effective local smoothness indicator for the downwind stencil in central-upwind weighted essentially non-oscillatory (WENO) schemes of even order for hyperbolic conservation laws. Starting from an odd-order upwind WENO scheme, we construct an even-number-of-points stencil by incorporating a downwind substencil whose smoothness indicator is the arithmetic mean of all local smoothness indicators. This straightforward averaging approach incorporates regularity information from the entire stencil without requiring additional tuning parameters or complex formulations. Combined with affine-invariant Z-type nonlinear weights and a carefully designed global smoothness indicator, the resulting scheme, termed WENO-ZA6 for the sixth-order case, achieves optimal convergence rates at critical points up to second order, exhibits favorable dispersion and dissipation properties as confirmed by approximate dispersion relation analysis, and provides sharp, essentially non-oscillatory resolution of discontinuities. Numerical experiments on scalar problems and the one- and two-dimensional Euler equations demonstrate that WENO-ZA6 achieves accuracy comparable to or better than existing sixth-order central-upwind schemes (WENO-CU6, WENO-S6) and the seventh-order WENO-Z7, while requiring approximately 15\%--21\% less computational time. The framework extends naturally to fourth-, eighth-, and tenth-order schemes.
NAJan 31, 2016
Non-polynomial ENO and WENO finite volume methods for hyperbolic conservation lawsJingyang Guo, Jae-Hun Jung
The essentially non-oscillatory (ENO) method is an efficient high order numerical method for solving hyperbolic conservation laws designed to reduce the Gibbs oscillations, if existent, by adaptively choosing the local stencil for the interpolation. The original ENO method is constructed based on the polynomial interpolation and the overall rate of convergence provided by the method is uniquely determined by the total number of interpolation points involved for the approximation. In this paper, we propose simple non-polynomial ENO and weighted ENO (WENO) finite volume methods in order to enhance the local accuracy and convergence. We first adopt the infinitely smooth radial basis functions (RBFs) for a non-polynomial interpolation. Particularly we use the multi-quadric and Gaussian RBFs. The non-polynomial interpolation such as the RBF interpolation offers the flexibility to control the local error by optimizing the free parameter. Then we show that the non-polynomial interpolation can be represented as a perturbation of the polynomial interpolation. That is, it is not necessary to know the exact form of the non-polynomial basis for the interpolation. In this paper, we formulate the ENO and WENO methods based on the non-polynomial interpolation and derive the optimization condition of the perturbation. To guarantee the essentially non-oscillatory property, we switch the non-polynomial reconstruction to the polynomial reconstruction adaptively near the non-smooth area by using the monotone polynomial interpolation method. The numerical results show that the developed non-polynomial ENO and WENO methods enhance the local accuracy.
MLNov 15, 2023
Supervised low-rank semi-nonnegative matrix factorization with frequency regularization for forecasting spatio-temporal dataKeunsu Kim, Hanbaek Lyu, Jinsu Kim et al.
We propose a novel methodology for forecasting spatio-temporal data using supervised semi-nonnegative matrix factorization (SSNMF) with frequency regularization. Matrix factorization is employed to decompose spatio-temporal data into spatial and temporal components. To improve clarity in the temporal patterns, we introduce a nonnegativity constraint on the time domain along with regularization in the frequency domain. Specifically, regularization in the frequency domain involves selecting features in the frequency space, making an interpretation in the frequency domain more convenient. We propose two methods in the frequency domain: soft and hard regularizations, and provide convergence guarantees to first-order stationary points of the corresponding constrained optimization problem. While our primary motivation stems from geophysical data analysis based on GRACE (Gravity Recovery and Climate Experiment) data, our methodology has the potential for wider application. Consequently, when applying our methodology to GRACE data, we find that the results with the proposed methodology are comparable to previous research in the field of geophysical sciences but offer clearer interpretability.
SDMar 29, 2022
Machine Composition of Korean Music via Topological Data Analysis and Artificial Neural NetworkMai Lan Tran, Dongjin Lee, Jae-Hun Jung
Common AI music composition algorithms based on artificial neural networks are to train a machine by feeding a large number of music pieces and create artificial neural networks that can produce music similar to the input music data. This approach is a blackbox optimization, that is, the underlying composition algorithm is, in general, not known to users. In this paper, we present a way of machine composition that trains a machine the composition principle embedded in the given music data instead of directly feeding music pieces. We propose this approach by using the concept of {\color{black}{Overlap}} matrix proposed in \cite{TPJ}. In \cite{TPJ}, a type of Korean music, so-called the {\it Dodeuri} music such as Suyeonjangjigok has been analyzed using topological data analysis (TDA), particularly using persistent homology. As the raw music data is not suitable for TDA analysis, the music data is first reconstructed as a graph. The node of the graph is defined as a two-dimensional vector composed of the pitch and duration of each music note. The edge between two nodes is created when those nodes appear consecutively in the music flow. Distance is defined based on the frequency of such appearances. Through TDA on the constructed graph, a unique set of cycles is found for the given music. In \cite{TPJ}, the new concept of the {\it {\color{black}{Overlap}} matrix} has been proposed, which visualizes how those cycles are interconnected over the music flow, in a matrix form. In this paper, we explain how we use the {\color{black}{Overlap}} matrix for machine composition. The {\color{black}{Overlap}} matrix makes it possible to compose a new music piece algorithmically and also provide a seed music towards the desired artificial neural network. In this paper, we use the {\it Dodeuri} music and explain detailed steps.
LGJul 8, 2024
A third-order finite difference weighted essentially non-oscillatory scheme with shallow neural networkKwanghyuk Park, Xinjuan Chen, Dongjin Lee et al.
In this paper, we introduce the finite difference weighted essentially non-oscillatory (WENO) scheme based on the neural network for hyperbolic conservation laws. We employ the supervised learning and design two loss functions, one with the mean squared error and the other with the mean squared logarithmic error, where the WENO3-JS weights are computed as the labels. Each loss function consists of two components where the first component compares the difference between the weights from the neural network and WENO3-JS weights, while the second component matches the output weights of the neural network and the linear weights. The former of the loss function enforces the neural network to follow the WENO properties, implying that there is no need for the post-processing layer. Additionally the latter leads to better performance around discontinuities. As a neural network structure, we choose the shallow neural network (SNN) for computational efficiency with the Delta layer consisting of the normalized undivided differences. These constructed WENO3-SNN schemes show the outperformed results in one-dimensional examples and improved behavior in two-dimensional examples, compared with the simulations from WENO3-JS and WENO3-Z.
NAMar 16
A scaled TW-PINN: A physics-informed neural network for traveling wave solutions of reaction-diffusion equations with general coefficientsSeungwan Han, Kwanghyuk Park, Jiaxi Gu et al.
We propose an efficient and generalizable physics-informed neural network (PINN) framework for computing traveling wave solutions of $n$-dimensional reaction-diffusion equations with various reaction and diffusion coefficients. By applying a scaling transformation with the traveling wave form, the original problem is reduced to a one-dimensional scaled reaction-diffusion equation with unit reaction and diffusion coefficients. This reduction leads to the proposed framework, termed scaled TW-PINN, in which a single PINN solver trained on the scaled equation is reused for different coefficient choices and spatial dimensions. We also prove a universal approximation property of the proposed PINN solver for traveling wave solutions. Numerical experiments in one and two dimensions, together with a comparison to the existing wave-PINN method, demonstrate the accuracy, flexibility, and superior performance of scaled TW-PINN. Finally, we explore an extension of the framework to the Fisher's equation with general initial conditions.
CVApr 29
Topology-Aware Representation Alignment for Semi-Supervised Vision-Language LearningJunwon You, Mihyun Jang, Sangwoo Mo et al.
Vision-language models have shown strong performance, but they often generalize poorly to specialized domains. While semi-supervised vision-language learning mitigates this limitation by leveraging a small set of labeled image-text pairs together with abundant unlabeled images, existing methods remain fundamentally pairwise and fail to model the global structure of multimodal representation manifolds. Existing topology-based alignment methods rely on persistence diagram matching, which neither guarantees geometric alignment nor utilizes the image-text pairing information central to vision-language learning. We propose Topology-Aware Multimodal Representation Alignment (ToMA), a framework that uses persistent homology to identify topologically salient edges and aligns them across modalities through available cross-modal correspondences. ToMA leverages both H_0-death edges and lightweight H_1-birth edges, allowing it to capture both connectivity and cycle structure without constructing 2-simplices. Experiments show that ToMA yields stable gains, with clear improvements on remote sensing and modest but consistent benefits on fashion retrieval. Additional analysis shows that ToMA is more stable than alternative topology-based objectives and that lightweight H_1-birth edges provide useful higher-order structural signals.
LGApr 23, 2024
PHLP: Sole Persistent Homology for Link Prediction - Interpretable Feature ExtractionJunwon You, Eunwoo Heo, Jae-Hun Jung
Link prediction (LP), inferring the connectivity between nodes, is a significant research area in graph data, where a link represents essential information on relationships between nodes. Although graph neural network (GNN)-based models have achieved high performance in LP, understanding why they perform well is challenging because most comprise complex neural networks. We employ persistent homology (PH), a topological data analysis method that helps analyze the topological information of graphs, to interpret the features used for prediction. We propose a novel method that employs PH for LP (PHLP) focusing on how the presence or absence of target links influences the overall topology. The PHLP utilizes the angle hop subgraph and new node labeling called degree double radius node labeling (Degree DRNL), distinguishing the information of graphs better than DRNL. Using only a classifier, PHLP performs similarly to state-of-the-art (SOTA) models on most benchmark datasets. Incorporating the outputs calculated using PHLP into the existing GNN-based SOTA models improves performance across all benchmark datasets. To the best of our knowledge, PHLP is the first method of applying PH to LP without GNNs. The proposed approach, employing PH while not relying on neural networks, enables the identification of crucial factors for improving performance.
CVOct 13, 2025
Topological Alignment of Shared Vision-Language Embedding SpaceJunwon You, Dasol Kang, Jae-Hun Jung
Contrastive Vision-Language Models (VLMs) have demonstrated strong zero-shot capabilities. However, their cross-modal alignment remains biased toward English due to limited multilingual multimodal data. Recent multilingual extensions have alleviated this gap but enforce instance-level alignment while neglecting the global geometry of the shared embedding space. We address this problem by introducing ToMCLIP (Topological Alignment for Multilingual CLIP), a topology-aware framework aligning embedding spaces with topology-preserving constraints. The proposed method applies persistent homology to define a topological alignment loss and approximates persistence diagram with theoretical error bounds using graph sparsification strategy. This work validates the proposed approach, showing enhanced structural coherence of multilingual representations, higher zero-shot accuracy on the CIFAR-100, and stronger multilingual retrieval performance on the xFlickr&CO. Beyond VLMs, the proposed approach provides a general method for incorporating topological alignment into representation learning.
NAJul 8, 2025
Conservative approximation-based feedforward neural network for WENO schemesKwanghyuk Park, Jiaxi Gu, Jae-Hun Jung
In this work, we present the feedforward neural network based on the conservative approximation to the derivative from point values, for the weighted essentially non-oscillatory (WENO) schemes in solving hyperbolic conservation laws. The feedforward neural network, whose inputs are point values from the three-point stencil and outputs are two nonlinear weights, takes the place of the classical WENO weighting procedure. For the training phase, we employ the supervised learning and create a new labeled dataset for one-dimensional conservative approximation, where we construct a numerical flux function from the given point values such that the flux difference approximates the derivative to high-order accuracy. The symmetric-balancing term is introduced for the loss function so that it propels the neural network to match the conservative approximation to the derivative and satisfy the symmetric property that WENO3-JS and WENO3-Z have in common. The consequent WENO schemes, WENO3-CADNNs, demonstrate robust generalization across various benchmark scenarios and resolutions, where they outperform WENO3-Z and achieve accuracy comparable to WENO5-JS.
LGFeb 1, 2022
Weighted Isolation and Random Cut Forest Algorithms for Anomaly DetectionSijin Yeom, Jae-Hun Jung
Random cut forest (RCF) algorithms have been developed for anomaly detection, particularly in time series data. The RCF algorithm is an improved version of the isolation forest (IF) algorithm. Unlike the IF algorithm, the RCF algorithm can determine whether real-time input contains an anomaly by inserting the input into the constructed tree network. Various RCF algorithms, including Robust RCF (RRCF), have been developed, where the cutting procedure is adaptively chosen probabilistically. The RRCF algorithm demonstrates better performance than the IF algorithm, as dimension cuts are decided based on the geometric range of the data, whereas the IF algorithm randomly chooses dimension cuts. However, the overall data structure is not considered in both IF and RRCF, given that split values are chosen randomly. In this paper, we propose new IF and RCF algorithms, referred to as the weighted IF (WIF) and weighted RCF (WRCF) algorithms, respectively. Their split values are determined by considering the density of the given data. To introduce the WIF and WRCF, we first present a new geometric measure, a density measure, which is crucial for constructing the WIF and WRCF. We provide various mathematical properties of the density measure, accompanied by theorems that support and validate our claims through numerical examples.
SDMar 11, 2021
Topological Data Analysis of Korean Music in Jeongganbo: A Cycle StructureMai Lan Tran, Changbom Park, Jae-Hun Jung
Jeongganbo is a unique music representation invented by Sejong the Great. Contrary to the western music notation, the pitch of each note is encrypted and the length is visualized directly in a matrix form in Jeongganbo. We use topological data analysis (TDA) to analyze the Korean music written in Jeongganbo for Suyeonjang, Songuyeo, and Taryong, those well-known pieces played at the palace and among noble community. We are particularly interested in the cycle structure. We first define and determine the node elements of each music, characterized uniquely with its pitch and length. Then we transform the music into a graph and define the distance between the nodes as their adjacent occurrence rate. The graph is used as a point cloud whose homological structure is investigated by measuring the hole structure in each dimension. We identify cycles of each music, match those in Jeongganbo, and show how those cycles are interconnected. The main discovery of this work is that the cycles of Suyeonjang and Songuyeo, categorized as a special type of cyclic music known as Dodeuri, frequently overlap each other when appearing in the music while the cycles found in Taryong, which does not belong to Dodeuri class, appear individually.
CGNov 23, 2020
The Interconnectivity Vector: A Finite-Dimensional Vector Representation of Persistent HomologyMegan Johnson, Jae-Hun Jung
Persistent Homology (PH) is a useful tool to study the underlying structure of a data set. Persistence Diagrams (PDs), which are 2D multisets of points, are a concise summary of the information found by studying the PH of a data set. However, PDs are difficult to incorporate into a typical machine learning workflow. To that end, two main methods for representing PDs have been developed: kernel methods and vectorization methods. In this paper we propose a new finite-dimensional vector, called the interconnectivity vector, representation of a PD adapted from Bag-of-Words (BoW). This new representation is constructed to demonstrate the connections between the homological features of a data set. This initial definition of the interconnectivity vector proves to be unstable, but we introduce a stabilized version of the vector and prove its stability with respect to small perturbations in the inputs. We evaluate both versions of the presented vectorization on several data sets and show their high discriminative power.
IMOct 18, 2019
Detection of gravitational waves using topological data analysis and convolutional neural network: An improved approachChristopher Bresten, Jae-Hun Jung
The gravitational wave detection problem is challenging because the noise is typically overwhelming. Convolutional neural networks (CNNs) have been successfully applied, but require a large training set and the accuracy suffers significantly in the case of low SNR. We propose an improved method that employs a feature extraction step using persistent homology. The resulting method is more resilient to noise, more capable of detecting signals with varied signatures and requires less training. This is a powerful improvement as the detection problem can be computationally intense and is concerned with a relatively large class of wave signatures.