NAMay 20, 2019
Core and Core-EP Inverses of TensorsJajati Kesahri Sahoo, Ratikanta Behera, Predrag S. Stanimirovic et al.
Specific definitions of the core and core-EP inverses of complex tensors are introduced. Some characterizations, representations and properties of the core and core-EP inverses are investigated. The results are verified using specific algebraic approach, based on proposed definitions and previously verified properties. The approach used here is new even in the matrix case.
NAMay 2
A Family of Iterative Methods for Computing Generalized Inverses of Quaternion Matrices and its ApplicationsBiswarup Karmakar, Neha Bhadala, Ratikanta Behera
The computation of generalized inverses of quaternion matrices is a fundamental problem in quaternion linear algebra, with wide-ranging applications in signal processing, image restoration, and multidimensional data analysis. This paper presents three efficient quaternion iterative algorithms for computing the Moore-Penrose pseudoinverse: (i) the quaternion rapid iterative method (QRAPID), (ii) the quaternion strong approximate inverse (QSAI), and (iii) the quaternion hyperpower iterative method of order nineteen (QHPI19). Convergence theorems and perturbation bounds are established to ensure numerical stability and robustness. The QSAI method is further employed as a preconditioner for quaternion Krylov subspace solvers, resulting in substantial reductions in the iteration count and runtime for large-scale linear systems. Comprehensive numerical experiments demonstrate that the proposed algorithms achieve an accuracy comparable to or better than existing approaches, including quaternion SVD, quaternion Newton-Schulz, and classical hyperpower schemes, while offering significant computational savings. The practical utility of the framework is illustrated through two representative applications: image completion via CUR decomposition and signal filtering, which confirm its scalability and effectiveness in real-world multidimensional data applications.
OCMay 2
Quaternion Nonlinear Transform-Induced Nuclear Norm for Low-Rank Tensor CompletionBiswarup Karmakar, Ratikanta Behera
Tensor completion has emerged as a powerful framework for recovering missing data in multidimensional signals by exploiting low-rank tensor structures. Among existing approaches, linear transform-based tensor nuclear norm (TNN) methods have achieved considerable success by enforcing low-rankness on transformed frontal slices. However, the low-rank structure revealed by linear transforms remains inherently limited. To better capture intrinsic correlations, nonlinear transform-based TNN (NTTNN) models have been proposed, significantly enhancing low-rank representation through composite transforms. Despite their effectiveness, existing NTTNN methods are restricted to real-valued tensors and fail to model quaternion-valued data, which are essential for preserving inter-channel dependencies in color images and videos. Extending nonlinear TNN models to the quaternion domain is challenging due to the non-commutativity of quaternion multiplication and the complexity of quaternion singular value decomposition. To address the limitations encountered in prior works, we propose a quaternion nonlinear transform-induced tensor nuclear norm (QNTTNN) via a real embedding of quaternions, enabling tractable nuclear norm definitions and efficient optimization. Building upon QNTTNN, we formulate a quaternion tensor completion model and develop a proximal alternating minimization algorithm with rigorous convergence guarantees. Extensive experiments on benchmark color video inpainting datasets validate the superior performance of the proposed method over existing approaches.
MLApr 15
Robust Low-Rank Tensor Completion based on M-product with Weighted Correlated Total Variation and Sparse RegularizationBiswarup Karmakar, Ratikanta Behera
The robust low-rank tensor completion problem addresses the challenge of recovering corrupted high-dimensional tensor data with missing entries, outliers, and sparse noise commonly found in real-world applications. Existing methodologies have encountered fundamental limitations due to their reliance on uniform regularization schemes, particularly the tensor nuclear norm and $\ell_1$ norm regularization approaches, which indiscriminately apply equal shrinkage to all singular values and sparse components, thereby compromising the preservation of critical tensor structures. The proposed tensor weighted correlated total variation (TWCTV) regularizer addresses these shortcomings through an $M$-product framework that combines a weighted Schatten-$p$ norm on gradient tensors for low-rankness with smoothness enforcement and weighted sparse components for noise suppression. The proposed weighting scheme adaptively reduces the thresholding level to preserve both dominant singular values and sparse components, thus improving the reconstruction of critical structural elements and nuanced details in the recovered signal. Through a systematic algorithmic approach, we introduce an enhanced alternating direction method of multipliers (ADMM) that offers both computational efficiency and theoretical substantiation, with convergence properties comprehensively analyzed within the $M$-product framework.Comprehensive numerical evaluations across image completion, denoising, and background subtraction tasks validate the superior performance of this approach relative to established benchmark methods.
LGApr 30
An adaptive wavelet-based PINN for problems with localized high-magnitude sourceHimanshu Pandey, Ratikanta Behera
In recent years, physics-informed neural networks (PINNs) have gained significant attention for solving differential equations, although they suffer from two fundamental limitations, namely, spectral bias inherent in neural networks and loss imbalance arising from multiscale phenomena. This paper proposes an adaptive wavelet-based PINN (AW-PINN) to address the extreme loss imbalance characteristic of problems with localized high-magnitude source terms. Such problems frequently arise in various physical applications, such as thermal processing, electro-magnetics, impact mechanics, and fluid dynamics involving localized forcing. The proposed framework dynamically adjusts the wavelet basis function based on residual and supervised loss. This adaptive nature makes AW-PINN handle problems with high-scale features effectively without being memory-intensive. Additionally, AW-PINN does not rely on automatic differentiation to obtain derivatives involved in the loss function, which accelerates the training process. The method operates in two stages, an initial short pre-training phase with fixed bases to select physically relevant wavelet families, followed by an adaptive refinement that adapts scales and translations without populating high-resolution bases across entire domains. Theoretically, we show that under certain assumptions, AW-PINN admits a Gaussian process limit and derive its associated NTK structure. We evaluate AW-PINN on several challenging PDEs featuring localized high-magnitude source terms with extreme loss imbalances having ratios up to $10^{10}:1$. Across these PDEs, including transient heat conduction, highly localized Poisson problems, oscillatory flow equations, and Maxwell equations with a point charge source, AW-PINN consistently outperforms existing methods in its class.
LGSep 18, 2024
An efficient wavelet-based physics-informed neural networks for singularly perturbed problemsHimanshu Pandey, Anshima Singh, Ratikanta Behera
Physics-informed neural networks (PINNs) are a class of deep learning models that utilize physics in the form of differential equations to address complex problems, including ones that may involve limited data availability. However, tackling solutions of differential equations with rapid oscillations, steep gradients, or singular behavior becomes challenging for PINNs. Considering these challenges, we designed an efficient wavelet-based PINNs (W-PINNs) model to address this class of differential equations. Here, we represent the solution in wavelet space using a family of smooth-compactly supported wavelets. This framework represents the solution of a differential equation with significantly fewer degrees of freedom while still retaining the dynamics of complex physical phenomena. The architecture allows the training process to search for a solution within the wavelet space, making the process faster and more accurate. Further, the proposed model does not rely on automatic differentiations for derivatives involved in differential equations and does not require any prior information regarding the behavior of the solution, such as the location of abrupt features. Thus, through a strategic fusion of wavelets with PINNs, W-PINNs excel at capturing localized nonlinear information, making them well-suited for problems showing abrupt behavior in certain regions, such as singularly perturbed and multiscale problems. The efficiency and accuracy of the proposed neural network model are demonstrated in various 1D and 2D test problems, i.e., the FitzHugh-Nagumo (FHN) model, the Helmholtz equation, the Maxwell's equation, lid-driven cavity flow, and the Allen-Cahn equation, along with other highly singularly perturbed nonlinear differential equations. The proposed model significantly improves with traditional PINNs, recently developed wavelet-based PINNs, and other state-of-the-art methods.
LGDec 9, 2025
Wavelet-Accelerated Physics-Informed Quantum Neural Network for Multiscale Partial Differential EquationsDeepak Gupta, Himanshu Pandey, Ratikanta Behera
This work proposes a wavelet-based physics-informed quantum neural network framework to efficiently address multiscale partial differential equations that involve sharp gradients, stiffness, rapid local variations, and highly oscillatory behavior. Traditional physics-informed neural networks (PINNs) have demonstrated substantial potential in solving differential equations, and their quantum counterparts, quantum-PINNs, exhibit enhanced representational capacity with fewer trainable parameters. However, both approaches face notable challenges in accurately solving multiscale features. Furthermore, their reliance on automatic differentiation for constructing loss functions introduces considerable computational overhead, resulting in longer training times. To overcome these challenges, we developed a wavelet-accelerated physics-informed quantum neural network that eliminates the need for automatic differentiation, significantly reducing computational complexity. The proposed framework incorporates the multiresolution property of wavelets within the quantum neural network architecture, thereby enhancing the network's ability to effectively capture both local and global features of multiscale problems. Numerical experiments demonstrate that our proposed method achieves superior accuracy while requiring less than five percent of the trainable parameters compared to classical wavelet-based PINNs, resulting in faster convergence. Moreover, it offers a speedup of three to five times compared to existing quantum PINNs, highlighting the potential of the proposed approach for efficiently solving challenging multiscale and oscillatory problems.
NAMay 10, 2019
Further results on the Drazin inverse of even-order tensorsRatikanta Behera, Ashish Kumar Nandi, Jajati Keshari Sahoo
The notion of the Drazin inverse of an even-order tensor with the Einstein product was introduced, very recently [J. Ji and Y. Wei. Comput. Math. Appl., 75(9), (2018), pp. 3402-3413]. In this article, we further elaborate this theory by producing a few characterizations of the Drazin inverse and the W-weighted Drazin inverse of tensors. In addition to these, we compute the Drazin inverse of tensors using different types of generalized inverses and full rank decomposition of tensors. We also address the solution to the multilinear systems using the Drazin inverse and iterative (higher order Gauss-Seidel) method of tensors. Besides this, the convergence analysis of the iterative technique is also investigated within the framework of the Einstein product.
NAApr 4, 2019
Generalized Inverses of Boolean Tensors via Einstein ProductRatikanta Behera, Jajati Keshari Sahoo
Applications of the theory and computations of boolean matrices are of fundamental importance to study a variety of discrete structural models. But the increasing ability of data collection systems to store huge volumes of multidimensional data, the boolean matrix representation of data analysis is not enough to represent all the information content of the multiway data in different fields. From this perspective, it is appropriate to develop an infrastructure that supports reasoning about the theory and computations. In this paper, we discuss the generalized inverses of the Boolean tensors with the Einstein product. Further, we elaborate on this theory by producing a few characterizations of different generalized inverses and several equivalence results on boolean tensors. In addition to these, we define the rank of a boolean tensor through space decomposition.