CVJan 31, 2023
Hierarchical Disentangled Representation for Invertible Image Denoising and BeyondWenchao Du, Hu Chen, Yi Zhang et al.
Image denoising is a typical ill-posed problem due to complex degradation. Leading methods based on normalizing flows have tried to solve this problem with an invertible transformation instead of a deterministic mapping. However, the implicit bijective mapping is not explored well. Inspired by a latent observation that noise tends to appear in the high-frequency part of the image, we propose a fully invertible denoising method that injects the idea of disentangled learning into a general invertible neural network to split noise from the high-frequency part. More specifically, we decompose the noisy image into clean low-frequency and hybrid high-frequency parts with an invertible transformation and then disentangle case-specific noise and high-frequency components in the latent space. In this way, denoising is made tractable by inversely merging noiseless low and high-frequency parts. Furthermore, we construct a flexible hierarchical disentangling framework, which aims to decompose most of the low-frequency image information while disentangling noise from the high-frequency part in a coarse-to-fine manner. Extensive experiments on real image denoising, JPEG compressed artifact removal, and medical low-dose CT image restoration have demonstrated that the proposed method achieves competing performance on both quantitative metrics and visual quality, with significantly less computational cost.
LGNov 26, 2022
Looking at the posterior: accuracy and uncertainty of neural-network predictionsH. Linander, O. Balabanov, H. Yang et al.
Bayesian inference can quantify uncertainty in the predictions of neural networks using posterior distributions for model parameters and network output. By looking at these posterior distributions, one can separate the origin of uncertainty into aleatoric and epistemic contributions. One goal of uncertainty quantification is to inform on prediction accuracy. Here we show that prediction accuracy depends on both epistemic and aleatoric uncertainty in an intricate fashion that cannot be understood in terms of marginalized uncertainty distributions alone. How the accuracy relates to epistemic and aleatoric uncertainties depends not only on the model architecture, but also on the properties of the dataset. We discuss the significance of these results for active learning and introduce a novel acquisition function that outperforms common uncertainty-based methods. To arrive at our results, we approximated the posteriors using deep ensembles, for fully-connected, convolutional and attention-based neural networks.
NADec 21, 2014
A note on robust preconditioners for monolithic fluid-structure interaction systems of finite element equationsU. Langer, H. Yang
In this note, we consider preconditioned Krylov subspace methods for discrete fluid-structure interaction problems with a nonlinear hyperelastic material model and covering a large range of flows, e.g, water, blood, and air with highly varying density. Based on the complete $LDU$ factorization of the coupled system matrix, the preconditioner is constructed in form of $\hat{L}\hat{D}\hat{U}$, where $\hat{L}$, $\hat{D}$ and $\hat{U}$ are proper approximations to $L$, $D$ and $U$, respectively. The inverse of the corresponding Schur complement is approximated by applying one cycle of a special class of algebraic multigrid methods to the perturbed fluid sub-problem, that is obtained by modifying corresponding entries in the original fluid matrix with an explicitly constructed approximation of the exact perturbation coming from the sparse matrix-matrix multiplications.