CLSep 5, 2023
Bring the Noise: Introducing Noise Robustness to Pretrained Automatic Speech RecognitionPatrick Eickhoff, Matthias Möller, Theresa Pekarek Rosin et al.
In recent research, in the domain of speech processing, large End-to-End (E2E) systems for Automatic Speech Recognition (ASR) have reported state-of-the-art performance on various benchmarks. These systems intrinsically learn how to handle and remove noise conditions from speech. Previous research has shown, that it is possible to extract the denoising capabilities of these models into a preprocessor network, which can be used as a frontend for downstream ASR models. However, the proposed methods were limited to specific fully convolutional architectures. In this work, we propose a novel method to extract the denoising capabilities, that can be applied to any encoder-decoder architecture. We propose the Cleancoder preprocessor architecture that extracts hidden activations from the Conformer ASR model and feeds them to a decoder to predict denoised spectrograms. We train our pre-processor on the Noisy Speech Database (NSD) to reconstruct denoised spectrograms from noisy inputs. Then, we evaluate our model as a frontend to a pretrained Conformer ASR model as well as a frontend to train smaller Conformer ASR models from scratch. We show that the Cleancoder is able to filter noise from speech and that it improves the total Word Error Rate (WER) of the downstream model in noisy conditions for both applications.
51.5NAApr 14
Deflation-based preconditioning for immersed finite element methods and immersogeometric analysisYannis Voet, Matthias Möller, Pablo Antolin et al.
Trimming is a ubiquitous operation in computer-aided-design whereby parts of a geometry are merged, intersected, or simply discarded. While it grants virtually unlimited flexibility in geometric design, it introduces a plethora of other difficulties when such geometries are used within immersed finite element methods. In particular, small cut elements lead to severely ill-conditioned system matrices requiring dedicated penalization, stabilization, or preconditioning techniques. In this work, we highlight the limitations of existing preconditioning strategies by first carefully examining the condition number of the diagonally scaled matrix and later providing realistic counter-examples for some well-established preconditioning strategies. Building on those insights, we propose a robust deflation-based preconditioning technique tailored to immersed finite element methods.
61.1NAApr 30
Parameterization-driven arbitrary Lagrangian-Eulerian method for large-deformation isogeometric fluid-structure interactionJingya Li, Ye Ji, Hugo Verhelst et al.
Body-fitted arbitrary Lagrangian-Eulerian (ALE) methods provide a sharp representation of the fluid-structure interface but rely on mesh-update strategies that incrementally deform a reference configuration. To address this issue, we reformulate the ALE mesh-motion problem in the isogeometric setting as a sequence of independent domain parameterization problems. At each time step, a multi-patch spline parameterization of the fluid domain is constructed from the current interface geometry. Three technical components realize this framework: (i) a barrier-function-based spline parameterization that enforces a strictly positive Jacobian at every time step; (ii) a tangential-slip reparameterization that handles unbounded cumulative rotations of closed domains, where no fixed boundary-to-parameter correspondence is admissible; and (iii) a constant-preserving quasi-interpolation operator for solution transfer between consecutive parameterizations, ensuring that the discrete geometric conservation law holds algebraically. We validate the method on three two-dimensional FSI benchmarks, covering standard and large-rotation regimes, and on a three-dimensional rotor problem. On a rotating-square benchmark, the tangential-slip strategy enables simulations under sustained rotation far beyond the range accessible to classical mesh-update schemes--a regime that is fundamentally inaccessible to any mesh-deformation formulation, not merely numerically difficult. A three-dimensional rotor example further demonstrates that the framework extends naturally to volumetric spline parameterizations. Finally, we show that the per-step spline parameterizations can be used directly within a standard finite element solver.
QUANT-PHJul 16, 2025
Surrogate Quantum Circuit Design for the Lattice Boltzmann Collision OperatorMonica Lăcătuş, Matthias Möller
This study introduces a framework for learning a low-depth surrogate quantum circuit (SQC) that approximates the nonlinear, dissipative, and hence non-unitary Bhatnagar-Gross-Krook (BGK) collision operator in the lattice Boltzmann method (LBM) for the D2Q9 lattice. By appropriately selecting the quantum state encoding, circuit architecture, and measurement protocol, non-unitary dynamics emerge naturally within the physical population space. This approach removes the need for probabilistic algorithms relying on any ancilla qubits and post-selection to reproduce dissipation, or for multiple state copies to capture nonlinearity. The SQC is designed to preserve key physical properties of the BGK operator, including mass conservation, scale equivariance, and D8 equivariance, while momentum conservation is encouraged through penalization in the training loss. When compiled to the IBM Heron quantum processor's native gate set, assuming all-to-all qubit connectivity, the circuit requires only 724 native gates and operates locally on the velocity register, making it independent of the lattice size. The learned SQC is validated on two benchmark cases, the Taylor-Green vortex decay and the lid-driven cavity, showing accurate reproduction of vortex decay and flow recirculation. While integration of the SQC into a quantum LBM framework presently requires measurement and re-initialization at each timestep, the necessary steps towards a measurement-free formulation are outlined.
CEMay 5, 2024
Predicting Open-Hole Laminates Failure Using Support Vector Machines With Classical and Quantum KernelsGiorgio Tosti Balducci, Boyang Chen, Matthias Möller et al.
Modeling open hole failure of composites is a complex task, consisting in a highly nonlinear response with interacting failure modes. Numerical modeling of this phenomenon has traditionally been based on the finite element method, but requires to tradeoff between high fidelity and computational cost. To mitigate this shortcoming, recent work has leveraged machine learning to predict the strength of open hole composite specimens. Here, we also propose using data-based models but to tackle open hole composite failure from a classification point of view. More specifically, we show how to train surrogate models to learn the ultimate failure envelope of an open hole composite plate under in-plane loading. To achieve this, we solve the classification problem via support vector machine (SVM) and test different classifiers by changing the SVM kernel function. The flexibility of kernel-based SVM also allows us to integrate the recently developed quantum kernels in our algorithm and compare them with the standard radial basis function (RBF) kernel. Finally, thanks to kernel-target alignment optimization, we tune the free parameters of all kernels to best separate safe and failure-inducing loading states. The results show classification accuracies higher than 90% for RBF, especially after alignment, followed closely by the quantum kernel classifiers.
AIMar 11, 2025
Neurosymbolic Decision TreesMatthias Möller, Arvid Norlander, Pedro Zuidberg Dos Martires et al.
Neurosymbolic (NeSy) AI studies the integration of neural networks (NNs) and symbolic reasoning based on logic. Usually, NeSy techniques focus on learning the neural, probabilistic and/or fuzzy parameters of NeSy models. Learning the symbolic or logical structure of such models has, so far, received less attention. We introduce neurosymbolic decision trees (NDTs), as an extension of decision trees together with a novel NeSy structure learning algorithm, which we dub NeuID3. NeuID3 adapts the standard top-down induction of decision tree algorithms and combines it with a neural probabilistic logic representation, inherited from the DeepProbLog family of models. The key advantage of learning NDTs with NeuID3 is the support of both symbolic and subsymbolic data (such as images), and that they can exploit background knowledge during the induction of the tree structure, In our experimental evaluation we demonstrate the benefits of NeSys structure learning over more traditonal approaches such as purely data-driven learning with neural networks.
NASep 28, 2018
High-Order Isogeometric Methods for Compressible Flows. II. Compressible Euler EquationsMatthias Möller, Andrzej Jaeschke
This work extends the high-resolution isogeometric analysis approach established for scalar transport equations to the equations of gas dynamics. The group finite element formulation is adopted to obtain an efficient assembly procedure for the standard Galerkin approximation, which is stabilized by adding artificial viscosities proportional to the spectral radius of the Roe-averaged flux-Jacobian matrix. Excess stabilization is removed in regions with smooth flow profiles with the aid of algebraic flux correction \cite{KBNII}. The underlying principles are reviewed and it is shown that linearized FCT-type flux limiting \cite{Kuzmin2009} originally derived for nodal low-order finite elements ensures positivity-preservation for high-order B-Spline discretizations.
NASep 28, 2018
High-Order Isogeometric Methods for Compressible Flows. I. Scalar Conservation LawsAndrzej Jaeschke, Matthias Möller
Isogeometric analysis was applied very successfully to many problem classes like linear elasticity, heat transfer and incompressible flow problems but its application to compressible flows is very rare. However, its ability to accurately represent complex geometries used in industrial applications makes IGA a suitable tool for the analysis of compressible flow problems that require the accurate resolution of boundary layers. The convection-diffusion solver presented in this chapter, is an indispensable step on the way to developing a compressible flow solver for complex viscous industrial flows. It is well known that the standard Galerkin finite element method and its isogeometric counterpart suffer from spurious oscillatory behaviour in the presence of shocks and steep solution gradients. As a remedy, the algebraic flux correction paradigm is generalized to B-Spline basis functions to suppress the creation of oscillations and occurrence of non-physical values in the solution. This work provides early results for scalar conservation laws and lays the foundation for extending this approach to the compressible Euler equations.
CEJun 19, 2017
On the impact of quantum computing technology on future developments in high-performance scientific computingMatthias Möller, Cornelis Vuik
Quantum computing technologies have become a hot topic in academia and industry receiving much attention and financial support from all sides. Building a quantum computer that can be used practically is in itself an outstanding challenge that has become the 'new race to the moon'. Next to researchers and vendors of future computing technologies, national authorities are showing strong interest in maturing this technology due to its known potential to break many of today's encryption techniques, which would have significant impact on our society. It is however quite likely that quantum computing has beneficial impact on many computational disciplines. In this article we describe our vision of future developments in scientific computing that would be enabled by the advent of software-programmable quantum computers. We thereby assume that quantum computers will form part of a hybrid accelerated computing platform like GPUs and co-processor cards do today. In particular, we address the potential of quantum algorithms to bring major breakthroughs in applied mathematics and its applications. Finally, we give several examples that demonstrate the possible impact of quantum-accelerated scientific computing on society.