NADec 20, 2017
A finite element method with strong mass conservation for Biot's linear consolidation modelBeatrice Riviere, Guido Kanschat
An H(div) conforming finite element method for solving the linear Biot equations is analyzed. Formulations for the standard mixed method are combined with formulation of interior penalty discontinuous Galerkin method to obtain a consistent scheme. Optimal convergence rates are obtained.
NAOct 11, 2016
A finite volume/discontinuous Galerkin method for the advective Cahn-Hilliard equation with degenerate mobility on porous domains stemming from micro-CT imagingFlorian Frank, Chen Liu, Faruk O. Alpak et al.
A numerical method is formulated for the solution of the advective Cahn-Hilliard (CH) equation with constant and degenerate mobility in three-dimensional porous media with non-vanishing velocity on the exterior boundary. The CH equation describes phase separation of an immiscible binary mixture at constant temperature in the presence of a mass constraint and dissipation of free energy. Porous media/pore-scale problems specifically entail high-resolution images of rocks in which the solid matrix and pore spaces are fully resolved. The interior penalty discontinuous Galerkin method is used for the spatial discretization of the CH equation in mixed form, while a semi-implicit convex-concave splitting is utilized for temporal discretization. The spatial approximation order is arbitrary, while it reduces to a finite volume scheme for the choice of elementwise constants. The resulting nonlinear systems of equations are reduced using the Schur complement and solved via Newton's method. The numerical scheme is first validated using numerical convergence tests and then applied to a number of fundamental problems for validation and numerical experimentation purposes including the case of degenerate mobility. First-order physical applicability and robustness of the numerical method are shown in a breakthrough scenario on a voxel set obtained from a micro-CT scan of a real sandstone rock sample.
FLU-DYNApr 17, 2016
Comparison of reduced models for blood flow using Runge-Kutta discontinuous Galerkin methodsCharles Puelz, Suncica Canic, Beatrice Riviere et al.
One-dimensional blood flow models take the general form of nonlinear hyperbolic systems but differ greatly in their formulation. One class of models considers the physically conserved quantities of mass and momentum, while another class describes mass and velocity. Further, the averaging process employed in the model derivation requires the specification of the axial velocity profile; this choice differentiates models within each class. Discrepancies among differing models have yet to be investigated. In this paper, we systematically compare several reduced models of blood flow for physiologically relevant vessel parameters, network topology, and boundary data. The models are discretized by a class of Runge-Kutta discontinuous Galerkin methods.
IVFeb 8, 2023
A Generalized Surface Loss for Reducing the Hausdorff Distance in Medical Imaging SegmentationAdrian Celaya, Beatrice Riviere, David Fuentes
Within medical imaging segmentation, the Dice coefficient and Hausdorff-based metrics are standard measures of success for deep learning models. However, modern loss functions for medical image segmentation often only consider the Dice coefficient or similar region-based metrics during training. As a result, segmentation architectures trained over such loss functions run the risk of achieving high accuracy for the Dice coefficient but low accuracy for Hausdorff-based metrics. Low accuracy on Hausdorff-based metrics can be problematic for applications such as tumor segmentation, where such benchmarks are crucial. For example, high Dice scores accompanied by significant Hausdorff errors could indicate that the predictions fail to detect small tumors. We propose the Generalized Surface Loss function, a novel loss function to minimize Hausdorff-based metrics with more desirable numerical properties than current methods and with weighting terms for class imbalance. Our loss function outperforms other losses when tested on the LiTS and BraTS datasets using the state-of-the-art nnUNet architecture. These results suggest we can improve medical imaging segmentation accuracy with our novel loss function.
IVApr 5, 2023
FMG-Net and W-Net: Multigrid Inspired Deep Learning Architectures For Medical Imaging SegmentationAdrian Celaya, Beatrice Riviere, David Fuentes
Accurate medical imaging segmentation is critical for precise and effective medical interventions. However, despite the success of convolutional neural networks (CNNs) in medical image segmentation, they still face challenges in handling fine-scale features and variations in image scales. These challenges are particularly evident in complex and challenging segmentation tasks, such as the BraTS multi-label brain tumor segmentation challenge. In this task, accurately segmenting the various tumor sub-components, which vary significantly in size and shape, remains a significant challenge, with even state-of-the-art methods producing substantial errors. Therefore, we propose two architectures, FMG-Net and W-Net, that incorporate the principles of geometric multigrid methods for solving linear systems of equations into CNNs to address these challenges. Our experiments on the BraTS 2020 dataset demonstrate that both FMG-Net and W-Net outperform the widely used U-Net architecture regarding tumor subcomponent segmentation accuracy and training efficiency. These findings highlight the potential of incorporating the principles of multigrid methods into CNNs to improve the accuracy and efficiency of medical imaging segmentation.
NANov 15, 2018
Numerical analysis of a discontinuous Galerkin method for Cahn-Hilliard-Navier-Stokes equationsChen Liu, Beatrice Riviere
In this paper, we derive a theoretical analysis of an interior penalty discontinuous Galerkin methods for solving the Cahn-Hilliard-Navier-Stokes model problem. We prove unconditional unique solvability of the discrete system, obtain unconditional discrete energy dissipation law, and derive stability bounds with a generalized chemical energy density. Convergence of the method is obtained by proving optimal a priori error estimates. Our analysis of the unique solvability is valid for both symmetric and non-symmetric versions of the discontinuous Galerkin formulation.
NAFeb 10, 2017
A priori error estimates of Adams-Bashforth discontinuous Galerkin methods for scalar nonlinear conservation lawsCharles Puelz, Beatrice Riviere
In this paper we show theoretical convergence of a second-order Adams-Bashforth discontinuous Galerkin method for approximating smooth solutions to scalar nonlinear conservation laws with E-fluxes. A priori error estimates are also derived for a first-order forward Euler discontinuous Galerkin method. Rates are optimal in time and suboptimal in space; they are valid under a CFL condition.
IVJul 31, 2024
MIST: A Simple and Scalable End-To-End 3D Medical Imaging Segmentation FrameworkAdrian Celaya, Evan Lim, Rachel Glenn et al.
Medical imaging segmentation is a highly active area of research, with deep learning-based methods achieving state-of-the-art results in several benchmarks. However, the lack of standardized tools for training, testing, and evaluating new methods makes the comparison of methods difficult. To address this, we introduce the Medical Imaging Segmentation Toolkit (MIST), a simple, modular, and end-to-end medical imaging segmentation framework designed to facilitate consistent training, testing, and evaluation of deep learning-based medical imaging segmentation methods. MIST standardizes data analysis, preprocessing, and evaluation pipelines, accommodating multiple architectures and loss functions. This standardization ensures reproducible and fair comparisons across different methods. We detail MIST's data format requirements, pipelines, and auxiliary features and demonstrate its efficacy using the BraTS Adult Glioma Post-Treatment Challenge dataset. Our results highlight MIST's ability to produce accurate segmentation masks and its scalability across multiple GPUs, showcasing its potential as a powerful tool for future medical imaging research and development.
LGNov 1, 2023
Solutions to Elliptic and Parabolic Problems via Finite Difference Based Unsupervised Small Linear Convolutional Neural NetworksAdrian Celaya, Keegan Kirk, David Fuentes et al.
In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods like PINNs rely on auto differentiation and sampling collocation points, leading to a lack of interpretability and lower accuracy than traditional numerical methods. As a result, we propose a fully unsupervised approach, requiring no training data, to estimate finite difference solutions for PDEs directly via small linear convolutional neural networks. Our proposed approach uses substantially fewer parameters than similar finite difference-based approaches while also demonstrating comparable accuracy to the true solution for several selected elliptic and parabolic problems compared to the finite difference method.
NAMar 19
Numerical Analysis of a Coupled 3D-1D Transport ProblemAlyssa Taylor-LaPole, Uzochi Gideon, Beatrice Riviere et al.
A finite element solution coupled with an interior penalty discontinuous Galerkin solution are defined for the approximation of the coupled 3D-1D solute transport problem. Under sufficient regularity for the weak solutions, optimal error bounds are derived for the 3D concentration and 1D concentration, that are optimal with respect to the time step size and the mesh sizes. Numerical results verify the theoretical results.
CVJul 25, 2025Code
Pre- and Post-Treatment Glioma Segmentation with the Medical Imaging Segmentation ToolkitAdrian Celaya, Tucker Netherton, Dawid Schellingerhout et al.
Medical image segmentation continues to advance rapidly, yet rigorous comparison between methods remains challenging due to a lack of standardized and customizable tooling. In this work, we present the current state of the Medical Imaging Segmentation Toolkit (MIST), with a particular focus on its flexible and modular postprocessing framework designed for the BraTS 2025 pre- and post-treatment glioma segmentation challenge. Since its debut in the 2024 BraTS adult glioma post-treatment segmentation challenge, MIST's postprocessing module has been significantly extended to support a wide range of transforms, including removal or replacement of small objects, extraction of the largest connected components, and morphological operations such as hole filling and closing. These transforms can be composed into user-defined strategies, enabling fine-grained control over the final segmentation output. We evaluate three such strategies - ranging from simple small-object removal to more complex, class-specific pipelines - and rank their performance using the BraTS ranking protocol. Our results highlight how MIST facilitates rapid experimentation and targeted refinement, ultimately producing high-quality segmentations for the BraTS 2025 challenge. MIST remains open source and extensible, supporting reproducible and scalable research in medical image segmentation.
NAApr 21
Proximal Discontinuous Galerkin Methods for Variational InequalitiesAlexandre Ern, Brendan Keith, Dohyun Kim et al.
We introduce a family of proximal discontinuous Galerkin methods for variational inequalities, focusing on the obstacle problem as a didactic example. Each member of this family is born from applying a different well-known nonconforming finite element discretization to the Bregman proximal point method. We explicitly treat four examples: the symmetric interior penalty discontinuous Galerkin, the enriched Galerkin, the hybridizable interior penalty and the hybrid high-order methods. We formulate a unified analysis framework for this family of methods and prove the existence and uniqueness of solutions, energy dissipation, and error estimates for both the primal and dual variables. Remarkably, the proximal hybrid high-order method with piecewise constant cell unknowns and piecewise affine cell unknowns leads to the first higher-order convergence result for any proximal Galerkin method.
CVFeb 24, 2025
A Priori Generalizability Estimate for a CNNCito Balsells, Beatrice Riviere, David Fuentes
We formulate truncated singular value decompositions of entire convolutional neural networks. We demonstrate the computed left and right singular vectors are useful in identifying which images the convolutional neural network is likely to perform poorly on. To create this diagnostic tool, we define two metrics: the Right Projection Ratio and the Left Projection Ratio. The Right (Left) Projection Ratio evaluates the fidelity of the projection of an image (label) onto the computed right (left) singular vectors. We observe that both ratios are able to identify the presence of class imbalance for an image classification problem. Additionally, the Right Projection Ratio, which only requires unlabeled data, is found to be correlated to the model's performance when applied to image segmentation. This suggests the Right Projection Ratio could be a useful metric to estimate how likely the model is to perform well on a sample.
LGFeb 12, 2025
Learning Discontinuous Galerkin Solutions to Elliptic Problems via Small Linear Convolutional Neural NetworksAdrian Celaya, Yimo Wang, David Fuentes et al.
In recent years, there has been an increasing interest in using deep learning and neural networks to tackle scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods, such as physics-informed neural networks, depend on automatic differentiation and the sampling of collocation points, which can result in a lack of interpretability and lower accuracy compared to traditional numerical methods. To address this issue, we propose two approaches for learning discontinuous Galerkin solutions to PDEs using small linear convolutional neural networks. Our first approach is supervised and depends on labeled data, while our second approach is unsupervised and does not rely on any training data. In both cases, our methods use substantially fewer parameters than similar numerics-based neural networks while also demonstrating comparable accuracy to the true and DG solutions for elliptic problems.
LGJan 13, 2025
Adaptive Collocation Point Strategies For Physics Informed Neural Networks via the QR Discrete Empirical Interpolation MethodAdrian Celaya, David Fuentes, Beatrice Riviere
Physics-informed neural networks (PINNs) have gained significant attention for solving forward and inverse problems related to partial differential equations (PDEs). While advancements in loss functions and network architectures have improved PINN accuracy, the impact of collocation point sampling on their performance remains underexplored. Fixed sampling methods, such as uniform random sampling and equispaced grids, can fail to capture critical regions with high solution gradients, limiting their effectiveness for complex PDEs. Adaptive methods, inspired by adaptive mesh refinement from traditional numerical methods, address this by dynamically updating collocation points during training but may overlook residual dynamics between updates, potentially losing valuable information. To overcome this limitation, we propose two adaptive collocation point selection strategies utilizing the QR Discrete Empirical Interpolation Method (QR-DEIM), a reduced-order modeling technique for efficiently approximating nonlinear functions. Our results on benchmark PDEs demonstrate that our QR-DEIM-based approaches improve PINN accuracy compared to existing methods, offering a promising direction for adaptive collocation point strategies.
IVApr 21, 2021
PocketNet: A Smaller Neural Network for Medical Image AnalysisAdrian Celaya, Jonas A. Actor, Rajarajeswari Muthusivarajan et al.
Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by throttling the growth of the number of channels in convolutional neural networks. We demonstrate that, for a range of segmentation and classification tasks, PocketNet architectures produce results comparable to that of conventional neural networks while reducing the number of parameters by multiple orders of magnitude, using up to 90% less GPU memory, and speeding up training times by up to 40%, thereby allowing such models to be trained and deployed in resource-constrained settings.