Yalchin Efendiev

Eric Chung, Yalchin Efendiev, Thomas Y. Hou

In this paper, we discuss a general multiscale model reduction framework based on multiscale finite element methods. We give a brief overview of related multiscale methods. Due to page limitations, the overview focuses on a few related methods and is not intended to be comprehensive. We present a general adaptive multiscale model reduction framework, the Generalized Multiscale Finite Element Method. Besides the method's basic outline, we discuss some important ingredients needed for the method's success. We also discuss several applications. The proposed method allows performing local model reduction in the presence of high contrast and no scale separation.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

The main goal of this paper is to design multiscale basis functions within GMsFEM framework such that the convergence of method is independent of the contrast and linearly decreases with respect to mesh size if oversampling size is appropriately chosen. We would like to show a mesh-dependent convergence with a minimal number of basis functions. Our construction starts with an auxiliary multiscale space by solving local spectral problems. In auxiliary multiscale space, we select the basis functions that correspond to small (contrast-dependent) eigenvalues. These basis functions represent the channels (high-contrast features that connect the boundaries of the coarse block). Using the auxiliary space, we propose a constraint energy minimization to construct multiscale spaces. The minimization is performed in the oversampling domain, which is larger than the target coarse block. The constraints allow handling non-decaying components of the local minimizers. If the auxiliary space is correctly chosen, we show that the convergence rate is independent of the contrast (because the basis representing the channels are included in the auxiliary space) and is proportional to the coarse-mesh size (because the constrains handle non-decaying components of the local minimizers). The oversampling size weakly depends on the contrast as our analysis shows. The convergence theorem requires that channels are not aligned with the coarse edges, which hold in many applications, where the channels are oblique with respect to the coarse-mesh geometry. The numerical results confirm our theoretical results. In particular, we show that if the oversampling domain size is not sufficiently large, the errors are large. To remove the contrast-dependence of the oversampling size, we propose a modified construction for basis functions and present numerical results and the analysis.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

The construction of local reduced-order models via multiscale basis functions has been an area of active research. In this paper, we propose online multiscale basis functions which are constructed using the offline space and the current residual. Online multiscale basis functions are constructed adaptively in some selected regions based on our error indicators. We derive an error estimator which shows that one needs to have an offline space with certain properties to guarantee that additional online multiscale basis function will decrease the error. This error decrease is independent of physical parameters, such as the contrast and multiple scales in the problem. The offline spaces are constructed using Generalized Multiscale Finite Element Methods (GMsFEM). We show that if one chooses a sufficient number of offline basis functions, one can guarantee that additional online multiscale basis functions will reduce the error independent of contrast. We note that the construction of online basis functions is motivated by the fact that the offline space construction does not take into account distant effects. Using the residual information, we can incorporate the distant information provided the offline approximation satisfies certain properties. In the paper, theoretical and numerical results are presented. Our numerical results show that if the offline space is sufficiently large (in terms of the dimension) such that the coarse space contains all multiscale spectral basis functions that correspond to small eigenvalues, then the error reduction by adding online multiscale basis function is independent of the contrast. We discuss various ways computing online multiscale basis functions which include a use of small dimensional offline spaces.

Eric T. Chung, Yalchin Efendiev, Guanglian Li et al.

Complex processes in perforated domains occur in many real-world applications. These problems are typically characterized by physical processes in domains with multiple scales (see Figure 1 for the illustration of a perforated domain). Moreover, these problems are intrinsically multiscale and their discretizations can yield very large linear or nonlinear systems. In this paper, we investigate multiscale approaches that attempt to solve such problems on a coarse grid by constructing multiscale basis functions in each coarse grid, where the coarse grid can contain many perforations. In particular, we are interested in cases when there is no scale separation and the perforations can have different sizes. In this regard, we mention some earlier pioneering works [14, 18, 17], where the authors develop multiscale finite element methods. In our paper, we follow Generalized Multiscale Finite Element Method (GMsFEM) and develop a multiscale procedure where we identify multiscale basis functions in each coarse block using snapshot space and local spectral problems. We show that with a few basis functions in each coarse block, one can accurately approximate the solution, where each coarse block can contain many small inclusions. We apply our general concept to (1) Laplace equation in perforated domain; (2) elasticity equation in perforated domain; and (3) Stokes equations in perforated domain. Numerical results are presented for these problems using two types of heterogeneous perforated domains. The analysis of the proposed methods will be presented elsewhere.

Eric T. Chung, Yalchin Efendiev, Shubin Fu

In this paper, we discuss the application of Generalized Multiscale Finite Element Method (GMsFEM) to elasticity equation in heterogeneous media. Our applications are motivated by elastic wave propagation in subsurface where the subsurface properties can be highly heterogeneous and have high contrast. We present the construction of main ingredients for GMsFEM such as the snapshot space and offline spaces. The latter is constructed using local spectral decomposition in the snapshot space. The spectral decomposition is based on the analysis which is provided in the paper. We consider both continuous Galerkin and discontinuous Galerkin coupling of basis functions. Both approaches have their cons and pros. Continuous Galerkin methods allow avoiding penalty parameters though they involve partition of unity functions which can alter the properties of multiscale basis functions. On the other hand, discontinuous Galerkin techniques allow gluing multiscale basis functions without any modifications. Because basis functions are constructed independently from each other, this approach provides an advantage. We discuss the use of oversampling techniques that use snapshots in larger regions to construct the offline space. We provide numerical results to show that one can accurately approximate the solution using reduced number of degrees of freedom.

Yalchin Efendiev, Seong Lee, Guanglian Li et al.

In this paper, we develop a multiscale finite element method for solving flows in fractured media. Our approach is based on Generalized Multiscale Finite Element Method (GMsFEM), where we represent the fracture effects on a coarse grid via multiscale basis functions. These multiscale basis functions are constructed in the offline stage via local spectral problems following GMsFEM. To represent the fractures on the fine grid, we consider two approaches (1) Discrete Fracture Model (DFM) (2) Embedded Fracture Model (EFM) and their combination. In DFM, the fractures are resolved via the fine grid, while in EFM the fracture and the fine grid block interaction is represented as a source term. In the proposed multiscale method, additional multiscale basis functions are used to represent the long fractures, while short-size fractures are collectively represented by a single basis functions. The procedure is automatically done via local spectral problems. In this regard, our approach shares common concepts with several approaches proposed in the literature as we discuss. Numerical results are presented where we demonstrate how one can adaptively add basis functions in the regions of interest based on error indicators. We also discuss the use of randomized snapshots (\cite{randomized2014}) which reduces the offline computational cost.

Eric T. Chung, Yalchin Efendiev, Tat Leung et al.

Simulating complex processes in fractured media requires some type of model reduction. Well-known approaches include multi-continuum techniques, which have been commonly used in approximating subgrid effects for flow and transport in fractured media. Our goal in this paper is to (1) show a relation between multi-continuum approaches and Generalized Multiscale Finite Element Method (GMsFEM) and (2) to discuss coupling these approaches for solving problems in complex multiscale fractured media. The GMsFEM, a systematic approach, constructs multiscale basis functions via local spectral decomposition in pre-computed snapshot spaces. We show that GMsFEM can automatically identify separate fracture networks via local spectral problems. We discuss the relation between these basis functions and continuums in multi-continuum methods. The GMsFEM can automatically detect each continuum and represent the interaction between the continuum and its surrounding (matrix). For problems with simplified fracture networks, we propose a simplified basis construction with the GMsFEM. This simplified approach is effective when the fracture networks are known and have simplified geometries. We show that this approach can achieve a similar result compared to the results using the GMsFEM with spectral basis functions. Further, we discuss the coupling between the GMsFEM and multi-continuum approaches. In this case, many fractures are resolved while for unresolved fractures, we use a multi-continuum approach with local Representative Volume Element (RVE) information. As a result, the method deals with a system of equations on a coarse grid, where each equation represents one of the continua on the fine grid. We present various basis construction mechanisms and numerical results.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung et al.

In this paper, we develop and analyze an adaptive multiscale approach for heterogeneous problems in perforated domains. In many applications, these problems have a multiscale nature arising because of the perforations, their geometries, the sizes of the perforations, and configurations. In this paper, we present a general offline/online procedure, which can adequately and adaptively represent the local degrees of freedom and derive appropriate coarse-grid equations. The main contributions of this paper are (1) the rigorous analysis of the offline approach (2) the development of the online procedures and their analysis (3) the development of adaptive strategies. We present an online procedure, which allows adaptively incorporating global information and is important for a fast convergence when combined with the adaptivity. Our methodology allows adding and guides constructing new online multiscale basis functions adaptively in appropriate regions. We present the convergence analysis of the online adaptive enrichment algorithm for the Stokes system. In particular, we show that the online procedure has a rapid convergence with a rate related to the number of offline basis functions, and one can obtain fast convergence by a sufficient number of offline basis functions, which are computed in the offline stage. To illustrate the performance of our method, we present numerical results with both small and large perforations. We see that only a few (1 or 2) online iterations can significantly improve the offline solution.

Eric Chung, Yalchin Efendiev, Wing Tat Leung

This paper presents a novel mass-conservative mixed multiscale method for solving flow equations in heterogeneous porous media. The media properties (the permeability) contain multiple scales and high contrast. The proposed method solves the flow equation in a mixed formulation on a coarse grid by constructing multiscale basis functions. The resulting velocity field is mass conservative on the fine grid. Our main goal is to obtain first-order convergence in terms of the mesh size which is independent of local contrast. This is achieved, first, by constructing some auxiliary spaces, which contain global information that can not be localized, in general. This is built on our previous work on the Generalized Multiscale Finite Element Method (GMsFEM). In the auxiliary space, multiscale basis functions corresponding to small (contrast-dependent) eigenvalues are selected. These basis functions represent the high-conductivity channels (which connect the boundaries of a coarse block). Next, we solve local problems to construct multiscale basis functions for the velocity field. These local problems are formulated in the oversampled domain taking into account some constraints with respect to auxiliary spaces. The latter allows fast spatial decay of local solutions and, thus, allows taking smaller oversampled regions. The number of basis functions depends on small eigenvalues of the local spectral problems. Moreover, multiscale pressure basis functions are needed in constructing the velocity space. Our multiscale spaces have a minimal dimension, which is needed to avoid contrast-dependence in the convergence. The method's convergence requires an oversampling of several layers. We present an analysis of our approach. Our numerical results confirm that the convergence rate is first order with respect to the mesh size and independent of the contrast.

Siu Wun Cheung, Eric T. Chung, Yalchin Efendiev et al.

The dual continuum model serves as a powerful tool in the modeling of subsurface applications. It allows a systematic coupling of various components of the solutions. The system is of multiscale nature as it involves high heterogeneous and high contrast coefficients. To numerically compute the solutions, some types of reduced order methods are necessary. We will develop and analyze a novel multiscale method based on the recent advances in multiscale finite element methods. Our method will compute multiple local multiscale basis functions per coarse region. The idea is based on some local spectral problems, which are important to identify high contrast channels, and an energy minimization principle. Using these concepts, we show that the basis functions are localized, even in the presence of high contrast long channels and fractures. In addition, we show that the convergence of the method depends only on the coarse mesh size. Finally, we present several numerical tests to show the performance.

Mohammed Al Kobaisi, Dmitry Ammosov, Yalchin Efendiev et al.

We develop a multicontinuum Generalized Multiscale Finite Element Method (MC-GMsFEM) for constructing coarse-scale models in heterogeneous media that simultaneously provide accurate numerical approximations and physically consistent macroscopic equations. Classical multiscale methods efficiently approximate fine-scale solutions on coarse grids using localized basis functions, but they do not offer a systematic pathway for deriving macroscopic governing equations. To overcome this limitation, we introduce a unified framework that integrates multiscale finite element constructions with multicontinuum representations. The proposed method builds on the structure of GMsFEM and exploits a representation of multiscale basis functions that separates coarse variables and their gradients. We construct continuum-dependent basis functions using auxiliary fields defined through local problems with integral constraints, ensuring that each basis function is associated with a specific continuum. This leads to a decomposition of the coarse-scale solution into continuum variables and their gradients, establishing a direct connection between multiscale discretizations and multicontinuum homogenization. Compared to existing multicontinuum approaches, the proposed framework provides greater flexibility in handling heterogeneous media with spatially varying numbers of continua and is naturally embedded within a standard finite element setting. This enables both systematic derivation of macroscopic equations and straightforward numerical implementation. We apply the proposed method to the upscaling of two-phase immiscible flow in heterogeneous porous media, where multiple interacting continua, including mobile and trapped phases, arise. With the proposed approaches, we derive new macroscopic models and show that if classical models are used, the errors can be large.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung et al.

In this paper, we consider local multiscale model reduction for problems with multiple scales in space and time. We developed our approaches within the framework of the Generalized Multiscale Finite Element Method (GMsFEM) using space-time coarse cells. The main idea of GMsFEM is to construct a local snapshot space and a local spectral decomposition in the snapshot space. Previous research in developing multiscale spaces within GMsFEM focused on constructing multiscale spaces and relevant ingredients in space only. In this paper, our main objective is to develop a multiscale model reduction framework within GMsFEM that uses space-time coarse cells. We construct space-time snapshot and offline spaces. We compute these snapshot solutions by solving local problems. A complete snapshot space will use all possible boundary conditions; however, this can be very expensive. We propose using randomized boundary conditions and oversampling. We construct the local spectral decomposition based on our analysis, as presented in the paper. We present numerical results to confirm our theoretical findings and to show that using our proposed approaches, we can obtain an accurate solution with low dimensional coarse spaces. We remark that the proposed method is a significant extension compared to existing methods, which use coarse cells in space only because of (1) the parabolic nature of cell solutions, (2) extra degrees of freedom associated with space-time cells, and (3) local boundary conditions in space-time cells.

Yalchin Efendiev, Cornelia Kronsbein, Frederic Legoll

In this article, we study the application of Multi-Level Monte Carlo (MLMC) approaches to numerical random homogenization. Our objective is to compute the expectation of some functionals of the homogenized coefficients, or of the homogenized solutions. This is accomplished within MLMC by considering different levels of representative volumes (RVE), and, when it comes to homogenized solutions, different levels of coarse-grid meshes. Many inexpensive computations with the smallest RVE size and the largest coarse mesh are combined with fewer expensive computations performed on larger RVEs and smaller coarse meshes. We show that, by carefully selecting the number of realizations at each level, we can achieve a speed-up in the computations in comparison to a standard Monte Carlo method. Numerical results are presented both for one-dimensional and two-dimensional test-cases.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

In this paper, we develop an adaptive Generalized Multiscale Discontinuous Galerkin Method (GMs-DGM) for a class of high-contrast flow problems, and derive a-priori and a-posteriori error estimates for the method. Based on the a-posteriori error estimator, we develop an adaptive enrichment algorithm for our GMsDGM and prove its convergence. The adaptive enrichment algorithm gives an automatic way to enrich the approximation space in regions where the solution requires more basis functions, which are shown to perform well compared with a uniform enrichment. We also discuss an approach that adaptively selects multiscale basis functions by correlating the residual to multiscale basis functions (cf. [4]). The proposed error indicators are L2-based and can be inexpensively computed which makes our approach efficient. Numerical results are presented that demonstrate the robustness of the proposed error indicators.

Min Wang, Siu Wun Cheung, Eric T. Chung et al.

In this paper, we propose a deep-learning-based approach to a class of multiscale problems. THe Generalized Multiscale Finite Element Method (GMsFEM) has been proven successful as a model reduction technique of flow problems in heterogeneous and high-contrast porous media. The key ingredients of GMsFEM include mutlsicale basis functions and coarse-scale parameters, which are obtained from solving local problems in each coarse neighborhood. Given a fixed medium, these quantities are precomputed by solving local problems in an offline stage, and result in a reduced-order model. However, these quantities have to be re-computed in case of varying media. The objective of our work is to make use of deep learning techniques to mimic the nonlinear relation between the permeability field and the GMsFEM discretizations, and use neural networks to perform fast computation of GMsFEM ingredients repeatedly for a class of media. We provide numerical experiments to investigate the predictive power of neural networks and the usefulness of the resultant multiscale model in solving channelized porous media flow problems.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung et al.

We propose a generalized multiscale finite element method (GMsFEM) based on clustering algorithm to study the elliptic PDEs with random coefficients in the multi-query setting. Our method consists of offline and online stages. In the offline stage, we construct a small number of reduced basis functions within each coarse grid block, which can then be used to approximate the multiscale finite element basis functions. In addition, we coarsen the corresponding random space through a clustering algorithm. In the online stage, we can obtain the multiscale finite element basis very efficiently on a coarse grid by using the pre-computed multiscale basis. The new GMsFEM can be applied to multiscale SPDE starting with a relatively coarse grid, without requiring the coarsest grid to resolve the smallest-scale of the solution. The new method offers considerable savings in solving multiscale SPDEs. Numerical results are presented to demonstrate the accuracy and efficiency of the proposed method for several multiscale stochastic problems without scale separation.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

We present a new stabilization technique for multiscale convection diffusion problems. Stabilization for these problems has been a challenging task, especially for the case with high Peclet numbers. Our method is based on a constraint energy minimization idea and the discontinuous Petrov-Galerkin formulation. In particular, the test functions are constructed by minimizing an appropriate energy subject to certain orthogonality conditions, and are related to the trial space. The resulting test functions have a localization property, and can therefore be computed locally. We will prove the stability, and present several numerical results. Our numerical results confirm that our test space gives a good stability, in the sense that the solution error is close to the best approximation error.

Mehdi Ghommem, Michael Presho, Victor M. Calo et al.

In this paper, we combine concepts of the generalized multiscale finite element method and mode decomposition methods to construct a robust local-global approach for model reduction of flows in high-contrast porous media. This is achieved by implementing proper orthogonal decomposition (POD) and dynamic mode decomposition (DMD) techniques on a coarse grid. The resulting reduced-order approach enables a significant reduction in the flow problem size while accurately capturing the behavior of fully resolved solutions. We consider a variety of high-contrast coefficients and present the corresponding numerical results to illustrate the effectiveness of the proposed technique. This paper is a continuation of the first part where we examine the applicability of POD and DMD to derive simplified and reliable representations of flows in high-contrast porous media. In the current paper, we discuss how these global model reduction approaches can be combined with local techniques to speed-up the simulations. The speed-up is due to inexpensive, while sufficiently accurate, computations of global snapshots.

Eugenio Aulisa, Lidia Bloshanskaya, Yalchin Efendiev et al.

In this work we propose upscaling method for nonlinear Forchheimer flow in highly heterogeneous porous media. The generalized Forchheimer law is considered for incompressible and slightly-compressible single-phase flows. We use recently developed analytical results Aulisa et al. (2009) and write the resulting system in terms of a degenerate nonlinear flow equation for the pressure with the nonlinearity that depends on the pressure gradient. The coarse scale parameters for the steady state problem are determined so that the volumetric average of velocity of the flow in the domain on fine scale and on coarse scale are close enough. A flow-based coarsening approach is used, where the equivalent permeability tensor is first evaluated following the streamline of the existing linear cases, and successively modified in order to take into account the nonlinear effects. Compared to previous works Durlofsky and Karimi-Fard (2009) and Peszynska et al. (2009), our approach relies on recent analytical results of Aulisa et al. (2009) and combines it with rigorous mathematical upscaling theory for monotone operators. The developed upscaling algorithm for nonlinear steady state problems is effectively used for variety of heterogeneities in the domain of computation. Direct numerical computations for average velocity and productivity index justify the usage of the coarse scale parameters obtained for the special steady state case in the fully transient problem. Analytical upscaling formulas in stratified domain are obtained for the nonlinear case. They correlate with high accuracy with numerical results.

Eric T. Chung, Yalchin Efendiev, Yanbo Li

In this paper, we propose a space-time GMsFEM for transport equations. Multiscale transport equations occur in many geoscientific applications, which include subsurface transport, atmospheric pollution transport, and so on. Most of existing multiscale approaches use spatial multiscale basis functions or upscaling, and there are very few works that design space-time multiscale functions to solve the transport equation on a coarse grid. For the time dependent problems, the use of space-time multiscale basis functions offers several advantages as the spatial and temporal scales are intrinsically coupled. By using the GMsFEM idea with a space-time framework, one obtains a better dimension reduction taking into account features of the solutions in both space and time. In addition, the time-stepping can be performed using much coarser time step sizes compared to the case when spatial multiscale basis are used. Our scheme is based on space-time snapshot spaces and model reduction using space-time spectral problems derived from the analysis. We give the analysis for the well-posedness and the spectral convergence of our method. We also present some numerical examples to demonstrate the performance of the method. In all examples, we observe a good accuracy with a few basis functions.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung et al.

Numerical homogenization and multiscale finite element methods construct effective properties on a coarse grid by solving local problems and extracting the average effective properties from these local solutions. In some cases, the solutions of local problems can be expensive to compute due to scale disparity. In this setting, one can basically apply a homogenization or multiscale method re-iteratively to solve for the local problems. This process is known as re-iterated homogenization and has many variations in the numerical context. Though the process seems to be a straightforward extension of two-level process, it requires some careful implementation and the concept development for problems without scale separation and high contrast. In this paper, we consider the Generalized Multiscale Finite Element Method (GMsFEM) and apply it iteratively to construct its multiscale basis functions. The main idea of the GMsFEM is to construct snapshot functions and then extract multiscale basis functions (called offline space) using local spectral decompositions in the snapshot spaces. The extension of this construction to several levels uses snapshots and offline spaces interchangebly to achieve this goal. At each coarse-grid scale, we assume that the offline space is a good approximation of the solution and use all possible offline functions or randomization as boundary conditions and solve the local problems in the offline space at the previous (finer) level, to construct snapshot space. We present an adaptivity strategy and show numerical results for flows in heterogeneous media and in perforated domains.

Eric Chung, Yalchin Efendiev, Wing Tat Leung et al.

In this work, we propose a multi-agent actor-critic reinforcement learning (RL) algorithm to accelerate the multi-level Monte Carlo Markov Chain (MCMC) sampling algorithms. The policies (actors) of the agents are used to generate the proposal in the MCMC steps; and the critic, which is centralized, is in charge of estimating the long term reward. We verify our proposed algorithm by solving an inverse problem with multiple scales. There are several difficulties in the implementation of this problem by using traditional MCMC sampling. Firstly, the computation of the posterior distribution involves evaluating the forward solver, which is very time consuming for a problem with heterogeneous. We hence propose to use the multi-level algorithm. More precisely, we use the generalized multiscale finite element method (GMsFEM) as the forward solver in evaluating a posterior distribution in the multi-level rejection procedure. Secondly, it is hard to find a function which can generate samplings which are meaningful. To solve this issue, we learn an RL policy as the proposal generator. Our experiments show that the proposed method significantly improves the sampling process

Eric Chung, Yalchin Efendiev, Yanbo Li et al.

The Boltzmann equation, as a model equation in statistical mechanics, is used to describe the statistical behavior of a large number of particles driven by the same physics laws. Depending on the media and the particles to be modeled, the equation has slightly different forms. In this article, we investigate a model Boltzmann equation with highly oscillatory media in the small Knudsen number regime, and study the numerical behavior of the Generalized Multi-scale Finite Element Method (GMsFEM) in the fluid regime when high oscillation in the media presents. The Generalized Multi-scale Finite Element Method (GMsFEM) is a general approach to numerically treat equations with multi-scale structures. The method is divided into the offline and online steps. In the offline step, basis functions are prepared from a snapshot space via a well-designed generalized eigenvalue problem (GEP), and these basis functions are then utilized to patch up for a solution through DG formulation in the online step to incorporate specific boundary and source information. We prove the wellposedness of the method on the Boltzmann equation, and show that the GEP formulation provides a set of optimal basis functions that achieve spectral convergence. Such convergence is independent of the oscillation in the media, or the smallness of the Knudsen number, making it one of the few methods that simultaneously achieve numerical homogenization and asymptotic preserving properties across all scales of oscillations and the Knudsen number.

Maria Vasilyeva, Eric T. Chung, Yalchin Efendiev et al.

In this paper, our aim is to present (1) an embedded fracture model (EFM) for coupled flow and mechanics problem based on the dual continuum approach on the fine grid and (2) an upscaled model for the resulting fine grid equations. The mathematical model is described by the coupled system of equation for displacement, fracture and matrix pressures. For a fine grid approximation, we use the finite volume method for flow problem and finite element method for mechanics. Due to the complexity of fractures, solutions have a variety of scales, and fine grid approximation results in a large discrete system. Our second focus in on constructing the upscaled coarse grid poroelasticity model for fractured media. Our upscaled approach is based on the nonlocal multicontinuum (NLMC) upscaling for coupled flow and mechanics problem, which involves computations of local basis functions via an energy minimization principle. This concept allows a systematic upscaling for processes in the fractured porous media, and provides an effective coarse scale model whose degrees of freedoms have physical meaning. We obtain a fast and accurate solver for the poroelasticity problem on a coarse grid and, at the same time, derive a novel upscaled model. We present numerical results for the two dimensional model problem.

Maria Vasilyeva, Eric T. Chung, Yalchin Efendiev et al.

Traditional two level upscaling techniques suffer from a high offline cost when the coarse grid size is much larger than the fine grid size. Thus, multilevel methods are desirable for problems with complex heterogeneities and high contrast. In this paper, we propose a novel three-level upscaling method for flow problems in fractured porous media. Our method starts with a fine grid discretization for the system involving fractured porous media. In the next step, based on the fine grid model, we construct a nonlocal multi-continua upscaling (NLMC) method using an intermediate grid. The system resulting from NLMC gives solutions that have physical meaning. In order to enhance locality, the grid size of the intermediate grid needs to be relatively small, and this motivates using such an intermediate grid. However, the resulting NLMC upscaled system has a relatively large dimension. This motivates a further step of dimension reduction. In particular, we will apply the idea of the Generalized Multiscale Finite Element Method (GMsFEM) to the NLMC system to obtain a final reduced model. We present simulation results for a two-dimensional model problem with a large number of fractures using the proposed three-level method.

Wing T. Leung, Eric T. Chung, Yalchin Efendiev et al.

In this paper, we discuss multiscale methods for nonlinear problems. The main idea of these approaches is to use local constraints and solve problems in oversampled regions for constructing macroscopic equations. These techniques are intended for problems without scale separation and high contrast, which often occur in applications. For linear problems, the local solutions with constraints are used as basis functions. This technique is called Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM). GMsFEM identifies macroscopic quantities based on rigorous analysis. In corresponding upscaling methods, the multiscale basis functions are selected such that the degrees of freedom have physical meanings, such as averages of the solution on each continuum. This paper extends the linear concepts to nonlinear problems, where the local problems are nonlinear. The main concept consists of: (1) identifying macroscopic quantities; (2) constructing appropriate oversampled local problems with coarse-grid constraints; (3) formulating macroscopic equations. We consider two types of approaches. In the first approach, the solutions of local problems are used as basis functions (in a linear fashion) to solve nonlinear problems. This approach is simple to implement; however, it lacks the nonlinear interpolation, which we present in our second approach. In this approach, the local solutions are used as a nonlinear forward map from local averages (constraints) of the solution in oversampling region. This local fine-grid solution is further used to formulate the coarse-grid problem. Both approaches are discussed on several examples and applied to single-phase and two-phase flow problems, which are challenging because of convection-dominated nature of the concentration equation.

Yating Wang, Siu Wun Cheung, Eric T. Chung et al.

The objective of this paper is to design novel multi-layer neural network architectures for multiscale simulations of flows taking into account the observed data and physical modeling concepts. Our approaches use deep learning concepts combined with local multiscale model reduction methodologies to predict flow dynamics. Using reduced-order model concepts is important for constructing robust deep learning architectures since the reduced-order models provide fewer degrees of freedom. Flow dynamics can be thought of as multi-layer networks. More precisely, the solution (e.g., pressures and saturations) at the time instant $n+1$ depends on the solution at the time instant $n$ and input parameters, such as permeability fields, forcing terms, and initial conditions. One can regard the solution as a multi-layer network, where each layer, in general, is a nonlinear forward map and the number of layers relates to the internal time steps. We will rely on rigorous model reduction concepts to define unknowns and connections for each layer. In each layer, our reduced-order models will provide a forward map, which will be modified ("trained") using available data. It is critical to use reduced-order models for this purpose, which will identify the regions of influence and the appropriate number of variables. Because of the lack of available data, the training will be supplemented with computational data as needed and the interpolation between data-rich and data-deficient models. We will also use deep learning algorithms to train the elements of the reduced model discrete system. We will present main ingredients of our approach and numerical results. Numerical results show that using deep learning and multiscale models, we can improve the forward models, which are conditioned to the available data.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung et al.

In this paper, we propose a rigorous and accurate non-local (in the oversampled region) upscaling framework based on some recently developed multiscale methods [10]. Our proposed method consists of identifying multi-continua parameters via local basis functions and constructing non-local (in the oversampled region) transfer and effective properties. To achieve this, we significantly modify our recent work proposed within Generalized Multiscale Finite Element Method (GMsFEM) in [10] and derive appropriate local problems in oversampled regions once we identify important modes representing each continua. We use piecewise constant functions in each fracture network and in the matrix to write an upscaled equation. Thus, the resulting upscaled equation is of minimal size and the unknowns are average pressures in the fractures and the matrix. We note that the use of non-local upscaled model for porous media flows is not new, e.g., in [14], the authors derive non-local approach. Our main contribution is identifying appropriate local problems together with local spectral modes to represent each continua. The model problem for fractures assumes that one can identify fracture networks. The resulting non-local equation (restricted to the oversampling region, which is several times larger compared to the target coarse block) has the same form as \cite{Hamdi_Nonlocal} with much smaller local regions. We present numerical results, which show that the proposed approach can provide good accuracy.

Eric T. Chung, Yalchin Efendiev, Bangti Jin et al.

In this work, we propose a generalized multiscale inversion algorithm for heterogeneous problems that aims at solving an inverse problem on a computational coarse grid. Previous inversion techniques for multiscale problems seek a coarse-grid media properties, e.g., permeability and conductivity, and by doing so, they assume that there exists a homogenized representation of the underlying fine-scale permeability field on a coarse grid. Generally such assumptions do not hold for highly heterogeneous fields, e.g., fracture media or channelized fields, where the width of channels are very small compared to the coarse-grid sizes. In these cases, grid refinement can lead to many degrees of freedom, and thus unattractive to apply. The proposed algorithm is based on the Generalized Multiscale Finite Element Method (GMsFEM), which uses local spectral problems to identify non-localized features, i.e., channels (high-conductivity inclusions that connect the boundaries of the coarse-grid block). The inclusion of these features in the coarse space enables one to achieve a good accuracy. The approach is valid under the assumption that the solution can be well represented in a reduced-dimensional space by multiscale basis functions. In practice, these basis functions are non-observable as we do not identify the fine-scale features of the permeability field. Our inversion algorithm finds the discretization parameters of the resulting system. By doing so, we identify the appropriate coarse-grid parameters representing the permeability field instead of fine-grid permeability field. We illustrate the approach by numerical results for fractured media.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

Local multiscale methods often construct multiscale basis functions in the offline stage without taking into account input parameters, such as source terms, boundary conditions, and so on. These basis functions are then used in the online stage with a specific input parameter to solve the global problem at a reduced computational cost. Recently, online approaches have been introduced, where multiscale basis functions are adaptively constructed in some regions to reduce the error significantly. In multiscale methods, it is desired to have only 1-2 iterations to reduce the error to a desired threshold. Using Generalized Multiscale Finite Element Framework, it was shown that by choosing sufficient number of offline basis functions, the error reduction can be made independent of physical parameters, such as scales and contrast. In this paper, our goal is to improve this. Using our recently proposed approach and special online basis construction in oversampled regions, we show that the error reduction can be made sufficiently large by appropriately selecting oversampling regions. Our numerical results show that one can achieve a three order of magnitude error reduction, which is better than our previous methods. We also develop an adaptive algorithm and enrich in selected regions with large residuals. In our adaptive method, we show that the convergence rate can be determined by a user-defined parameter and we confirm this by numerical simulations. The analysis of the method is presented.

Juan Galvis, Eric Chung, Yalchin Efendiev et al.

We review some important ideas in the design and analysis of robust overlapping domain decomposition algorithms for high-contrast multiscale problems and propose a domain decomposition method better performance in terms of the number of iterations. The main novelty of our approaches is the construction of coarse spaces, which are computed using spectral information of local bilinear forms. We present several approaches to incorporate the spectral information into the coarse problem in order to obtain minimal coarse space dimension. We show that using these coarse spaces, we can obtain a domain decomposition preconditioner with the condition number independent of contrast and small scales. To minimize further the number of iterations until convergence, we use this minimal dimensional coarse spaces in a construction combining them with large overlap local problems that take advantage of the possibility of localizing global fields orthogonal to the coarse space. We obtain a condition number close to 1 for the new method. We discuss possible drawbacks and further extensions.

Victor M. Calo, Eric T. Chung, Yalchin Efendiev et al.

We develop a Petrov-Galerkin stabilization method for multiscale convection-diffusion transport systems. Existing stabilization techniques add a limited number of degrees of freedom in the form of bubble functions or a modified diffusion, which may not sufficient to stabilize multiscale systems. We seek a local reduced-order model for this kind of multiscale transport problems and thus, develop a systematic approach for finding reduced-order approximations of the solution. We start from a Petrov-Galerkin framework using optimal weighting functions. We introduce an auxiliary variable to a mixed formulation of the problem. The auxiliary variable stands for the optimal weighting function. The problem reduces to finding a test space (a reduced dimensional space for this auxiliary variable), which guarantees that the error in the primal variable (representing the solution) is close to the projection error of the full solution on the reduced dimensional space that approximates the solution. To find the test space, we reformulate some recent mixed Generalized Multiscale Finite Element Methods. We introduce snapshots and local spectral problems that appropriately define local weight and trial spaces. In particular, we use energy minimizing snapshots and local spectral decompositions in the natural norm associated with the auxiliary variable. The resulting spectral decomposition adaptively identifies and builds the optimal multiscale space to stabilize the system. We discuss the stability and its relation to the approximation property of the test space. We design online basis functions, which accelerate convergence in the test space, and consequently, improve stability. We present several numerical examples and show that one needs a few test functions to achieve an error similar to the projection error in the primal variable irrespective of the Peclet number.

Eric Chung, Yalchin Efendiev, Wing Tat Leung et al.

In a number of previous papers, local (coarse grid) multiscale model reduction techniques are developed using a Generalized Multiscale Finite Element Method. In these approaches, multiscale basis functions are constructed using local snapshot spaces, where a snapshot space is a large space that represents the solution behavior in a coarse block. In a number of applications (e.g., those discussed in the paper), one may have a sparsity in the snapshot space for an appropriate choice of a snapshot space. More precisely, the solution may only involve a portion of the snapshot space. In this case, one can use sparsity techniques to identify multiscale basis functions. In this paper, we consider two such sparse local multiscale model reduction approaches. In the first approach (which is used for parameter-dependent multiscale PDEs), we use local minimization techniques, such as sparse POD, to identify multiscale basis functions, which are sparse in the snapshot space. These minimization techniques use $l_1$ minimization to find local multiscale basis functions, which are further used for finding the solution. In the second approach (which is used for the Helmholtz equation), we directly apply $l_1$ minimization techniques to solve the underlying PDEs. This approach is more expensive as it involves a large snapshot space; however, in this example, we can not identify a local minimization principle, such as local generalized SVD.

Ho Yuen Chan, Eric T. Chung, Yalchin Efendiev

In this paper, we present two adaptive methods for the basis enrichment of the mixed Generalized Multiscale Finite Element Method (GMsFEM) for solving the flow problem in heterogeneous media. We develop an a-posteriori error indicator which depends on the norm of a local residual operator. Based on this indicator, we construct an offline adaptive method to increase the number of basis functions locally in coarse regions with large local residuals. We also develop an online adaptive method which iteratively enriches the function space by adding new functions computed based on the residual of the previous solution and special minimum energy snapshots. We show theoretically and numerically the convergence of the two methods. The online method is, in general, better than the offline method as the online method is able to capture distant effects (at a cost of online computations), and both methods have faster convergence than a uniform enrichment. Analysis shows that the online method should start with certain number of initial basis functions in order to have the best performance. The numerical results confirm this and show further that with correct selection of initial basis functions, the convergence of the online method can be independent of the contrast of the medium. We consider cases with both very high and very low conducting inclusions and channels in our numerical experiments.

I. Y. Akkutlu, Yalchin Efendiev, Maria Vasilyeva

In this paper, we develop a multiscale model reduction technique that describes shale gas transport in fractured media. Due to the pore-scale heterogeneities and processes, we use upscaled models to describe the matrix. We follow our previous work \cite{aes14}, where we derived an upscaled model in the form of generalized nonlinear diffusion model to describe the effects of kerogen. To model the interaction between the matrix and the fractures, we use Generalized Multiscale Finite Element Method. In this approach, the matrix and the fracture interaction is modeled via local multiscale basis functions. We developed the GMsFEM and applied for linear flows with horizontal or vertical fracture orientations on a Cartesian fine grid. In this paper, we consider arbitrary fracture orientations and use triangular fine grid and developed GMsFEM for nonlinear flows. Moreover, we develop online basis function strategies to adaptively improve the convergence. The number of multiscale basis functions in each coarse region represents the degrees of freedom needed to achieve a certain error threshold. Our approach is adaptive in a sense that the multiscale basis functions can be added in the regions of interest. Numerical results for two-dimensional problem are presented to demonstrate the efficiency of proposed approach.

Kai Gao, Shubin Fu, Richard L. Gibson et al.

It is important to develop fast yet accurate numerical methods for seismic wave propagation to characterize complex geological structures and oil and gas reservoirs. However, the computational cost of conventional numerical modeling methods, such as finite-difference method and finite-element method, becomes prohibitively expensive when applied to very large models. We propose a Generalized Multiscale Finite-Element Method (GMsFEM) for elastic wave propagation in heterogeneous, anisotropic media, where we construct basis functions from multiple local problems for both the boundaries and interior of a coarse node support or coarse element. The application of multiscale basis functions can capture the fine scale medium property variations, and allows us to greatly reduce the degrees of freedom that are required to implement the modeling compared with conventional finite-element method for wave equation, while restricting the error to low values. We formulate the continuous Galerkin and discontinuous Galerkin formulation of the multiscale method, both of which have pros and cons. Applications of the multiscale method to three heterogeneous models show that our multiscale method can effectively model the elastic wave propagation in anisotropic media with a significant reduction in the degrees of freedom in the modeling system.

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

Offline computation is an essential component in most multiscale model reduction techniques. However, there are multiscale problems in which offline procedure is insufficient to give accurate representations of solutions, due to the fact that offline computations are typically performed locally and global information is missing in these offline information. To tackle this difficulty, we develop an online local adaptivity technique for local multiscale model reduction problems. We design new online basis functions within Discontinuous Galerkin method based on local residuals and some optimally estimates. The resulting basis functions are able to capture the solution efficiently and accurately, and are added to the approximation iteratively. Moreover, we show that the iterative procedure is convergent with a rate independent of physical scales if the initial space is chosen carefully. Our analysis also gives a guideline on how to choose the initial space. We present some numerical examples to show the performance of the proposed method.