×

Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential training. (English) Zbl 1507.74119

Summary: Physics-informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward problems, however, pose significant challenges, mainly because of the complex non-convex and multi-objective loss function. In this work, we present a PINN approach to solving the equations of coupled flow and deformation in porous media for both single-phase and multiphase flow. To this end, we construct the solution space using multi-layer neural networks. Due to the dynamics of the problem, we find that incorporating multiple differential relations into the loss function results in an unstable optimization problem, meaning that sometimes it converges to the trivial null solution, other times it moves very far from the expected solution. We report a dimensionless form of the coupled governing equations that we find most favorable to the optimizer. Additionally, we propose a sequential training approach based on the stress-split algorithms of poromechanics. Notably, we find that sequential training based on stress-split performs well for different problems, while the classical strain-split algorithm shows an unstable behavior similar to what is reported in the context of finite element solvers. We use the approach to solve benchmark problems of poroelasticity, including Mandel’s consolidation problem, Barry-Mercer’s injection-production problem, and a reference two-phase drainage problem. The Python-SciANN codes reproducing the results reported in this manuscript will be made publicly available at https://github.com/sciann/sciann-applications.

MSC:

74F10 Fluid-solid interactions (including aero- and hydro-elasticity, porosity, etc.)
74-10 Mathematical modeling or simulation for problems pertaining to mechanics of deformable solids

References:

[1] Armero, F.; Simo, J. C., A new unconditionally stable fractional step method for non-linear coupled thermomechanical problems, Internat. J. Numer. Methods Engrg., 35, 4, 737-766 (1992) · Zbl 0784.73085
[2] Armero, Francisco, Formulation and finite element implementation of a multiplicative model of coupled poro-plasticity at finite strains under fully saturated conditions, Comput. Methods Appl. Mech. Engrg., 171, 3-4, 205-241 (1999) · Zbl 0968.74062
[3] Park, K. C., Stabilization of partitioned solution procedure for pore fluid-soil interaction analysis, Internat. J. Numer. Methods Engrg., 19, 11, 1669-1673 (1983) · Zbl 0519.76095
[4] Zienkiewicz, O. C.; Paul, D. K.; Chan, AHC, Unconditionally stable staggered solution procedure for soil-pore fluid interaction problems, Internat. J. Numer. Methods Engrg., 26, 5, 1039-1055 (1988) · Zbl 0634.73110
[5] Lewis, Roland W.; Schrefler, B. A., The Finite Element Method in the Static and Dynamic Deformation and Consolidation of Porous Media (1998), John Wiley & Sons · Zbl 0935.74004
[6] Schrefler, B. A., Multiphase flow in deforming porous material, Internat. J. Numer. Methods Engrg., 60, 1, 27-50 (2004) · Zbl 1060.74536
[7] White, Joshua A.; Borja, Ronaldo I., Stabilized low-order finite elements for coupled solid-deformation/fluid-diffusion and their application to fault zone transients, Comput. Methods Appl. Mech. Engrg., 197, 49-50, 4353-4366 (2008) · Zbl 1194.74480
[8] Settari, Antonin; Mourits, F. M., A coupled reservoir and geomechanical simulation system, SPE J., 3, 03, 219-226 (1998)
[9] Thomas, L. K.; Chin, L. Y.; Pierson, R. G.; Sylte, J. E., Coupled geomechanics and reservoir simulation, SPE J., 8, 04, 350-358 (2003)
[10] Khoei, A. R.; Mohammadnejad, T., Numerical modeling of multiphase fluid flow in deforming porous media: A comparison between two-and three-phase models for seismic analysis of earth and rockfill dams, Comput. Geotech., 38, 2, 142-166 (2011)
[11] Zienkiewicz, O. C.; Chan, A. H.C.; Pastor, M.; Schrefler, B. A.; Shiomi, T., Computational Geomechanics with Special Reference to Earthquake Engineering (1999), Wiley · Zbl 0932.74003
[12] Fredrich, Joanne T.; Arguello, JG; Deitrick, GL; de Rouffignac, Eric P., Geomechanical modeling of reservoir compaction, surface subsidence, and casing damage at the belridge diatomite field, SPE Reserv. Eval. Eng., 3, 04, 348-359 (2000)
[13] Jha, Birendra; Juanes, Ruben, A locally conservative finite element framework for the simulation of coupled flow and reservoir geomechanics, Acta Geotech., 2, 3, 139-153 (2007)
[14] Kim, Jihoon; Tchelepi, Hamdi A.; Juanes, Ruben, Stability and convergence of sequential methods for coupled flow and geomechanics: Fixed-stress and fixed-strain splits, Comput. Methods Appl. Mech. Engrg., 200, 13-16, 1591-1606 (2011) · Zbl 1228.74101
[15] Jha, Birendra; Juanes, Ruben, Coupled multiphase flow and poromechanics: A computational model of pore pressure effects on fault slip and earthquake triggering, Water Resour. Res., 50, 5, 3776-3808 (2014)
[16] Gawin, D.; Lefik, M.; Schrefler, B. A., ANN approach to sorption hysteresis within a coupled hygro-thermo-mechanical FE analysis, Internat. J. Numer. Methods Engrg., 50, 299-323 (2001) · Zbl 1043.76033
[17] Raissi, Maziar; Perdikaris, Paris; Karniadakis, George E., Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, J. Comput. Phys., 378, 686-707 (2019) · Zbl 1415.68175
[18] Jin, Xiaowei; Cai, Shengze; Li, Hui; Karniadakis, George Em, NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations, J. Comput. Phys., 426, Article 109951 pp. (2021) · Zbl 07510065
[19] Garipov, Timur T.; Tomin, Pavel; Rin, Ruslan; Voskov, Denis V.; Tchelepi, Hamdi A., Unified thermo-compositional-mechanical framework for reservoir simulation, Comput. Geosci., 22, 4, 1039-1057 (2018) · Zbl 1401.86012
[20] Wu, Jin-Long; Xiao, Heng; Paterson, Eric, Physics-informed machine learning approach for augmenting turbulence models: A comprehensive framework, Phys. Rev. Fluids, 3, 7, Article 074602 pp. (2018)
[21] Cai, Shengze; Mao, Zhiping; Wang, Zhicheng; Yin, Minglang; Karniadakis, George Em, Physics-informed neural networks (PINNs) for fluid mechanics: A review (2021), arXiv preprint arXiv:2105.09506
[22] Rao, Chengping; Sun, Hao; Liu, Yang, Physics-informed deep learning for incompressible laminar flows, Theor. Appl. Mech. Lett., 10, 3, 207-212 (2020)
[23] Mao, Zhiping; Jagtap, Ameya D.; Karniadakis, George Em, Physics-informed neural networks for high-speed flows, Comput. Methods Appl. Mech. Engrg., 360, Article 112789 pp. (2020) · Zbl 1442.76092
[24] Reyes, Brandon; Howard, Amanda A.; Perdikaris, Paris; Tartakovsky, Alexandre M., Learning unknown physics of non-Newtonian fluids, Phys. Rev. Fluids, 6, 7, Article 073301 pp. (2021)
[25] Haghighat, Ehsan; Raissi, Maziar; Moure, Adrian; Gomez, Hector; Juanes, Ruben, A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics, Comput. Methods Appl. Mech. Engrg., 379, Article 113741 pp. (2021) · Zbl 1506.74476
[26] Rao, Chengping; Sun, Hao; Liu, Yang, Physics-informed deep learning for computational elastodynamics without labeled data, J. Eng. Mech., 147, 8, Article 04021043 pp. (2021)
[27] Haghighat, Ehsan; Bekar, Ali Can; Madenci, Erdogan; Juanes, Ruben, A nonlocal physics-informed deep learning framework using the peridynamic differential operator, Comput. Methods Appl. Mech. Engrg., 385, Article 114012 pp. (2021) · Zbl 1502.65172
[28] Guo, Mengwu; Haghighat, Ehsan, An energy-based error bound of physics-informed neural network solutions in elasticity (2020), arXiv preprint arXiv:2010.09088
[29] Cai, Shengze; Wang, Zhicheng; Wang, Sifan; Perdikaris, Paris; Karniadakis, George Em, Physics-informed neural networks for heat transfer problems, J. Heat Transfer, 143, 6, Article 060801 pp. (2021)
[30] Niaki, Sina Amini; Haghighat, Ehsan; Campbell, Trevor; Poursartip, Anoush; Vaziri, Reza, Physics-informed neural network for modelling the thermochemical curing process of composite-tool systems during manufacture, Comput. Methods Appl. Mech. Engrg., 384, Article 113959 pp. (2021) · Zbl 1506.74123
[31] Zobeiry, Navid; Humfeld, Keith D., A physics-informed machine learning approach for solving heat transfer equation in advanced manufacturing and engineering applications, Eng. Appl. Artif. Intell., 101, Article 104232 pp. (2021)
[32] Pilania, Ghanshyam; McClellan, Kenneth James; Stanek, Christopher Richard; Uberuaga, Blas P., Physics-informed machine learning for inorganic scintillator discovery, J. Chem. Phys., 148, 24, Article 241729 pp. (2018)
[33] Liu, Sen; Kappes, Branden B.; Amin-ahmadi, Behnam; Benafan, Othmane; Zhang, Xiaoli; Stebner, Aaron P., Physics-informed machine learning for composition-process-property design: Shape memory alloy demonstration, Appl. Mater. Today, 22, Article 100898 pp. (2021)
[34] Ji, Weiqi; Qiu, Weilun; Shi, Zhiyu; Pan, Shaowu; Deng, Sili, Stiff-PINN: Physics-informed neural network for stiff chemical kinetics (2020), arXiv preprint arXiv:2011.04520
[35] Fang, Zhiwei; Zhan, Justin, Deep physical informed neural networks for metamaterial design, IEEE Access, 8, 24506-24513 (2019)
[36] Chen, Yuyao; Lu, Lu; Karniadakis, George Em; Dal Negro, Luca, Physics-informed neural networks for inverse problems in nano-optics and metamaterials, Opt. Express, 28, 8, 11618-11633 (2020)
[37] Noakoasteen, Oameed; Wang, Shu; Peng, Zhen; Christodoulou, Christos, Physics-informed deep neural networks for transient electromagnetic analysis, IEEE Open J. Antennas Propag., 1, 404-412 (2020)
[38] bin Waheed, Umair; Haghighat, Ehsan; Alkhalifah, Tariq; Song, Chao; Hao, Qi, PINNeik: Eikonal solution using physics-informed neural networks, Comput. Geosci., 155, Article 104833 pp. (2021)
[39] Song, Chao; Alkhalifah, Tariq; Waheed, Umair Bin, Solving the frequency-domain acoustic VTI wave equation using physics-informed neural networks, Geophys. J. Int., 225, 2, 846-859 (2021)
[40] Song, Chao; Alkhalifah, Tariq, Wavefield reconstruction inversion via physics-informed neural networks (2021), arXiv preprint arXiv:2104.06897
[41] Waheed, Umair bin; Alkhalifah, Tariq; Haghighat, Ehsan; Song, Chao, A holistic approach to computing first-arrival traveltimes using neural networks (2021), arXiv preprint arXiv:2101.11840
[42] Fuks, Olga; Tchelepi, Hamdi A., Limitations of physics informed machine learning for nonlinear two-phase transport in porous media, J. Mach. Learn. Modeling Comput., 1, 1, 19-37 (2020)
[43] Almajid, Muhammad M.; Abu-Alsaud, Moataz O., Prediction of porous media fluid flow using physics informed neural networks, J. Pet. Sci. Eng., 208, Article 109205 pp. (2022)
[44] Bekele, Yared W., Physics-informed deep learning for one-dimensional consolidation, J. Rock Mech. Geotech. Eng., 13, 2, 420-430 (2021)
[45] Shokouhi, Parisa; Kumar, Vikas; Prathipati, Sumedha; Hosseini, Seyyed A.; Giles, Clyde Lee; Kifer, Daniel, Physics-informed deep learning for prediction of CO2 storage site response, J. Contam. Hydrol., Article 103835 pp. (2021)
[46] Kadeethum, Teeratorn; Jørgensen, Thomas M.; Nick, Hamidreza M., Physics-informed neural networks for solving nonlinear diffusivity and Biot’s equations, PLoS One, 15, 5, Article e0232683 pp. (2020)
[47] Bekele, Yared W., Physics-informed deep learning for flow and deformation in poroelastic media (2020), arXiv preprint arXiv:2010.15426
[48] Tartakovsky, Alexandre M.; Marrero, C. Ortiz; Perdikaris, Paris; Tartakovsky, Guzel D.; Barajas-Solano, David, Physics-informed deep neural networks for learning parameters and constitutive relationships in subsurface flow problems, Water Resour. Res., 56, 5, Article e2019WR026731 pp. (2020)
[49] Karniadakis, George Em; Kevrekidis, Ioannis G.; Lu, Lu; Perdikaris, Paris; Wang, Sifan; Yang, Liu, Physics-informed machine learning, Nat. Rev. Phys., 3, 6, 422-440 (2021)
[50] Haghighat, Ehsan; Juanes, Ruben, SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks, Comput. Methods Appl. Mech. Engrg., 373, Article 113552 pp. (2021) · Zbl 1506.65251
[51] Lu, Lu; Meng, Xuhui; Mao, Zhiping; Karniadakis, George Em, DeepXDE: A deep learning library for solving differential equations, SIAM Rev., 63, 1, 208-228 (2021) · Zbl 1459.65002
[52] Hennigh, Oliver; Narasimhan, Susheela; Nabian, Mohammad Amin; Subramaniam, Akshay; Tangsali, Kaustubh; Fang, Zhiwei; Rietmann, Max; Byeon, Wonmin; Choudhry, Sanjay, NVIDIA SimNet™: An AI-accelerated multi-physics simulation framework, (International Conference on Computational Science (2021), Springer), 447-461
[53] Zubov, Kirill; McCarthy, Zoe; Ma, Yingbo; Calisto, Francesco; Pagliarino, Valerio; Azeglio, Simone; Bottero, Luca; Luján, Emmanuel; Sulzer, Valentin; Bharambe, Ashutosh, NeuralPDE: Automating physics-informed neural networks (PINNs) with error approximations (2021), arXiv preprint arXiv:2107.09443
[54] Wang, Sifan; Teng, Yujun; Perdikaris, Paris, Understanding and mitigating gradient pathologies in physics-informed neural networks (2020), arXiv preprint arXiv:2001.04536 · Zbl 1530.68232
[55] Chen, Zhao; Badrinarayanan, Vijay; Lee, Chen-Yu; Rabinovich, Andrew, Gradnorm: Gradient normalization for adaptive loss balancing in deep multitask networks, (International Conference on Machine Learning (2018), PMLR), 794-803
[56] Wang, Sifan; Yu, Xinling; Perdikaris, Paris, When and why PINNs fail to train: A neural tangent kernel perspective (2020), arXiv preprint arXiv:2007.14527 · Zbl 07524768
[57] Wang, Sifan; Wang, Hanwen; Perdikaris, Paris, On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks, Comput. Methods Appl. Mech. Engrg., 384, Article 113938 pp. (2021) · Zbl 1506.35130
[58] Madenci, Erdogan; Barut, Atila; Futch, Michael, Peridynamic differential operator and its applications, Comput. Methods Appl. Mech. Engrg., 304, 408-451 (2016) · Zbl 1425.74043
[59] Jagtap, Ameya D.; Kharazmi, Ehsan; Karniadakis, George Em, Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems, Comput. Methods Appl. Mech. Engrg., 365, Article 113028 pp. (2020) · Zbl 1442.92002
[60] Jagtap, Ameya D.; Karniadakis, George Em, Extended physics-informed neural networks (xPINNs): A generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations, Commun. Comput. Phys., 28, 5, 2002-2041 (2020) · Zbl 1542.65182
[61] Fraces, Cedric G.; Papaioannou, Adrien; Tchelepi, Hamdi, Physics informed deep learning for transport in porous media. Buckley Leverett problem (2020), arXiv preprint arXiv:2001.05172
[62] Biot, Maurice A., General theory of three-dimensional consolidation, J. Appl. Phys., 12, 2, 155-164 (1941) · JFM 67.0837.01
[63] Kim, Jihoon; Tchelepi, Hamdi A.; Juanes, Ruben, Rigorous coupling of geomechanics and multiphase flow with strong capillarity, SPE J., 18, 06, 1123-1139 (2013)
[64] Coussy, Olivier, Poromechanics (2004), John Wiley & Sons · Zbl 1120.74447
[65] Kingma, Diederik P.; Ba, Jimmy, Adam: A method for stochastic optimization (2014), arXiv preprint arXiv:1412.6980
[66] Liu, Dong C.; Nocedal, Jorge, On the limited memory BFGS method for large scale optimization, Math. Program., 45, 1, 503-528 (1989) · Zbl 0696.90048
[67] Nocedal, Jorge; Wright, Stephen, Numerical Optimization (2006), Springer Science & Business Media · Zbl 1104.65059
[68] Nabian, Mohammad Amin; Gladstone, Rini Jasmine; Meidani, Hadi, Efficient training of physics-informed neural networks via importance sampling, Comput.-Aided Civ. Infrastruct. Eng. (2021)
[69] Wight, Colby L.; Zhao, Jia, Solving Allen-Cahn and Cahn-Hilliard equations using the adaptive physics informed neural networks (2020), arXiv preprint arXiv:2007.04542 · Zbl 07419706
[70] Zienkiewicz, Olgierd Cecil; Taylor, Robert Leroy; Nithiarasu, Perumal; Zhu, JZ, The Finite Element Method, vol. 3 (1977), McGraw-hill London · Zbl 0435.73072
[71] Hughes, Thomas J. R., The Finite Element Method: Linear Static and Dynamic Finite Element Analysis (2012), Courier Corporation
[72] Jagtap, Ameya D.; Kawaguchi, Kenji; Em Karniadakis, George, Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks, Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci., 476, 2239, Article 20200334 pp. (2020) · Zbl 1472.68175
[73] Sitzmann, Vincent; Martel, Julien; Bergman, Alexander; Lindell, David; Wetzstein, Gordon, Implicit neural representations with periodic activation functions, Adv. Neural Inf. Process. Syst., 33 (2020)
[74] Barry, S. I.; Mercer, G. N., Exact solutions for two-dimensional time-dependent flow and deformation within a poroelastic medium, J. Appl. Mech., 66, 2, 536-540 (1999)
[75] Phillips, Phillip Joseph, Finite Element Methods in Linear Poroelasticity: Theoretical and Computational Results (2005), The University of Texas at Austin
[76] Liakopoulos, Aristides C., Transient Flow Through Unsaturated Porous Media (1964), University of California: University of California Berkeley
[77] Brooks, Royal Harvard; Corey, Arthur T., Properties of porous media affecting fluid flow, J. Irrig. Drain. Div., 92, 2, 61-88 (1966)
[78] Castelletto, Nicola; White, Joshua A.; Tchelepi, H. A., Accuracy and convergence properties of the fixed-stress iterative solution of two-way coupled poromechanics, Int. J. Numer. Anal. Methods Geomech., 39, 14, 1593-1618 (2015)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.