×

Identification of the flux function of nonlinear conservation laws with variable parameters. (English) Zbl 1517.35263

Summary: Machine learning methods have in various ways emerged as a useful tool for modeling the dynamics of physical systems in the context of partial differential equations (PDEs). Nonlinear conservation laws (NCLs) of the form \(u_t + f(u)_x = 0\) play a vital role within the family of PDEs. A main challenge with NCLs is that solutions contain discontinuities. That is, one or several jumps of the form \((u_L(t), u_R(t))\) with \(u_L \neq u_R\) may move in space and time such that information about \(f(u)\) in the interval associated with this jump is not present in the observation data. Moreover, the lack of regularity in the solution \(u(x, t)\) prevents use of physics informed neural network (PINN) and similar methods. The purpose of this work is to propose a method to identify the nonlinear flux function \(f(u, \beta)\) with variable parameters of an unknown scalar conservation law \[ u_t + f(u, \beta)_x = 0\tag{\(\ast\)} \] with \(u\) as the dependent variable and \(\beta\) as the parameter. In a recent work we introduced a framework coined ConsLaw-Net that combines a symbolic multi-layer neural network and an entropy-satisfying discrete scheme to learn the nonlinear, unknown flux function \(f(u; \beta)\) for various fixed \(\beta\). Learning the flux function with variable parameters, marked as \(f(u, \beta)\), is more challenging since it requires an understanding of the relationship between the variable \(u\) and parameter \(\beta\) as well. In this work we demonstrate how to couple ConsLaw-Net to the Linear Regression Neural Network (LRNN) to learn the functional form of the two variable function \(f(u, \beta)\). In addition, ConsLaw-Net is here further developed and made more generic by using a refined discrete scheme combined with a more general symbolic neural network (S-Net). We experimentally demonstrate that the upgraded ConsLaw-Net integrated with LRNN is well-suited for learning tasks, achieving more accurate identification than existing learning approaches when applied to problems that involve general classes of flux functions \(f(u, \beta)\). The investigations of this work are restricted to the class of polynomial, rational functions.

MSC:

35R30 Inverse problems for PDEs
35L65 Hyperbolic conservation laws

References:

[1] Pardo, D.; Demkowicz, L.; Torres-Verdin, C.; Paszynski, M., A self-adaptive goal-oriented hp-finite element method with electromagnetic applications. Part II: Electrodynamics, Comput. Methods Appl. Mech. Engrg., 196, 37-40, 3585-3597 (2007) · Zbl 1173.78320
[2] Economon, Thomas D.; Palacios, Francisco; Copeland, Sean R.; Lukaczyk, Trent W.; Alonso, Juan J., SU2: An open-source suite for multiphysics simulation and design, AIAA J., 54, 3, 828-846 (2016)
[3] Ramamurti, Ravi; Sandberg, William, Simulation of flow about flapping airfoils using finite element incompressible flow solver, AIAA J., 39, 2, 253-260 (2001)
[4] Bauer, Peter; Thorpe, Alan; Brunet, Gilbert, The quiet revolution of numerical weather prediction, Nature, 525, 7567, 47-55 (2015)
[5] Schwarzbach, Christoph; Börner, Ralph-Uwe; Spitzer, Klaus, Three-dimensional adaptive higher order finite element simulation for geo-electromagnetics—a marine CSEM example, Geophys. J. Int., 187, 1, 63-74 (2011)
[6] Raissi, Maziar; Perdikaris, Paris; Karniadakis, George E., Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, J. Comput. Phys., 378, 686-707 (2019) · Zbl 1415.68175
[7] Long, Zichao; Lu, Yiping; Ma, Xianzhong; Dong, Bin, Pde-net: Learning PDEs from data, (International Conference on Machine Learning (2018), PMLR), 3208-3216
[8] Long, Zichao; Lu, Yiping; Dong, Bin, PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network, J. Comput. Phys., 399, Article 108925 pp. (2019) · Zbl 1454.65131
[9] Skadsem, Hans Joakim; Kragset, Steinar, A numerical study of density-unstable reverse circulation displacement for primary cementing, . Energy Resour. Technol., 144, 12, Article 123008 pp. (2022)
[10] Fuks, Olga; Tchelepi, Hamdi A., Limitations of physics informed machine learning for nonlinear two-phase transport in porous media, J. Mach. Learn. Model. Comput., 1, 1 (2020)
[11] Li, Qing; Evje, Steinar, Learning the nonlinear flux function of a hidden scalar conservation law from data, Netw. Heterog. Media, 18 (2023) · Zbl 1531.68086
[12] R.J. LeVeque, Finite Volume Methods for Hyperbolic Problems, in: Cambridge Texts in Applied Mathematics, 2007.
[13] J.W. Thomas, Numerical Partial Differential Equations. Conservation laws and elliptic equations, in: Texts in Applied Mathematics 33, 1999. · Zbl 0927.65109
[14] Hesthaven, J. S., Numerical methods for conservation laws. From analysis to algorithms, SIAM. Comput. Sci. Eng. (2017)
[15] D. Kröener, Numerical Schemes for Conservation Laws, in: Wiley-Teubner Series Advances in Numerical Mathematics, 1997. · Zbl 0872.76001
[16] Mishra, Siddhartha; Fjordholm, U.; Abgrall, R., (Numerical methods for conservation laws and related equations. Numerical methods for conservation laws and related equations, Lecture Notes for Numerical Methods for Partial Differential Equations, ETH, vol. 57 (2019)), 58
[17] Iakovlev, Valerii; Heinonen, Markus; Lähdesmäki, Harri, Learning continuous-time PDEs from sparse data with graph neural networks, (9th International Conference on Learning Representations. 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 (2021), OpenReview.net)
[18] Pfaff, Tobias; Fortunato, Meire; Sanchez-Gonzalez, Alvaro; Battaglia, Peter W., Learning mesh-based simulation with graph networks, (9th International Conference on Learning Representations. 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 (2021), OpenReview.net)
[19] Zhao, Qingqing; Lindell, David B.; Wetzstein, Gordon, Learning to solve PDE-constrained inverse problems with graph networks, (Chaudhuri, Kamalika; Jegelka, Stefanie; Song, Le; Szepesvári, Csaba; Niu, Gang; Sabato, Sivan, International Conference on Machine Learning. International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA. International Conference on Machine Learning. International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA, Proceedings of Machine Learning Research, vol. 162 (2022), PMLR), 26895-26910
[20] Holden, Helge; Priuli, Fabio Simone; Risebro, Nils Henrik, On an inverse problem for scalar conservation laws, Inverse Problems, 30, 3, Article 035015 pp. (2014) · Zbl 1286.35266
[21] Bustos, María Cristina; Tory, EM; Bürger, Raimund; Concha, F., Sedimentation and thickening: Phenomenological foundation and mathematical theory, Vol. 8 (1999), Springer Science & Business Media · Zbl 0936.76001
[22] Diehl, Stefan, Estimation of the batch-settling flux function for an ideal suspension from only two experiments, Chem. Eng. Sci., 62, 17, 4589-4601 (2007)
[23] Bürger, Raimund; Diehl, Stefan, Convexity-preserving flux identification for scalar conservation laws modelling sedimentation, Inverse Problems, 29, 4, Article 045008 pp. (2013) · Zbl 1273.35310
[24] Bürger, Raimund; Careaga, Julio; Diehl, Stefan, Flux identification of scalar conservation laws from sedimentation in a cone, IMA J. Appl. Math., 83, 3, 526-552 (2018) · Zbl 1408.76400
[25] Diehl, Stefan, Numerical identification of constitutive functions in scalar nonlinear convection-diffusion equations with application to batch sedimentation, Appl. Numer. Math., 95, 154-172 (2015) · Zbl 1320.65136
[26] Mosser, Lukas; Dubrule, Olivier; Blunt, Martin J., Stochastic seismic waveform inversion using generative adversarial networks as a geological prior, Math. Geosci., 52, 1, 53-79 (2020) · Zbl 1428.86022
[27] He, Qinglong; Wang, Yanfei, Reparameterized full-waveform inversion using deep neural networks, Geophysics, 86, 1, V1-V13 (2021)
[28] Fan, Tiffany; Xu, Kailai; Pathak, Jay; Darve, Eric, Solving inverse problems in steady-state navier-stokes equations using deep neural networks (2020), arXiv preprint arXiv:2008.13074
[29] Schaeffer, Hayden, Learning partial differential equations via data discovery and sparse optimization, Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci., 473, 2197, Article 20160446 pp. (2017) · Zbl 1404.35397
[30] Kang, Sung Ha; Liao, Wenjing; Liu, Yingjie, Ident: Identifying differential equations with numerical time evolution, J. Sci. Comput., 87, 1-27 (2021) · Zbl 1467.65102
[31] Thuerey, Nils; Weißenow, Konstantin; Prantl, Lukas; Hu, Xiangyu, Deep learning methods for Reynolds-averaged Navier-Stokes simulations of airfoil flows, AIAA J., 58, 1, 25-36 (2020)
[32] Wandel, Nils; Weinmann, Michael; Klein, Reinhard, Learning incompressible fluid dynamics from scratch - towards fast, differentiable fluid models that generalize, (9th International Conference on Learning Representations. 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 (2021), OpenReview.net)
[33] Mishra, Siddhartha, A machine learning framework for data driven acceleration of computations of differential equations, Mathematics in Engineering, 1, 118-146 (2019) · Zbl 1435.68279
[34] Martius, Georg; Lampert, Christoph H., Extrapolation and learning equations, (5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Workshop Track Proceedings (2017), OpenReview.net)
[35] Sahoo, Subham; Lampert, Christoph; Martius, Georg, Learning equations for extrapolation and control, (International Conference on Machine Learning (2018), PMLR), 4442-4450
[36] Zhu, Ciyou; Byrd, Richard H.; Lu, Peihuang; Nocedal, Jorge, Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization, ACM Trans. Math. Softw., 23, 4, 550-560 (1997) · Zbl 0912.65057
[37] Ruder, Sebastian, An overview of gradient descent optimization algorithms (2016), arXiv preprint arXiv:1609.04747
[38] James, François; Sepúlveda, M., Parameter identification for a model of chromatographic column, Inverse Problems, 10, 6, 1299 (1994) · Zbl 0809.35159
[39] James, François; Sepúlveda, Mauricio, Convergence results for the flux identification in a scalar conservation law, SIAM J. Control Optim., 37, 3, 869-891 (1999) · Zbl 0970.35161
[40] Holden, Helge; Risebro, Nils Henrik, Front Tracking for Hyperbolic Conservation Laws, Vol. 152 (2015), Springer · Zbl 1346.35004
[41] Loshchilov, Ilya; Hutter, Frank, Decoupled weight decay regularization, (7th International Conference on Learning Representations. 7th International Conference on Learning Representations, ICLR 2019, New Orleans, la, USA, May 6-9, 2019 (2019), OpenReview.net)
[42] Gilmer, Justin; Schoenholz, Samuel S.; Riley, Patrick F.; Vinyals, Oriol; Dahl, George E., Neural message passing for quantum chemistry, (International Conference on Machine Learning (2017), PMLR), 1263-1272
[43] Riedmiller, Martin; Braun, Heinrich, Rprop-a fast adaptive learning algorithm, (Proc. of ISCIS VII, Universitat (1992), Citeseer)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.