Leveraging Bayesian analysis to improve accuracy of approximate models. (English) Zbl 1453.62417
Summary: We focus on improving the accuracy of an approximate model of a multiscale dynamical system that uses a set of parameter-dependent terms to account for the effects of unresolved or neglected dynamics on resolved scales. We start by considering various methods of calibrating and analyzing such a model given a few well-resolved simulations. After presenting results for various point estimates and discussing some of their shortcomings, we demonstrate (a) the potential of hierarchical Bayesian analysis to uncover previously unanticipated physical dependencies in the approximate model, and (b) how such insights can then be used to improve the model. In effect parametric dependencies found from the Bayesian analysis are used to improve structural aspects of the model. While we choose to illustrate the procedure in the context of a closure model for buoyancy-driven, variable-density turbulence, the statistical nature of the approach makes it more generally applicable. Towards addressing issues of increased computational cost associated with the procedure, we demonstrate the use of a neural network based surrogate in accelerating the posterior sampling process and point to recent developments in variational inference as an alternative methodology for greatly mitigating such costs. We conclude by suggesting that modern validation and uncertainty quantification techniques such as the ones we consider have a valuable role to play in the development and improvement of approximate models.
MSC:
| 62F15 | Bayesian inference |
| 76F55 | Statistical turbulence modeling |
| 76D06 | Statistical solutions of Navier-Stokes and related equations |
| 68T07 | Artificial neural networks and deep learning |
Keywords:
Bayesian analysis; reduced order modeling; turbulence modeling; Reynolds-averaged Navier Stokes; neural network; surrogate modelingSoftware:
Spalart-AllmarasReferences:
| [1] | Anjum, M. Farooq; Tasadduq, Imran; Al-Sultan, Khaled, Response surface methodology: a neural network approach, Eur. J. Oper. Res., 101, 1, 65-73 (1997) · Zbl 0928.93007 |
| [2] | Babuska, Ivo; Tinsley Oden, J., Verification and validation in computational engineering and science: basic concepts, Comput. Methods Appl. Mech. Eng., 193, 36, 4057-4066 (2004) · Zbl 1198.74126 |
| [3] | Baldwin, Barrett; Lomax, Harvard, Thin-layer approximation and algebraic model for separated turbulent flows, (16th Aerospace Sciences Meeting (1978)), 257 |
| [4] | Beskos, Alexandros; Pillai, Natesh; Roberts, Gareth; Sanz-Serna, Jesus-Maria; Stuart, Andrew, Optimal tuning of the hybrid Monte Carlo algorithm, Bernoulli, 19, 5A, 1501-1534 (2013) · Zbl 1287.60090 |
| [5] | Besnard, Didier; Harlow, F. H.; Rauenzahn, R. M.; Zemach, C., Turbulence Transport Equations for Variable-Density Turbulence and Their Relationship to Two-Field Models (1992), Los Alamos National Lab., NM: Los Alamos National Lab., NM United States, Technical report |
| [6] | Blei, David M.; Kucukelbir, Alp; McAuliffe, Jon D., Variational inference: a review for statisticians, J. Am. Stat. Assoc., 112, 518, 859-877 (2017) |
| [7] | Hung Cheung, Sai; Oliver, Todd A.; Prudencio, Ernesto E.; Prudhomme, Serge; Moser, Robert D., Bayesian uncertainty analysis with applications to turbulence modeling, Reliab. Eng. Syst. Saf., 96, 9, 1137-1149 (2011) |
| [8] | Chien, Kuei-Yuan, Predictions of channel and boundary-layer flows with a low-Reynolds-number turbulence model, AIAA J., 20, 1, 33-38 (1982) · Zbl 0484.76064 |
| [9] | Cybenko, George, Approximation by superpositions of a sigmoidal function, Math. Control Signals Syst., 2, 4, 303-314 (1989) · Zbl 0679.94019 |
| [10] | DeGennaro, Anthony M.; Urban, Nathan M.; Nadiga, Balasubramanya T.; Haut, Terry, Model structural inference using local dynamic operators, Int. J. Uncertain. Quantificat., 9, 1, 59-83 (2019) · Zbl 1498.62085 |
| [11] | Deuflhard, Peter; Huisinga, Wilhelm; Fischer, Alexander; Schütte, Ch., Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains, Linear Algebra Appl., 315, 1-3, 39-59 (2000) · Zbl 0963.65008 |
| [12] | Dorrestijn, Jesse; Crommelin, Daan T.; Siebesma, A. Pier; Jonker, Harm J. J., Stochastic parameterization of shallow cumulus convection estimated from high-resolution model data, Theor. Comput. Fluid Dyn., 27, 1-2, 133-148 (2013) |
| [13] | Duan, Jinqiao; Nadiga, Balasubramanya, Stochastic parameterization for large eddy simulation of geophysical flows, Proc. Am. Math. Soc., 135, 4, 1187-1196 (2007) · Zbl 1105.76033 |
| [14] | Durbin, Paul A., Near-wall turbulence closure modeling without “damping functions”, Theor. Comput. Fluid Dyn., 3, 1, 1-13 (1991) · Zbl 0728.76053 |
| [15] | Edeling, W. N.; Cinnella, Pasquale; Dwight, Richard P., Predictive rans simulations via Bayesian model-scenario averaging, J. Comput. Phys., 275, 65-91 (2014) · Zbl 1349.76106 |
| [16] | Edeling, W. N.; Cinnella, Pasquale; Dwight, Richard P.; Bijl, Hester, Bayesian estimates of parameter variability in the k-\(ε\) turbulence model, J. Comput. Phys., 258, 73-94 (2014) · Zbl 1349.76110 |
| [17] | Farrell, Kathryn; Tinsley Oden, J.; Faghihi, Danial, A Bayesian framework for adaptive selection, calibration, and validation of coarse-grained models of atomistic systems, J. Comput. Phys., 295, 189-208 (2015) · Zbl 1349.62078 |
| [18] | Gelman, Andrew; Roberts Walter, Gareth O.; Gilks, R., Efficient metropolis jumping rules, Bayesian Stat., 5, 599-608, 42 (1996) |
| [19] | Gerber, Susanne; Horenko, Illia, Toward a direct and scalable identification of reduced models for categorical processes, Proc. Natl. Acad. Sci., Article 201612619 pp. (2017) · Zbl 1407.62190 |
| [20] | Haario, Heikki; Saksman, Eero; Tamminen, Johanna, An adaptive metropolis algorithm, Bernoulli, 7, 2, 223-242 (2001) · Zbl 0989.65004 |
| [21] | Haario, Heikki; Laine, Marko; Mira, Antonietta; Saksman, Eero, Dram: efficient adaptive mcmc, Stat. Comput., 16, 4, 339-354 (2006) |
| [22] | Jolliffe, Ian, Principal component analysis (2011), Springer |
| [23] | Launder, B. E.; Sharma, B. I., Application of the energy-dissipation model of turbulence to the calculation of flow near a spinning disc, Lett. Heat Mass Transf., 1, 2, 131-137 (1974) |
| [24] | Livescu, Daniel; Ristorcelli, J. R., Buoyancy-driven variable-density turbulence, J. Fluid Mech., 591, 43-71 (2007) · Zbl 1125.76353 |
| [25] | Livescu, Daniel; Ristorcelli, J. R.; Gore, R. A.; Dean, S. H.; Cabot, W. H.; Cook, A. W., High-Reynolds number Rayleigh-Taylor turbulence, J. Turbul., 10, 13 (2009) · Zbl 1273.76142 |
| [26] | Nadiga, Balasubramanya T.; Urban, Nathan M., Improved representation of ocean heat content in energy balance models, Clim. Change, 1-14 (2019) |
| [27] | Nadiga, B. T., Orientation of eddy fluxes in geostrophic turbulence, Philos. Trans. R. Soc. A, Math. Phys. Eng. Sci., 366, 1875, 2489-2508 (2008) · Zbl 1153.86306 |
| [30] | Oliver, Todd A.; Moser, Robert D., Bayesian uncertainty quantification applied to rans turbulence models, J. Phys. Conf. Ser., 318, Article 042032 pp. (2011) |
| [31] | Pande, Vijay S.; Beauchamp, Kyle; Bowman, Gregory R., Everything you wanted to know about Markov state models but were afraid to ask, Methods, 52, 1, 99-105 (2010) |
| [32] | Plant, R. S.; Craig, George C., A stochastic parameterization for deep convection based on equilibrium statistics, J. Atmos. Sci., 65, 1, 87-105 (2008) |
| [33] | Pope, Stephen B., Turbulent Flows (2001) · Zbl 0966.76002 |
| [34] | Roache, Patrick J., Verification and Validation in Computational Science and Engineering (1998), Hermosa |
| [35] | Schmid, Peter J., Dynamic mode decomposition of numerical and experimental data, J. Fluid Mech., 656, 5-28 (2010) · Zbl 1197.76091 |
| [36] | Schütte, Christof; Noé, Frank; Lu, Jianfeng; Sarich, Marco; Vanden-Eijnden, Eric, Markov state models based on milestoning, J. Chem. Phys., 134, 20, Article 05B609 pp. (2011) |
| [37] | Schwarzkopf, J. D.; Livescu, D.; Baltzer, J. R.; Gore, R. A.; Ristorcelli, J. R., A two-length scale turbulence model for single-phase multi-fluid mixing, Flow Turbul. Combust., 96, 1, 1-43 (2016) |
| [38] | Schwarzkopf, John D.; Livescu, Daniel; Gore, Robert A.; Rauenzahn, Rick M.; Ristorcelli, J. Raymond, Application of a second-moment closure model to mixing processes involving multicomponent miscible fluids, J. Turbul., 12, 49 (2011) · Zbl 1273.76146 |
| [39] | Spalart, P. Ra. A.; Allmaras, S., A one-equation turbulence model for aerodynamic flows, (30th Aerospace Sciences Meeting and Exhibit (1992)), 439 |
| [40] | Tierney, Luke; Mira, Antonietta, Some adaptive Monte Carlo methods for Bayesian inference, Stat. Med., 18, 1718, 2507-2515 (1999) |
| [41] | Wang, Zhu; Akhtar, Imran; Borggaard, Jeff; Iliescu, Traian, Proper orthogonal decomposition closure models for turbulent flows: a numerical comparison, Comput. Methods Appl. Mech. Eng., 237, 10-26 (2012) · Zbl 1253.76050 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
