×

Physics-constrained symbolic model discovery for polyconvex incompressible hyperelastic materials. (English) Zbl 07898465

Summary: We present a machine learning framework capable of consistently inferring mathematical expressions of hyperelastic energy functionals for incompressible materials from sparse experimental data and physical laws. To achieve this goal, we propose a polyconvex neural additive model (PNAM) that enables us to express the hyperelastic model in a learnable feature space while enforcing polyconvexity. An upshot of this feature space obtained via the PNAM is that (1) it is spanned by a set of univariate basis functions that can be re-parametrized with a more complex mathematical form, and (2) the resultant elasticity model is guaranteed to fulfill the polyconvexity, which ensures that the acoustic tensor remains elliptic for any deformation. To further improve the interpretability, we use genetic programming to convert each univariate basis into a compact mathematical expression. The resultant multi-variable mathematical models obtained from this proposed framework are not only more interpretable but are also proven to fulfill physical laws. By controlling the compactness of the learned symbolic form, the machine learning-generated mathematical model also requires fewer arithmetic operations than its deep neural network counterparts during deployment. This latter attribute is crucial for scaling large-scale simulations where the constitutive responses of every integration point must be updated within each incremental time step. We compare our proposed model discovery framework against other state-of-the-art alternatives to assess the robustness and efficiency of the training algorithms and examine the trade-off between interpretability, accuracy, and precision of the learned symbolic hyperelastic models obtained from different approaches. Our numerical results suggest that our approach extrapolates well outside the training data regime due to the precise incorporation of physics-based knowledge.
© 2024 John Wiley & Sons, Ltd.

MSC:

74B20 Nonlinear elasticity

References:

[1] KirchdoerferT, OrtizM. Data‐driven computational mechanics. Comput Methods Appl Mech Eng. 2016;304:81‐101. · Zbl 1425.74503
[2] BoyceMC, ArrudaEM. Constitutive models of rubber elasticity: a review. Rubber Chem Technol. 2000;73(3):504‐523.
[3] Yves Le GuennecJ‐P, BrunetF‐ZD, ChauM, TourbierY. A parametric and non‐intrusive reduced order model of car crash simulation. Comput Methods Appl Mech Eng. 2018;338:186‐207. · Zbl 1440.74298
[4] BarbaniD, BaldanziniN, PieriniM. Development and validation of an FE model for motorcycle-car crash test simulations. Int J Crashworthiness. 2014;19(3):244‐263.
[5] GrinspunE, HiraniAN, DesbrunM, SchröderP. Discrete shells. Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Citeseer; 2003:62‐67.
[6] DafaliasYF. Modelling cyclic plasticity; simple versus sophistication. Mechanics of Engineering Materials. John Wiley & Sons; 1984:153‐178.
[7] TruesdellC. Hypo‐elasticity. J Ration Mech Anal. 1955;4:83‐1020. · Zbl 0064.42002
[8] GreenAE. Hypo‐elasticity and plasticity. II. J Ration Mech Anal. 1956;5(5):725‐734. · Zbl 0070.41706
[9] FreedAD, EinsteinDR, SacksMS. Hypoelastic soft tissues: part II: in‐plane biaxial experiments. Acta Mech. 2010;213(1‐2):205‐222. · Zbl 1320.74020
[10] OgdenRW. Non‐linear Elastic Deformations. Courier Corporation; 1997.
[11] HolzapfelGA, GasserTC, OgdenRW. A new constitutive framework for arterial wall mechanics and a comparative study of material models. J Elast Phys Sci Solid. 2000;61:1‐48. · Zbl 1023.74033
[12] MihaiLA, BuddayS, HolzapfelGA, KuhlE, GorielyA. A family of hyperelastic models for human brain tissue. J Mech Phys Solids. 2017;106:60‐79.
[13] MooneyM. A theory of large elastic deformation. J Appl Phys. 1940;11(9):582‐592. · JFM 66.1021.04
[14] RivlinRS, SaundersD. Large elastic deformations of isotropic materials VII. Experiments on the deformation of rubber. Philos Trans R Soc Lond Ser A Math Phys Sci. 1951;243(865):251‐288. · Zbl 0042.42505
[15] VlassisNN, MaR, SunWC. Geometric deep learning for computational mechanics part i: anisotropic hyperelasticity. Comput Methods Appl Mech Eng. 2020;371:113299. · Zbl 1506.74504
[16] LiuM, LiangL, SunW. A generic physics‐informed neural network‐based constitutive model for soft biological tissues. Comput Methods Appl Mech Eng. 2020;372:113402. · Zbl 1506.74207
[17] ThakolkaranP, JoshiA, ZhengY, FlaschelM, De LorenzisL, KumarS. NN‐EUCLID: deep‐learning hyperelasticity without stress data. J Mech Phys Solids. 2022;169:105076.
[18] KleinDK, FernándezM, MartinRJ, NeffP, WeegerO. Polyconvex anisotropic hyperelasticity with neural networks. J Mech Phys Solids. 2022;159:104703.
[19] TacV, CostabalFS, TepoleAB. Data‐driven tissue mechanics with polyconvex neural ordinary differential equations. Comput Methods Appl Mech Eng. 2022;398:115248. · Zbl 1507.74236
[20] FrankelAL, JonesRE, SwilerLP. Tensor basis gaussian process models of hyperelastic materials. J Mach Learn Model Comput. 2020;1(1):1‐17.
[21] FuhgJN, BouklasN. On physics‐informed data‐driven isotropic and anisotropic constitutive models through probabilistic machine learning and space‐filling sampling. Comput Methods Appl Mech Eng. 2022;394:114915. · Zbl 1507.74551
[22] AbdusalamovR, HillgärtnerM, ItskovM. Automatic generation of interpretable hyperelastic material models by symbolic regression. Int J Numer Methods Eng. 2023;124(9):2093‐2104. · Zbl 1532.74014
[23] HornikK, StinchcombeM, WhiteH. Multilayer feedforward networks are universal approximators. Neural Netw. 1989;2(5):359‐366. · Zbl 1383.92015
[24] HsuD, SanfordCH, ServedioR, Vlatakis‐GkaragkounisEV. On the approximation power of two‐layer networks of random ReLUs. Conference on Learning Theory. PMLR; 2021:2423‐2461.
[25] Yuelin ShenK, ChandrashekharaWFB, OliverLR. Neural network based constitutive model for rubber material. Rubber Chem Technol. 2004;77(2):257‐277.
[26] LiangG, ChandrashekharaK. Neural network based constitutive model for elastomeric foams. Eng Struct. 2008;30(7):2002‐2011.
[27] LeBA, YvonnetJ, HeQ‐C. Computational homogenization of nonlinear elastic materials using neural networks. Int J Numer Methods Eng. 2015;104(12):1061‐1084. · Zbl 1352.74266
[28] VlassisNN, SunWC. Sobolev training of thermodynamic‐informed neural networks for interpretable elasto‐plasticity models with level set hardening. Comput Methods Appl Mech Eng. 2021;377:113695. · Zbl 1506.74449
[29] VlassisNN, ZhaoP, MaR, SewellT, SunWC. Molecular dynamics inferred transfer learning models for finite‐strain hyperelasticity of monoclinic crystals: Sobolev training and validations against physical constraints. Int J Numer Methods Eng. 2022;123(17):3922‐3949. · Zbl 1534.74009
[30] FernándezM, FritzenF, WeegerO. Material modeling for parametric, anisotropic finite strain hyperelasticity based on machine learning with application in optimization of metamaterials. Int J Numer Methods Eng. 2022;123(2):577‐609. · Zbl 1526.74055
[31] AgarwalR, MelnickL, FrosstN, et al. Neural additive models: interpretable machine learning with neural nets. 35th h Conference on Advances in Neural Information Processing Systems. 2021:4699‐4711.
[32] BahmaniB, SuhHS, SunWC. Discovering interpretable elastoplasticity models via the neural polynomial method enabled symbolic regressions. arXiv preprint arXiv:2307.13149, 2023.
[33] HartmannS, NeffP. Polyconvexity of generalized polynomial‐type hyperelastic strain energy functions for near‐incompressibility. Int J Solids Struct. 2003;40(11):2767‐2791. · Zbl 1051.74539
[34] TeichertGH, NatarajanAR, Van der VenA, GarikipatiK. Machine learning materials physics: Integrable deep neural networks enable scale bridging by learning free energy functions. Comput Methods Appl Mech Eng. 2019;353:201‐216. · Zbl 1441.82021
[35] MasiF, StefanouI, VannucciP, Maffi‐BerthierV. Thermodynamics‐based artificial neural networks for constitutive modeling. J Mech Phys Solids. 2021;147:104277.
[36] RaissiM, PerdikarisP, KarniadakisGE. Physics‐informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J Comput Phys. 2019;378:686‐707. · Zbl 1415.68175
[37] LagarisIE, LikasA, FotiadisDI. Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw. 1998;9(5):987‐1000.
[38] BronsteinMM, BrunaJ, CohenT, VeličkovićP. Geometric deep learning: grids, groups, graphs, geodesics, and gauges. arXiv preprint arXiv:2104.13478, 2021.
[39] TianheY, KumarS, GuptaA, LevineS, HausmanK, FinnC. Gradient surgery for multi‐task learning. Proceedings of the 34th International Conference on Neural Information Processing Systems. Curran Associates Inc.; 2020:5824‐5836.
[40] BahmaniB, SunWC. Training multi‐objective/multi‐task collocation physics‐informed neural network with student/teachers transfer learnings. arXiv preprint arXiv:2107.11496, 2021.
[41] JinC, KakadeSM, NetrapalliP. Provable efficient online matrix completion via non‐convex stochastic gradient descent. 30th Conference on Neural Information Processing Systems; 2016.
[42] HeiderY, WangK, SunWC. So (3)‐invariance of informed‐graph‐based deep neural network for anisotropic elastoplastic materials. Comput Methods Appl Mech Eng. 2020;363:112875. · Zbl 1436.74012
[43] KailaiX, HuangDZ, DarveE. Learning constitutive relations using symmetric positive definite neural networks. J Comput Phys. 2021;428:110072. · Zbl 07511428
[44] LinkaK, HillgärtnerM, AbdolaziziKP, AydinRC, ItskovM, CyronCJ. Constitutive artificial neural networks: a fast and general approach to predictive data‐driven constitutive modeling by deep learning. J Comput Phys. 2021;429:110010. · Zbl 07500745
[45] As’adF, AveryP, FarhatC. A mechanics‐informed artificial neural network approach in data‐driven constitutive modeling. Int J Numer Methods Eng. 2022;123(12):2738‐2759. · Zbl 1528.74114
[46] ChenP, GuilleminotJ. Polyconvex neural networks for hyperelastic constitutive models: a rectification approach. Mech Res Commun. 2022;125:103993.
[47] CaiC, VlassisN, MageeL, et al. Equivariant geometric learning for digital rock physics: estimating formation factor and effective permeability tensors from morse graph. Int J Multiscale Comput Eng. 2023;21(5):1‐24.
[48] SchröderJ, NeffP. Invariant formulation of hyperelastic transverse isotropy based on polyconvex free energy functions. Int J Solids Struct. 2003;40(2):401‐445. · Zbl 1033.74005
[49] SchröderJ, NeffP, BalzaniD. A variational approach for materially stable anisotropic hyperelasticity. Int J Solids Struct. 2005;42(15):4352‐4371. · Zbl 1119.74321
[50] SchröderJ, NeffP. Poly‐, Quasi‐and Rank‐One Convexity in Applied Mechanics. Vol 516. Springer Science & Business Media; 2010.
[51] BallJM. Does rank‐one convexity imply quasiconvexity? Metastability and Incompletely Posed Problems. Springer; 1987:17‐32. · Zbl 0613.49014
[52] ShiraniM, SteigmannDJ. Convexity and quasiconvexity in a cosserat model for fiber‐reinforced elastic solids. J Elast. 2022;154:555‐567. · Zbl 1529.74012
[53] DayhoffJE, DeLeoJM. Artificial neural networks: opening the black box. Cancer. 2001;91(S8):1615‐1635.
[54] Seong JoonO, SchieleB, FritzM. Towards reverse‐engineering black‐box neural networks. In: SamekW (ed.), MontavonG (ed.), VedaldiA (ed.), HansenL (ed.), MüllerKR (ed.), eds. Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Springer; 2019:121‐144.
[55] VersinoD, TondaA, BronkhorstCA. Data driven modeling of plastic deformation. Comput Methods Appl Mech Eng. 2017;318:981‐1004. · Zbl 1439.74005
[56] BomaritoGF, TownsendTS, StewartKM, EshamKV, EmeryJM, HochhalterJD. Development of interpretable, data‐driven plasticity models with symbolic regression. Comput Struct. 2021;252:106557.
[57] ParkH, ChoM. Multiscale constitutive model using data-driven yield function. Compos Part B Eng. 2021;216:108831.
[58] BruntonSL, ProctorJL, KutzJN. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proc Natl Acad Sci USA. 2016;113(15):3932‐3937. · Zbl 1355.94013
[59] FlaschelM, KumarS, De LorenzisL. Unsupervised discovery of interpretable hyperelastic constitutive laws. Comput Methods Appl Mech Eng. 2021;381:113852. · Zbl 1506.74051
[60] WangZ, EstradaJB, ArrudaEM, GarikipatiK. Inference of deformation mechanisms and constitutive response of soft material surrogates of biological tissue by full‐field characterization and data‐driven variational system identification. J Mech Phys Solids. 2021;153:104474.
[61] LinkaK, KuhlE. A new family of constitutive artificial neural networks towards automated model discovery. Comput Methods Appl Mech Eng. 2023;403:115731. · Zbl 1536.74023
[62] WangM, ChenC, LiuW. Establish algebraic data‐driven constitutive models for elastic solids with a tensorial sparse symbolic regression method and a hybrid feature selection technique. J Mech Phys Solids. 2022;159:104742.
[63] NguyenLTK, KeipM‐A. A data‐driven approach to nonlinear elasticity. Comput Struct. 2018;194:97‐115.
[64] PlatzerA, LeygueA, StainierL, OrtizM. Finite element solver for data‐driven finite strain elasticity. Comput Methods Appl Mech Eng. 2021;379:113756. · Zbl 1506.74430
[65] CrespoJ, LatorreM, MontánsFJ. WYPiWYG hyperelasticity for isotropic, compressible materials. Comput Mech. 2017;59:73‐92. · Zbl 1398.74023
[66] AmoresVJ, BenítezJM, MontánsFJ. Average‐chain behavior of isotropic incompressible polymers obtained from macroscopic experimental data. A simple structure‐based WYPiWYG model in Julia language. Adv Eng Softw. 2019;130:41‐57.
[67] MorenoS, AmoresVJ, BenítezJM, MontánsFJ. Reverse‐engineering and modeling the 3D passive and active responses of skeletal muscle using a data‐driven, non‐parametric, spline‐based procedure. J Mech Behav Biomed Mater. 2020;110:103877.
[68] AkbariR, MorovatiV, DargazanyR. Reverse physically motivated frameworks for investigation of strain energy function in rubber‐like elasticity. Int J Mech Sci. 2022;221:107110.
[69] IbanezR, Abisset‐ChavanneE, AguadoJV, GonzalezD, CuetoE, ChinestaF. A manifold learning approach to data‐driven computational elasticity and inelasticity. Arch Comput Methods Eng. 2018;25:47‐57. · Zbl 1390.74195
[70] HeX, HeQ, ChenJ‐S. Deep autoencoders for physics‐constrained data‐driven nonlinear materials modeling. Comput Methods Appl Mech Eng. 2021;385:114034. · Zbl 1502.74109
[71] GonzálezD, García‐GonzálezA, ChinestaF, CuetoE. A data‐driven learning method for constitutive modeling: application to vascular hyperelastic soft tissues. Materials. 2020;13(10):2319.
[72] BahmaniB, SunWC. Manifold embedding data‐driven mechanics. J Mech Phys Solids. 2022;166:104927.
[73] BahmaniB, SunWC. Distance‐preserving manifold denoising for data‐driven mechanics. Comput Methods Appl Mech Eng. 2023;405:115857. · Zbl 1539.74538
[74] TruesdellC, NollW, TruesdellC, NollW. The Non‐linear Field Theories of Mechanics. Springer; 2004. · Zbl 1068.74002
[75] TruesdellCA. A First Course in Rational Continuum Mechanics V1. Academic Press; 1992.
[76] GurtinME. An Introduction to Continuum Mechanics. Academic Press; 1982.
[77] HolzapfelGA. Nonlinear solid mechanics: a continuum approach for engineering science. Meccanica. 2002;37:489‐490.
[78] HillR. On uniqueness and stability in the theory of finite elastic strain. J Mech Phys Solids. 1957;5(4):229‐241. · Zbl 0080.18004
[79] MarsdenJE, HughesTJR. Mathematical Foundations of Elasticity. Courier Corporation; 1994.
[80] BallJM. Convexity conditions and existence theorems in nonlinear elasticity. Arch Ration Mech Anal. 1976;63:337‐403. · Zbl 0368.73040
[81] BallJM. Strict convexity, strong ellipticity, and regularity in the calculus of variations. Mathematical Proceedings of the Cambridge Philosophical Society. Vol 87. Cambridge University Press; 1980:501‐513. · Zbl 0451.35028
[82] KuhlE, AskesH, SteinmannP. An illustration of the equivalence of the loss of ellipticity conditions in spatial and material settings of hyperelasticity. Eur J Mech A/Solids. 2006;25(2):199‐214. · Zbl 1087.74011
[83] CharlesB, JrM. Quasi‐convexity and the lower semicontinuity of multiple integrals. Pac J Math. 1952;2:25‐53. · Zbl 0046.10803
[84] HogerA. On the determination of residual stress in an elastic body. J Elast. 1986;16(3):303‐324. · Zbl 0616.73033
[85] AmosB, XuL, KolterJZ. Input convex neural networks. International Conference on Machine Learning. PMLR; 2017:146‐155.
[86] KalinaKA, LindenL, BrummundJ, KästnerM. FE ANN: an efficient data‐driven multiscale approach based on physics‐constrained neural networks and automated data mining. Comput Mech. 2023;71(5):827‐851. · Zbl 1517.74090
[87] KingmaDP, BaJ. Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
[88] KozaJR. Genetic programming as a means for programming computers by natural selection. Stat Comput. 1994;4:87‐112.
[89] SchmidtM, LipsonH. Distilling free‐form natural laws from experimental data. Science. 2009;324(5923):81‐85.
[90] WangY, WagnerN, RondinelliJM. Symbolic regression in materials science. MRS Commun. 2019;9(3):793‐805.
[91] PetersenBK, LandajuelaM, MundhenkTN, SantiagoCP, KimSK, KimJT. Deep symbolic regression: recovering mathematical expressions from data via risk‐seeking policy gradients. arXiv preprint arXiv:1912.04871, 2019.
[92] LandajuelaM, PetersenBK, KimS, et al. Discovering symbolic policies with deep reinforcement learning. International Conference on Machine Learning. PMLR; 2021:5979‐5989.
[93] CranmerM. Interpretable machine learning for science with PySR and SymbolicRegression.jl. arXiv preprint arXiv:2305.01582, 2023.
[94] KimS, LuPY, MukherjeeS, et al. Integration of neural network‐based symbolic regression in deep learning for scientific discovery. IEEE Trans Neural Netw Learn Syst. 2020;32(9):4166‐4177.
[95] IckeI, BongardJC. Improving genetic programming based symbolic regression using deterministic machine learning. 2013 IEEE Congress on Evolutionary Computation. IEEE; 2013:1763‐1770.
[96] PaszkeA, GrossS, MassaF, et al. PyTorch: an imperative style, high‐performance deep learning library. Proceedings of the 33rd International Conference on Neural Information Processing Systems. Curran Associates Inc.; 2019:8026‐8037.
[97] TreloarLRG. Stress‐strain data for vulcanized rubber under various types of deformation. Rubber Chem Technol. 1944;17(4):813‐825.
[98] KhajehsaeidH, ArghavaniJ, NaghdabadiR. A hyperelastic constitutive model for rubber‐like materials. Eur J Mech A/Solids. 2013;38:144‐151. · Zbl 1347.74009
[99] ChoH, LeeJ, MoonJ, et al. Large strain micromechanics of thermoplastic elastomers with random microstructures. arXiv preprint arXiv:2308.14607, 2023.
[100] KalinaKA, LindenL, BrummundJ, MetschP, KästnerM. Automated constitutive modeling of isotropic hyperelasticity based on artificial neural networks. Comput Mech. 2022;69:213‐232. · Zbl 07492666
[101] ClevertD‐A, UnterthinerT, HochreiterS. Fast and accurate deep network learning by exponential linear units (ELUs). arXiv preprint arXiv:1511.07289, 2015.
[102] GoodfellowI, BengioY, CourvilleA. Deep Learning. MIT Press; 2016. · Zbl 1373.68009
[103] PedregosaF, VaroquauxG, GramfortA, et al. Scikit‐learn: machine learning in python. J Mach Learn Res. 2011;12:2825‐2830. · Zbl 1280.68189
[104] WeissJA, MakerBN, GovindjeeS. Finite element implementation of incompressible, transversely isotropic hyperelasticity. Comput Methods Appl Mech Eng. 1996;135(1‐2):107‐128. · Zbl 0893.73071
[105] SchröderJ, ViebahnN, WriggersP, AuricchioF, SteegerK. On the stability analysis of hyperelastic boundary value problems using three‐and two‐field mixed finite element formulations. Comput Mech. 2017;60:479‐492. · Zbl 1386.74141
[106] BelytschkoT, LiuWK, MoranB, ElkhodaryK. Nonlinear Finite Elements for Continua and Structures. John Wiley & Sons; 2014.
[107] AlnæsM, BlechtaJ, HakeJ, et al. The FEniCS project version 1.5. Arch Numer Softw. 2015;3(100):9‐23.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.