Solving parametric PDE problems with artificial neural networks. (English) Zbl 1501.65154
Summary: The curse of dimensionality is commonly encountered in numerical partial differential equations (PDE), especially when uncertainties have to be modelled into the equations as random coefficients. However, very often the variability of physical quantities derived from PDE can be captured by a few features on the space of the coefficient fields. Based on such observation, we propose using neural network to parameterise the physical quantity of interest as a function of input coefficients. The representability of such quantity using a neural network can be justified by viewing the neural network as performing time evolution to find the solutions to the PDE. We further demonstrate the simplicity and accuracy of the approach through notable examples of PDEs in engineering and physics.
MSC:
| 65N99 | Numerical methods for partial differential equations, boundary value problems |
| 68T07 | Artificial neural networks and deep learning |
| 35R60 | PDEs with randomness, stochastic partial differential equations |
References:
| [1] | Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, J., Levenberg, M., Mane, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Viegas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y. & Zheng, X. (2016) Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467. |
| [2] | Carleo, G. & Troyer, M. (2017) Solving the quantum many-body problem with artificial neural networks. Science355(6325), 602-606. · Zbl 1404.81313 |
| [3] | Cheng, M., Hou, T. Y., Yan, M. & Zhang, Z. (2013) A data-driven stochastic method for elliptic PDEs with random coefficients. SIAM/ASA J. Uncertainty Quant.1(1), 452-493. · Zbl 1290.60068 |
| [4] | Chollet, F. (2017) Keras (2015). http://keras.io. |
| [5] | Dozat, T. (2016) Incorporating Nesterov momentum into ADAM. In: Proceedings of the ICLR Workshop. |
| [6] | Han, J., Jentzen, A. & Weinan, E. (2017) Overcoming the curse of dimensionality: solving high-dimensional partial differential equations using deep learning. arXiv preprint arXiv:1707.02568. |
| [7] | He, K., Zhang, X., Ren, S. & Sun, J. (2016) Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778. |
| [8] | Hinton, G. E. & Salakhutdinov, R. R. (2006) Reducing the dimensionality of data with neural networks. Science313(5786), 504-507. · Zbl 1226.68083 |
| [9] | Khoo, Y., Lu, J. & Ying, L. (2018) Solving for high dimensional committor functions using artificial neural networks. arXiv preprint arXiv:1802.10275. · Zbl 1498.60222 |
| [10] | Lagaris, I. E., Likas, A. & Fotiadis, D. I. (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans. Neural Networks9(5), 987-1000. |
| [11] | Lecun, Y., Bengio, Y. & Hinton, G. (2015) Deep learning. Nature521(7553), 436-444. |
| [12] | Long, Z., Lu, Y., Ma, X. & Dong, B. (2017) PDE-net: learning PDEs from data. arXiv preprint arXiv:1710.09668. |
| [13] | Matthies, H. G. & Keese, A. (2005) Galerkin methods for linear and nonlinear elliptic stochastic partial differential equations. Comput. Methods Appl. Mecha. Eng.194(12), 1295-1331. · Zbl 1088.65002 |
| [14] | Rudd, K. & Ferrari, S. (2015) A constrained integration (CINT) approach to solving partial differential equations using artificial neural networks. Neurocomputing155, 277-285. |
| [15] | Schmidhuber, J. (2015) Deep learning in neural networks: an overview. Neural Networks61, 85-117. |
| [16] | Stefanou, G. (2009) The stochastic finite element method: past, present and future. Comput. Methods Appl. Mecha. Eng.198(9), 1031-1051. · Zbl 1229.74140 |
| [17] | Torlai, G. & Melko, R. G. (2016) Learning thermodynamics with Boltzmann machines. Phys. Rev. B94(16), 165134. |
| [18] | Wiener, N. (1938) The homogeneous chaos. Am. J. Math.60(4), 897-936. · JFM 64.0887.02 |
| [19] | Xiu, D. & Karniadakis, G. E. (2002) The Wiener-Askey polynomial chaos for stochastic differential equations. SIAM J. Sci. Comput.24(2), 619-644. · Zbl 1014.65004 |
| [20] | Xu, J. & Zikatanov, L. (2017) Algebraic multigrid methods. Acta Numerica26, 591-721. · Zbl 1378.65182 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
