×
Blühdorn, Johannes; Sagebaum, Max; Gauger, Nicolas

Event-based automatic differentiation of OpenMP with opDiLib. (English) Zbl 07908565

ACM Trans. Math. Softw. 49, No. 1, Article No. 3, 31 p. (2023).

MSC:

65-XX Numerical analysis

Keywords:

algorithmic differentiation; OpenMP; OMPT; high performance computing; AD tool design; reusable software

Software:

ADOL-C; OMPT; OpDiLib; TAPENADE; AutoMat; OpenFOAM
Cite Review PDF
Full Text: DOI arXiv

References:

[1] Auroux, D. and Groza, V.. 2017. Optimal parameters identification and sensitivity study for abrasive waterjet milling model. Inverse Probl. Sci. Eng.25, 11(2017), 1560-1576. DOI:DOI: · Zbl 1444.35161
[2] Bahadır, A. Refik. 2003. A fully implicit finite-difference scheme for two-dimensional Burgers’ equations. Appl. Math. Comput.137, 1(2003), 131-137. DOI:DOI: · Zbl 1027.65111
[3] Baydin, Atılım Günes, Pearlmutter, Barak A., Radul, Alexey Andreyevich, and Siskind, Jeffrey Mark. 2017. Automatic differentiation in machine learning: A survey. J. Mach. Learn. Res.18, 153(2017), 1-43. Retrieved from https://jmlr.org/papers/v18/17-468.html. · Zbl 06982909
[4] Biazar, J. and Aminikhah, H.. 2009. Exact and numerical solutions for non-linear Burger’s equation by VIM. Math. Comput. Modell.49, 7(2009), 1394-1400. DOI:DOI: · Zbl 1165.65395
[5] Bischof, Christian, Guertler, Niels, Kowarz, Andreas, and Walther, Andrea. 2008. Parallel reverse mode automatic differentiation for OpenMP programs with ADOL-C. In Advances in Automatic Differentiation.Bischof, Christian H., Bücker, H. Martin, Hovland, Paul, Naumann, Uwe, and Utke, Jean (Eds.), Springer, Berlin, Germany, 163-173. DOI:DOI: · Zbl 1156.68620
[6] Bücker, H. Martin, Lang, Bruno, Mey, Dieter an, and Bischof, Christian H.. 2001. Bringing together automatic differentiation and OpenMP. In Proceedings of the 15th International Conference on Supercomputing. ACM, New York, NY, 246-251. DOI:DOI:
[7] Bücker, H. Martin, Lang, Bruno, Rasch, Arno, Bischof, Christian H., and Mey, Dieter an. 2002. Explicit loop scheduling in OpenMP for parallel automatic differentiation. In Proceedings of the 16th Annual International Symposium on High Performance Computing Systems and Applications. IEEE, New York, NY, 121-126. DOI:DOI:
[8] Bücker, H. Martin, Rasch, Arno, and Wolf, Andreas. 2004. A class of OpenMP applications involving nested parallelism. In Proceedings of the 2004 ACM Symposium on Applied Computing. ACM, New York, NY, 220-224. DOI:DOI:
[9] Eichenberger, Alexandre E., Mellor-Crummey, John, Schulz, Martin, Wong, Michael, Copty, Nawal, Dietrich, Robert, Liu, Xu, Loh, Eugene, and Lorenz, Daniel. 2013. OMPT: An OpenMP tools application programming interface for performance analysis. In OpenMP in the Era of Low Power Devices and Accelerators.Rendell, Alistair P., Chapman, Barbara M., and Müller, Matthias S. (Eds.), Springer, Berlin, Germany, 171-185. DOI:DOI:
[10] Förster, Michael. 2014. Algorithmic Differentiation of Pragma-Defined Parallel Regions. Springer Vieweg, Wiesbaden, Germany. DOI:DOI:Ph. D. Dissertation. RWTH Aachen University, Aachen, Germany. · Zbl 1304.65002
[11] Giering, Ralf, Kaminski, Thomas, Todling, Ricardo, Errico, Ronald, Gelaro, Ronald, and Winslow, Nathan. 2006. Tangent linear and adjoint versions of NASA/GMAO’s Fortran 90 global weather forecast model. In Automatic Differentiation: Applications, Theory, and Implementations.Bücker, Martin, Corliss, George, Naumann, Uwe, Hovland, Paul, and Norris, Boyana (Eds.), Springer, Berlin, Germany, 275-284. DOI:DOI: · Zbl 1270.86002
[12] Griewank, Andreas and Walther, Andrea. 2008. Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. Vol. 105. SIAM, Philadelphia, PA. DOI:DOI: · Zbl 1159.65026
[13] Günther, Stefanie, Ruthotto, Lars, Schroder, Jacob B., Cyr, Eric C., and Gauger, Nicolas R.. 2020. Layer-parallel training of deep residual neural networks. SIAM J. Math. Data Sci.2, 1(2020), 1-23. DOI:DOI: · Zbl 1508.68306
[14] Hascoët, Laurent and Pascual, Valérie. 2013. The Tapenade automatic differentiation tool: Principles, model, and specification. ACM Trans. Math. Softw.39, 3(2013), 43 pages. DOI:DOI: · Zbl 1295.65026
[15] Heimbach, Patrick, Hill, Chris, and Giering, Ralf. 2002. Automatic generation of efficient adjoint code for a parallel Navier-Stokes solver. In Computational Science.Sloot, Peter M. A., Hoekstra, Alfons G., Tan, C. J. Kenneth, and Dongarra, Jack J. (Eds.), Springer, Berlin, Germany, 1019-1028. DOI:DOI: · Zbl 1331.76003
[16] Heimbach, Patrick, Hill, Chris, and Giering, Ralf. 2005. An efficient exact adjoint of the parallel MIT General Circulation Model, generated via automatic differentiation. Future Gener. Comput. Syst.21, 8(2005), 1356-1371. DOI:DOI:
[17] Hogan, Robin J.. 2014. Fast reverse-mode automatic differentiation using expression templates in C++. ACM Trans. Math. Softw.40, 4(2014), 16 pages. DOI:DOI: · Zbl 1369.65037
[18] Hückelheim, Jan and Hascoët, Laurent. 2022. Source-to-source automatic differentiation of OpenMP parallel loops. ACM Trans. Math. Softw.48, 1(2022), 32 pages. DOI:DOI: · Zbl 07500132
[19] Hückelheim, Jan, Hovland, Paul, Strout, Michelle Mills, and Müller, Jens-Dominik. 2019. Reverse-mode algorithmic differentiation of an OpenMP-parallel compressible flow solver. Int. J. High Perform. Comput. Appl.33, 1(2019), 140-154. DOI:DOI:
[20] Kaler, Tim, Schardl, Tao B., Xie, Brian, Leiserson, Charles E., Chen, Jie, Pareja, Aldo, and Kollias, Georgios. 2021. PARAD: A work-efficient parallel algorithm for reverse-mode automatic differentiation. In Proceedings of the Symposium on Algorithmic Principles of Computer Systems. SIAM, Philadelphia, PA, 144-158. DOI:DOI:
[21] Kowarz, Andreas. 2008. Advanced Concepts for Automatic Differentiation Based on Operator Overloading. . Techn. Univ. Dresden, Dresden, Germany. Retrieved from https://nbn-resolving.org/urn:nbn:de:bsz:14-ds-1206719130404-22306.
[22] Nemili, Anil, Özkaya, Emre, Gauger, Nicolas R., Kramer, Felix, and Thiele, Frank. 2016. Discrete adjoint based optimal active control of separation on a realistic high-lift configuration. In New Results in Numerical and Experimental Fluid Mechanics X. Dillmann, Andreas, Heller, Gerd, Krämer, Ewald, Wagner, Claus, and Breitsamter, Christian (Eds.), Springer, Cham, Switzerland, 237-246. DOI:DOI:
[23] Board, OpenMP Architecture Review. 2005. OpenMP Application Program Interface Version 2.5. (May2005). Retrieved from https://www.openmp.org/wp-content/uploads/spec25.pdf.
[24] Board, OpenMP Architecture Review. 2013. OpenMP Application Program Interface Version 4.0. (July2013). Retrieved from https://www.openmp.org/wp-content/uploads/OpenMP4.0.0.pdf.
[25] Board, OpenMP Architecture Review. 2018. OpenMP Application Programming Interface Version 5.0. (November2018). Retrieved from https://www.openmp.org/wp-content/uploads/OpenMP-API-Specification-5.0.pdf.
[26] Board, OpenMP Architecture Review. 2021. OpenMP Application Programming Interface Version 5.2. (November2021). Retrieved from https://www.openmp.org/wp-content/uploads/OpenMP-API-Specification-5-2.pdf.
[27] Özkaya, Emre and Gauger, Nicolas R.. 2010. Automatic transition from simulation to one-shot shape optimization with Navier-Stokes equations. GAMM-Mitteilungen33, 2(2010), 133-147. DOI:DOI: · Zbl 1342.76068
[28] Protze, Joachim, Cramer, Tim, Convent, Simon, and Müller, Matthias S.. 2019. OMPT-Multiplex: Nesting of OMPT tools. In Tools for High Performance Computing 2017.Niethammer, Christoph, Resch, Michael M., Nagel, Wolfgang E., Brunst, Holger, and Mix, Hartmut (Eds.), Springer, Cham, Switzerland, 73-83. DOI:DOI:
[29] Sagebaum, M., Albring, T., and Gauger, N. R.. 2018. Expression templates for primal value taping in the reverse mode of algorithmic differentiation. Optim. Methods Software33, 4-6(2018), 1207-1231. DOI:DOI: · Zbl 1401.65164
[30] Sagebaum, Max, Albring, Tim, and Gauger, Nicolas R.. 2019. High-performance derivative computations using CoDiPack. ACM Trans. Math. Softw.45, 4(2019), 26 pages. DOI:DOI: · Zbl 1486.65029
[31] Sagebaum, Max, Blühdorn, Johannes, and Gauger, Nicolas R.. 2020. Index Handling and Assign Optimization for Algorithmic Differentiation Reuse Index Managers. (2020). arXiv:2006.12992. Retrieved from https://arxiv.org/abs/2006.12992.
[32] Sagebaum, Max, Gauger, Nicolas R., Naumann, Uwe, Lotz, Johannes, and Leppkes, Klaus. 2013. Algorithmic differentiation of a complex C++ code with underlying libraries, In Proceedings of the 2013 International Conference on Computational Science. Alexandrov, Vassil, Lees, Michael, Krzhizhanovskaya, Valeria, Dongarra, Jack, and Sloot, Peter M. A. (Eds.), 208-217. DOI:
[33] Schanen, Michel, Förster, Michael, Lotz, Johannes, Leppkes, Klaus, and Naumann, Uwe. 2012. Adjoining hybrid parallel code. In Proceedings of the 8th International Conference on Engineering Computational Technology.Topping, B. H. V. (Ed.), Vol. 100, Civil-Comp Press, Kippen, Stirlingshire, UK, 18. DOI:DOI:
[34] Schanen, Michel, Naumann, Uwe, Hascoët, Laurent, and Utke, Jean. 2010. Interpretative adjoints for numerical simulation codes using MPI, In 2010 International Conference on Computational Science. Procedia Comput. Sci.1, 1 (2010), 1825-1833. DOI:DOI:
[35] Schlenkrich, Sebastian, Walther, Andrea, Gauger, Nicolas R., and Heinrich, Ralf. 2008. Differentiating fixed point iterations with ADOL-C: Gradient calculation for fluid dynamics. In Modeling, Simulation and Optimization of Complex Processes. Bock, Hans Georg, Kostina, Ekaterina, Phu, Hoang Xuan, and Rannacher, Rolf (Eds.), Springer, Berlin, Germany, 499-508. DOI:DOI:
[36] Towara, Markus and Naumann, Uwe. 2013. A discrete adjoint model for OpenFOAM, In Proceedings of the 2013 International Conference on Computational Science. Alexandrov, Vassil, Lees, Michael, Krzhizhanovskaya, Valeria, Dongarra, Jack, and Sloot, Peter M. A. (Eds.), 429-438. DOI:
[37] Verstraete, Tom, Müller, Lasse, and Müller, Jens-Dominik. 2017. Adjoint-based design optimisation of an internal cooling channel u-bend for minimised pressure losses. Int. J. Turbomach. Propuls. Power2, 2(2017), 13. DOI:DOI:
[38] Vitale, S., Pini, M., and Colonna, P.. 2020. Multistage turbomachinery design using the discrete adjoint method within the open-source software SU2. Journal Propul. Power36, 3(2020), 465-478. DOI:DOI:
[39] Walther, Andrea. 2009. Getting started with ADOL-C. In Combinatorial Scientific Computing.Naumann, Uwe, Schenk, Olaf, Simon, Horst D., and Toledo, Sivan (Eds.), Vol. 9061, Schloss Dagstuhl - Leibniz-Zentrum für Informatik, Dagstuhl, Germany, 10. Retrieved from https://drops.dagstuhl.de/opus/volltexte/2009/2084.
[40] Zhu, Hongqing, Shu, Huazhong, and Ding, Meiyu. 2010. Numerical solutions of two-dimensional Burgers’ equations by discrete Adomian decomposition method. Comput. Math. Appl.60, 3(2010), 840-848. DOI: · Zbl 1201.65190
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.