On architecture and performance of adaptive mesh refinement in an electrostatics particle-in-cell code. (English) Zbl 07678442
Comput. Phys. Commun. 247, Article ID 106912, 18 p. (2020); erratum ibid. 265, Article ID 107980, 1 p. (2021).
Summary: This article presents a hardware architecture independent implementation of an adaptive mesh refinement Poisson solver that is integrated into the electrostatic Particle-In-Cell beam dynamics code OPAL. The Poisson solver is solely based on second generation Trilinos packages to ensure the desired hardware portability. Based on the massively parallel framework AMReX, formerly known as BoxLib, the new adaptive mesh refinement interface provides several refinement policies in order to enable precise large-scale neighbouring bunch simulations in high intensity cyclotrons. The solver is validated with a built-in multigrid solver of AMReX and a test problem with analytical solution. The parallel scalability is presented as well as an example of a neighbouring bunch simulation that covers the scale of the later anticipated physics simulation.
Keywords:
multigrid Poisson solver; adaptive mesh refinement; hardware portability; particle-in-cell; neighbouring bunches; high intensity cyclotronsReferences:
| [1] | Hockney, R. W.; Eastwood, J. W., Computer Simulation Using Particles (1988), Taylor & Francis, Inc.: Taylor & Francis, Inc. Bristol, PA, USA · Zbl 0662.76002 |
| [2] | Adelmann, A.; Locans, U.; Suter, A., Comput. Phys. Comm., 207, 83-90 (2016) |
| [3] | Berger, M. J.; Oliger, J., J. Comput. Phys., 53, 3, 484-512 (1984) · Zbl 0536.65071 |
| [4] | Berger, M.; Colella, P., J. Comput. Phys., 82, 1, 64-84 (1989) · Zbl 0665.76070 |
| [5] | Hittinger, J.; Banks, J., J. Comput. Phys., 241, 118-140 (2013) · Zbl 1349.76339 |
| [6] | Kolobov, V.; Arslanbekov, R., J. Phys. Conf. Ser., 719, 1, 012020 (2016) |
| [7] | Vay, J.-L.; Almgren, A.; Bell, J.; Ge, L.; Grote, D.; Hogan, M.; Kononenko, O.; Lehe, R.; Myers, A.; Ng, C.; Park, J.; Ryne, R.; Shapoval, O.; Thévenet, M.; Zhang, W., Nucl. Instrum. Methods Phys. Res. A (2018) |
| [8] | Trilinos, https://github.com/trilinos/Trilinos, release: 12.14.1, 2019. |
| [9] | Edwards, H. C.; Trott, C. R.; Sunderland, D., J. Parallel Distrib. Comput., 74, 12, 3202-3216 (2014), Domain-Specific Languages and High-Level Frameworks for High-Performance Computing · doi:10.1016/j.jpdc.2014.07.003 |
| [10] | Edwards, H. C.; Sunderland, D.; Porter, V.; Amsler, C.; Mish, S., Sci. Program., 20, 2, 89-114 (2012) · doi:10.3233/SPR-2012-0343 |
| [11] | A. Adelmann, P. Calvo, M. Frey, A. Gsell, U. Locans, C. Metzger-Kraus, N. Neveu, C. Rogers, S. Russell, S. Sheehy, J. Snuverink, D. Winklehner, arXiv e-prints, arXiv:1905.06654, 2019. |
| [12] | AMReX, https://ccse.lbl.gov/AMReX, release: 18.07, 2019. |
| [13] | Martin, D. F., An Adaptive Cell-centered Projection Method for the Incompressible Euler Equations (1998), University of California at Berkeley, (PhD thesis) |
| [14] | Baker, C. G.; Heroux, M. A., Sci. Program., 20, 2, 115-128 (2012) |
| [15] | Bavier, E.; Hoemmen, M.; Rajamanickam, S.; Thornquist, H., Sci. Program., 20 (2012), Issue 3 |
| [16] | L. Berger-Vergiat, C.A. Glusa, J.J. Hu, M. Mayr, A. Prokopenko, C.M. Siefert, R.S. Tuminaro, T.A. Wiesner, MueLu User’s Guide, Technical Report SAND2019-0537, Sandia National Laboratories, 2019. |
| [17] | L. Berger-Vergiat, C.A. Glusa, J.J. Hu, M. Mayr, A. Prokopenko, C.M. Siefert, R.S. Tuminaro, T.A. Wiesner, MueLu multigrid framework,http://trilinos.org/packages/muelu, 2019. |
| [18] | A. Prokopenko, C.M. Siefert, J.J. Hu, M. Hoemmen, A. Klinvex, Ifpack2 User’s Guide 1.0, Technical Report SAND2016-5338, Sandia National Labs, 2016. |
| [19] | Yang, J. J.; Adelmann, A.; Humbel, M.; Seidel, M.; Zhang, T. J., Phys. Rev. ST Accel. Beams, 13, 064201 (2010) |
| [20] | Rizzoglio, V.; Adelmann, A.; Baumgarten, C.; Frey, M.; Gerbershagen, A.; Meer, D.; Schippers, J. M., Phys. Rev. Accel. Beams, 20, 124702 (2017) |
| [21] | Adelmann, A.; Arbenz, P.; Ineichen, Y., J. Comput. Phys., 229, 12, 4554-4566 (2010) · Zbl 1192.78010 |
| [22] | Toggweiler, M.; Adelmann, A.; Arbenz, P.; Yang, J., J. Comput. Phys., 273, 255-267 (2014) · Zbl 1351.81023 |
| [23] | Vay, J. L.; Grote, D. P.; Cohen, R. H.; Friedman, A., Comput. Sci. Discov., 5, 1, 014019 (2012) |
| [24] | Colella, P.; Norgaard, P. C., J. Comput. Phys., 229, 4, 947-957 (2010) · Zbl 1185.82054 |
| [25] | Jackson, J. D., Classical Electrodynamics (1999), John Wiley & Sons, Inc.: John Wiley & Sons, Inc. New York · Zbl 0920.00012 |
| [26] | Turk, M. J.; Smith, B. D.; Oishi, J. S.; Skory, S.; Skillman, S. W.; Abel, T.; Norman, M. L., Astrophys. J. Suppl., 192, 9 (2011) |
| [27] | D.F. Martin, K.L. Cartwright, Solving Poisson’s equation using adaptive mesh refinement, Technical Report UCB/ERL M96/66, Univ. Calif. Berkeley, 1996. |
| [28] | Almgren, A. S.; Bell, J. B.; Colella, P.; Howell, L. H.; Welcome, M. L., J. Comput. Phys., 142, 1, 1-46 (1998) · Zbl 0933.76055 |
| [29] | Alvin, B.; Eli, T., Comm. Pure Appl. Math., 33, 6, 707-725 (1980) · Zbl 0438.35043 |
| [30] | Bayliss, A.; Gunzburger, M.; Turkel, E., SIAM J. Appl. Math., 42, 2, 430-451 (1982) · Zbl 0479.65056 |
| [31] | Khebir, A.; Kouki, A. B.; Mittra, R., IEEE Trans. Microw. Theory Tech., 38, 10, 1427-1432 (1990) |
| [32] | Gordon, R. K.; Fook, S. H., IEEE Trans. Microw. Theory Tech., 41, 8, 1280-1286 (1993) |
| [33] | Biswas, D.; Singh, G.; Kumar, R., Phys. Plasmas, 22, 9, 093119 (2015) |
| [34] | Wangler, T. P.; Crandall, K. R., (Beam Halo in Proton Linac Beams. Beam Halo in Proton Linac Beams, International Linac Conference, vol. 20 (2000)) |
| [35] | CSCS, https://www.cscs.ch/computers/piz-daint/, (visited: 8.10.18), 2018. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
