-
GeantV: Results from the prototype of concurrent vector particle transport simulation in HEP
Authors:
G. Amadio,
A. Ananya,
J. Apostolakis,
M. Bandieramonte,
S. Banerjee,
A. Bhattacharyya,
C. Bianchini,
G. Bitzes,
P. Canal,
F. Carminati,
O. Chaparro-Amaro,
G. Cosmo,
J. C. De Fine Licht,
V. Drogan,
L. Duhem,
D. Elvira,
J. Fuentes,
A. Gheata,
M. Gheata,
M. Gravey,
I. Goulas,
F. Hariri,
S. Y. Jun,
D. Konstantinov,
H. Kumawat
, et al. (17 additional authors not shown)
Abstract:
Full detector simulation was among the largest CPU consumer in all CERN experiment software stacks for the first two runs of the Large Hadron Collider (LHC). In the early 2010's, the projections were that simulation demands would scale linearly with luminosity increase, compensated only partially by an increase of computing resources. The extension of fast simulation approaches to more use cases,…
▽ More
Full detector simulation was among the largest CPU consumer in all CERN experiment software stacks for the first two runs of the Large Hadron Collider (LHC). In the early 2010's, the projections were that simulation demands would scale linearly with luminosity increase, compensated only partially by an increase of computing resources. The extension of fast simulation approaches to more use cases, covering a larger fraction of the simulation budget, is only part of the solution due to intrinsic precision limitations. The remainder corresponds to speeding-up the simulation software by several factors, which is out of reach using simple optimizations on the current code base. In this context, the GeantV R&D project was launched, aiming to redesign the legacy particle transport codes in order to make them benefit from fine-grained parallelism features such as vectorization, but also from increased code and data locality. This paper presents extensively the results and achievements of this R&D, as well as the conclusions and lessons learnt from the beta prototype.
△ Less
Submitted 16 September, 2020; v1 submitted 2 May, 2020;
originally announced May 2020.
-
HEP Software Foundation Community White Paper Working Group - Detector Simulation
Authors:
HEP Software Foundation,
:,
J Apostolakis,
M Asai,
S Banerjee,
R Bianchi,
P Canal,
R Cenci,
J Chapman,
G Corti,
G Cosmo,
S Easo,
L de Oliveira,
A Dotti,
V Elvira,
S Farrell,
L Fields,
K Genser,
A Gheata,
M Gheata,
J Harvey,
F Hariri,
R Hatcher,
K Herner,
M Hildreth
, et al. (40 additional authors not shown)
Abstract:
A working group on detector simulation was formed as part of the high-energy physics (HEP) Software Foundation's initiative to prepare a Community White Paper that describes the main software challenges and opportunities to be faced in the HEP field over the next decade. The working group met over a period of several months in order to review the current status of the Full and Fast simulation appl…
▽ More
A working group on detector simulation was formed as part of the high-energy physics (HEP) Software Foundation's initiative to prepare a Community White Paper that describes the main software challenges and opportunities to be faced in the HEP field over the next decade. The working group met over a period of several months in order to review the current status of the Full and Fast simulation applications of HEP experiments and the improvements that will need to be made in order to meet the goals of future HEP experimental programmes. The scope of the topics covered includes the main components of a HEP simulation application, such as MC truth handling, geometry modeling, particle propagation in materials and fields, physics modeling of the interactions of particles with matter, the treatment of pileup and other backgrounds, as well as signal processing and digitisation. The resulting work programme described in this document focuses on the need to improve both the software performance and the physics of detector simulation. The goals are to increase the accuracy of the physics models and expand their applicability to future physics programmes, while achieving large factors in computing performance gains consistent with projections on available computing resources.
△ Less
Submitted 12 March, 2018;
originally announced March 2018.
-
A Roadmap for HEP Software and Computing R&D for the 2020s
Authors:
Johannes Albrecht,
Antonio Augusto Alves Jr,
Guilherme Amadio,
Giuseppe Andronico,
Nguyen Anh-Ky,
Laurent Aphecetche,
John Apostolakis,
Makoto Asai,
Luca Atzori,
Marian Babik,
Giuseppe Bagliesi,
Marilena Bandieramonte,
Sunanda Banerjee,
Martin Barisits,
Lothar A. T. Bauerdick,
Stefano Belforte,
Douglas Benjamin,
Catrin Bernius,
Wahid Bhimji,
Riccardo Maria Bianchi,
Ian Bird,
Catherine Biscarat,
Jakob Blomer,
Kenneth Bloom,
Tommaso Boccali
, et al. (285 additional authors not shown)
Abstract:
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones. Similarly, it requires commensurate investment in the R&D of software to acquire, manage, process, and analyse the shear amounts of data to be recorded. In planning for…
▽ More
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones. Similarly, it requires commensurate investment in the R&D of software to acquire, manage, process, and analyse the shear amounts of data to be recorded. In planning for the HL-LHC in particular, it is critical that all of the collaborating stakeholders agree on the software goals and priorities, and that the efforts complement each other. In this spirit, this white paper describes the R&D activities required to prepare for this software upgrade.
△ Less
Submitted 19 December, 2018; v1 submitted 18 December, 2017;
originally announced December 2017.
-
A portable platform for accelerated PIC codes and its application to GPUs using OpenACC
Authors:
F. Hariri,
T. M. Tran,
A. Jocksch,
E. Lanti,
J. Progsch,
P. Messmer,
S. Brunner,
G. Gheller,
L. Villard
Abstract:
We present a portable platform, called PIC_ENGINE, for accelerating Particle-In-Cell (PIC) codes on heterogeneous many-core architectures such as Graphic Processing Units (GPUs). The aim of this development is efficient simulations on future exascale systems by allowing different parallelization strategies depending on the application problem and the specific architecture. To this end, this platfo…
▽ More
We present a portable platform, called PIC_ENGINE, for accelerating Particle-In-Cell (PIC) codes on heterogeneous many-core architectures such as Graphic Processing Units (GPUs). The aim of this development is efficient simulations on future exascale systems by allowing different parallelization strategies depending on the application problem and the specific architecture. To this end, this platform contains the basic steps of the PIC algorithm and has been designed as a test bed for different algorithmic options and data structures. Among the architectures that this engine can explore, particular attention is given here to systems equipped with GPUs. The study demonstrates that our portable PIC implementation based on the OpenACC programming model can achieve performance closely matching theoretical predictions. Using the Cray XC30 system, Piz Daint, at the Swiss National Supercomputing Centre (CSCS), we show that PIC_ENGINE running on an NVIDIA Kepler K20X GPU can outperform the one on an Intel Sandybridge 8-core CPU by a factor of 3.4.
△ Less
Submitted 9 March, 2016;
originally announced March 2016.
-
The effect of magnetic islands on ITG turbulence driven transport
Authors:
P. Hill,
F. Hariri,
M. Ottaviani
Abstract:
In this work, we address the question of the influence of magnetic islands on the perpendicular transport due to steady-state ITG turbulence on the energy transport time scale. We demonstrate that turbulence can cross the separatrix and enhance the perpendicular transport across magnetic islands. As the perpendicular transport in the interior of the island sets the critical island size needed for…
▽ More
In this work, we address the question of the influence of magnetic islands on the perpendicular transport due to steady-state ITG turbulence on the energy transport time scale. We demonstrate that turbulence can cross the separatrix and enhance the perpendicular transport across magnetic islands. As the perpendicular transport in the interior of the island sets the critical island size needed for growth of neoclassical tearing modes, this increased transport leads to a critical island size larger than that predicted from considering collisional conductivities, but smaller than that using anomalous effective conductivities.
We find that on Bohm time scales, the turbulence is able to re-establish the temperature gradient across the island for islands widths $w \lesssim λ_{turb}$, the turbulence correlation length. The reduction in the island flattening is estimated by comparison with simulations retaining only the perpendicular temperature and no turbulence. At intermediate island widths, comparable to $λ_{turb}$, turbulence is able to maintain finite temperature gradients across the island.
△ Less
Submitted 5 January, 2015; v1 submitted 19 December, 2014;
originally announced December 2014.
-
Plasma turbulence simulations with X-points using the flux-coordinate independent approach
Authors:
F. Hariri,
P. Hill,
M. Ottaviani,
Y. Sarazin
Abstract:
In this work, the Flux-Coordinate Independent (FCI) approach to plasma turbulence simulations is formulated for the case of generic, static magnetic fields, including those possessing stochastic field lines. It is then demonstrated that FCI is applicable to nonlinear turbulent problems with and without X-point geometry. In particular, by means of simulations with the FENICIA code, it is shown that…
▽ More
In this work, the Flux-Coordinate Independent (FCI) approach to plasma turbulence simulations is formulated for the case of generic, static magnetic fields, including those possessing stochastic field lines. It is then demonstrated that FCI is applicable to nonlinear turbulent problems with and without X-point geometry. In particular, by means of simulations with the FENICIA code, it is shown that the standard features of ITG modes are recovered with reduced toroidal resolution. Finally, ITG turbulence under the influence of a static island is studied on the transport timescale with ITER-like parameters, showing the wide range of applicability of the method.
△ Less
Submitted 9 September, 2014; v1 submitted 8 September, 2014;
originally announced September 2014.
-
A Singularity-Free Coordinate System for X-point Geometries
Authors:
F. Hariri,
P. Hill,
M. Ottaviani,
Y. Sarazin
Abstract:
A Flux Coordinate Independent (FCI) approach for anisotropic systems, not based on magnetic flux coordinates has been introduced in [F. Hariri and M. Ottaviani, Comput. Phys. Commun., 184,2419 (2013)]. In this paper, we show that the approach can tackle magnetic configurations including X-points. Using the code FENICIA, an equilibrium with a magnetic island has been used to show the robustness of…
▽ More
A Flux Coordinate Independent (FCI) approach for anisotropic systems, not based on magnetic flux coordinates has been introduced in [F. Hariri and M. Ottaviani, Comput. Phys. Commun., 184,2419 (2013)]. In this paper, we show that the approach can tackle magnetic configurations including X-points. Using the code FENICIA, an equilibrium with a magnetic island has been used to show the robustness of the FCI approach to cases in which a magnetic separatrix is present in the system, either by design or as a consequence of instabilities. Numerical results are in good agreement with the analytic solutions of the sound-wave propagation problem. Conservation properties are verified. Finally, the critical gain of the FCI approach in situations including the magnetic separatrix with an X-point is demonstrated by a fast convergence of the code with the numerical resolution in the direction of symmetry. The results highlighted in this paper show that the FCI approach should be able to address turbulent transport problems in X-point geometries.
△ Less
Submitted 13 June, 2014;
originally announced June 2014.