-
Strong Coupling of Hydrodynamics and Reactions in Nuclear Statistical Equilibrium for Modeling Convection in Massive Stars
Authors:
Michael Zingale,
Zhi Chen,
Eric T. Johnson,
Max P. Katz,
Alexander Smith Clark
Abstract:
We build on the simplified spectral deferred corrections (SDC) coupling of hydrodynamics and reactions to handle the case of nuclear statistical equilibrium (NSE) and electron/positron captures/decays in the cores of massive stars. Our approach blends a traditional reaction network on the grid with a tabulated NSE state from a very large, O(100) nuclei, network. We demonstrate how to achieve secon…
▽ More
We build on the simplified spectral deferred corrections (SDC) coupling of hydrodynamics and reactions to handle the case of nuclear statistical equilibrium (NSE) and electron/positron captures/decays in the cores of massive stars. Our approach blends a traditional reaction network on the grid with a tabulated NSE state from a very large, O(100) nuclei, network. We demonstrate how to achieve second-order accuracy in the simplified-SDC framework when coupling NSE to hydrodynamics, with the ability to evolve the star on the hydrodynamics timestep. We discuss the application of this method to convection in massive stars leading up to core-collapse. We also show how to initialize the initial convective state from a 1D model in a self-consistent fashion. All of these developments are done in the publicly available Castro simulation code and the entire simulation methodology is fully GPU accelerated.
△ Less
Submitted 22 October, 2024; v1 submitted 21 March, 2024;
originally announced March 2024.
-
An Improved Method for Coupling Hydrodynamics with Astrophysical Reaction Networks
Authors:
M. Zingale,
M. P. Katz,
A. Nonaka,
M. Rasmussen
Abstract:
Reacting astrophysical flows can be challenging to model because of the difficulty in accurately coupling hydrodynamics and reactions. This can be particularly acute during explosive burning or at high temperatures where nuclear statistical equilibrium is established. We develop a new approach based on the ideas of spectral deferred corrections (SDC) coupling of explicit hydrodynamics and stiff re…
▽ More
Reacting astrophysical flows can be challenging to model because of the difficulty in accurately coupling hydrodynamics and reactions. This can be particularly acute during explosive burning or at high temperatures where nuclear statistical equilibrium is established. We develop a new approach based on the ideas of spectral deferred corrections (SDC) coupling of explicit hydrodynamics and stiff reaction sources as an alternative to operator splitting that is simpler than the more comprehensive SDC approach we demonstrated previously. We apply the new method to a double detonation problem with a moderately-sized astrophysical nuclear reaction network and explore the timestep size and reaction network tolerances to show that the simplified-SDC approach provides improved coupling with decreased computational expense compared to traditional Strang operator splitting. This is all done in the framework of the Castro hydrodynamics code, and all algorithm implementations are freely available.
△ Less
Submitted 26 July, 2022; v1 submitted 2 June, 2022;
originally announced June 2022.
-
High-Throughput Virtual Screening of Small Molecule Inhibitors for SARS-CoV-2 Protein Targets with Deep Fusion Models
Authors:
Garrett A. Stevenson,
Derek Jones,
Hyojin Kim,
W. F. Drew Bennett,
Brian J. Bennion,
Monica Borucki,
Feliza Bourguet,
Aidan Epstein,
Magdalena Franco,
Brooke Harmon,
Stewart He,
Max P. Katz,
Daniel Kirshner,
Victoria Lao,
Edmond Y. Lau,
Jacky Lo,
Kevin McLoughlin,
Richard Mosesso,
Deepa K. Murugesh,
Oscar A. Negrete,
Edwin A. Saada,
Brent Segelke,
Maxwell Stefan,
Marisa W. Torres,
Dina Weilhammer
, et al. (7 additional authors not shown)
Abstract:
Structure-based Deep Fusion models were recently shown to outperform several physics- and machine learning-based protein-ligand binding affinity prediction methods. As part of a multi-institutional COVID-19 pandemic response, over 500 million small molecules were computationally screened against four protein structures from the novel coronavirus (SARS-CoV-2), which causes COVID-19. Three enhanceme…
▽ More
Structure-based Deep Fusion models were recently shown to outperform several physics- and machine learning-based protein-ligand binding affinity prediction methods. As part of a multi-institutional COVID-19 pandemic response, over 500 million small molecules were computationally screened against four protein structures from the novel coronavirus (SARS-CoV-2), which causes COVID-19. Three enhancements to Deep Fusion were made in order to evaluate more than 5 billion docked poses on SARS-CoV-2 protein targets. First, the Deep Fusion concept was refined by formulating the architecture as one, coherently backpropagated model (Coherent Fusion) to improve binding-affinity prediction accuracy. Secondly, the model was trained using a distributed, genetic hyper-parameter optimization. Finally, a scalable, high-throughput screening capability was developed to maximize the number of ligands evaluated and expedite the path to experimental evaluation. In this work, we present both the methods developed for machine learning-based high-throughput screening and results from using our computational pipeline to find SARS-CoV-2 inhibitors.
△ Less
Submitted 31 May, 2021; v1 submitted 9 April, 2021;
originally announced April 2021.
-
Practical Effects of Integrating Temperature with Strang Split Reactions
Authors:
M. Zingale,
M. P. Katz,
D. E. Willcox,
A. Harpole
Abstract:
For astrophysical reacting flows, operator splitting is commonly used to couple hydrodynamics and reactions. Each process operates independent of one another, but by staggering the updates in a symmetric fashion (via Strang splitting) second order accuracy in time can be achieved. However, approximations are often made to the reacting system, including the choice of whether or not to integrate tem…
▽ More
For astrophysical reacting flows, operator splitting is commonly used to couple hydrodynamics and reactions. Each process operates independent of one another, but by staggering the updates in a symmetric fashion (via Strang splitting) second order accuracy in time can be achieved. However, approximations are often made to the reacting system, including the choice of whether or not to integrate temperature with the species. Here we demonstrate through a simple convergence test that integrating an energy equation together with reactions achieves the best convergence when modeling reactive flows with Strang splitting. Additionally, second order convergence cannot be achieved without integrating an energy or temperature equation.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Dynamics of Laterally Propagating Flames in X-ray Bursts. II. Realistic Burning & Rotation
Authors:
A. Harpole,
N. M. Ford,
K. Eiden,
M. Zingale,
D. E. Willcox,
Y. Cavecchi,
M. P. Katz
Abstract:
We continue to investigate two-dimensional laterally propagating flames in type I X-ray bursts using fully compressible hydrodynamics simulations. In the current study we relax previous approximations where we artificially boosted the flames. We now use more physically realistic reaction rates, thermal conductivities, and rotation rates, exploring the effects of neutron star rotation rate and ther…
▽ More
We continue to investigate two-dimensional laterally propagating flames in type I X-ray bursts using fully compressible hydrodynamics simulations. In the current study we relax previous approximations where we artificially boosted the flames. We now use more physically realistic reaction rates, thermal conductivities, and rotation rates, exploring the effects of neutron star rotation rate and thermal structure on the flame. We find that at lower rotation rates the flame becomes harder to ignite, whereas at higher rotation rates the nuclear burning is enhanced by increased confinement from the Coriolis force and the flame propagates steadily. At higher crustal temperatures, the flame moves more quickly and accelerates as it propagates through the atmosphere. If the temperature is too high, instead of a flame propagating across the surface the entire atmosphere burns steadily. All of the software used for these simulations is freely available.
△ Less
Submitted 26 March, 2021; v1 submitted 29 January, 2021;
originally announced February 2021.
-
Preparing Nuclear Astrophysics for Exascale
Authors:
Max P. Katz,
Ann Almgren,
Maria Barrios Sazo,
Kiran Eiden,
Kevin Gott,
Alice Harpole,
Jean M. Sexton,
Don E. Willcox,
Weiqun Zhang,
Michael Zingale
Abstract:
Astrophysical explosions such as supernovae are fascinating events that require sophisticated algorithms and substantial computational power to model. Castro and MAESTROeX are nuclear astrophysics codes that simulate thermonuclear fusion in the context of supernovae and X-ray bursts. Examining these nuclear burning processes using high resolution simulations is critical for understanding how these…
▽ More
Astrophysical explosions such as supernovae are fascinating events that require sophisticated algorithms and substantial computational power to model. Castro and MAESTROeX are nuclear astrophysics codes that simulate thermonuclear fusion in the context of supernovae and X-ray bursts. Examining these nuclear burning processes using high resolution simulations is critical for understanding how these astrophysical explosions occur. In this paper we describe the changes that have been made to these codes to transform them from standard MPI + OpenMP codes targeted at petascale CPU-based systems into a form compatible with the pre-exascale systems now online and the exascale systems coming soon. We then discuss what new science is possible to run on systems such as Summit and Perlmutter that could not have been achieved on the previous generation of supercomputers.
△ Less
Submitted 10 July, 2020;
originally announced July 2020.
-
Dynamics of Laterally Propagating Flames in X-ray Bursts. I. Burning Front Structure
Authors:
Kiran Eiden,
Michael Zingale,
Alice Harpole,
Donald Willcox,
Yuri Cavecchi,
Max P. Katz
Abstract:
We investigate the structure of laterally-propagating flames through the highly-stratified burning layer in an X-ray burst. Two-dimensional hydrodynamics simulations of flame propagation are performed through a rotating plane-parallel atmosphere, exploring the structure of the flame. We discuss the approximations needed to capture the length and time scales at play in an X-ray burst and describe t…
▽ More
We investigate the structure of laterally-propagating flames through the highly-stratified burning layer in an X-ray burst. Two-dimensional hydrodynamics simulations of flame propagation are performed through a rotating plane-parallel atmosphere, exploring the structure of the flame. We discuss the approximations needed to capture the length and time scales at play in an X-ray burst and describe the flame acceleration observed. Our studies complement other multidimensional studies of burning in X-ray bursts.
△ Less
Submitted 10 December, 2019;
originally announced December 2019.
-
Modelling low Mach number stellar hydrodynamics with MAESTROeX
Authors:
A. Harpole,
D. Fan,
M. P. Katz,
A. J. Nonaka,
D. E. Willcox,
M. Zingale
Abstract:
Modelling long-time convective flows in the interiors of stars is extremely challenging using conventional compressible hydrodynamics codes due to the acoustic timestep limitation. Many of these flows are in the low Mach number regime, which allows us to exploit the relationship between acoustic and advective time scales to develop a more computationally efficient approach. MAESTROeX is an open so…
▽ More
Modelling long-time convective flows in the interiors of stars is extremely challenging using conventional compressible hydrodynamics codes due to the acoustic timestep limitation. Many of these flows are in the low Mach number regime, which allows us to exploit the relationship between acoustic and advective time scales to develop a more computationally efficient approach. MAESTROeX is an open source low Mach number stellar hydrodynamics code that allows much larger timesteps to be taken, therefore enabling systems to be modelled for much longer periods of time. This is particularly important for the problem of convection in the cores of rotating massive stars prior to core collapse. To fully capture the dynamics, it is necessary to model these systems in three dimensions at high resolution over many rotational periods. We present an overview of MAESTROeX's current capabilities, describe ongoing work to incorporate the effects of rotation and discuss how we are optimising the code to run on GPUs.
△ Less
Submitted 28 October, 2019;
originally announced October 2019.
-
The Castro AMR Simulation Code: Current and Future Developments
Authors:
M. Zingale,
A. S. Almgren,
M. Barrios Sazo,
J. B. Bell,
K. Eiden,
A. Harpole,
M. P. Katz,
A. J. Nonaka,
D. E. Willcox,
W. Zhang
Abstract:
We describe recent developments to the Castro astrophysics simulation code, focusing on new features that enable our simulations of X-ray bursts. Two highlights of Castro's ongoing development are the new integration technique to couple hydrodynamics and reactions to high order and GPU offloading. We discuss how these features will help offset some of the computational expense in X-ray burst model…
▽ More
We describe recent developments to the Castro astrophysics simulation code, focusing on new features that enable our simulations of X-ray bursts. Two highlights of Castro's ongoing development are the new integration technique to couple hydrodynamics and reactions to high order and GPU offloading. We discuss how these features will help offset some of the computational expense in X-ray burst models.
△ Less
Submitted 28 October, 2019;
originally announced October 2019.
-
Improved Coupling of Hydrodynamics and Nuclear Reactions via Spectral Deferred Corrections
Authors:
M. Zingale,
M. P. Katz,
J. B. Bell,
M. L. Minion,
A. J. Nonaka,
W. Zhang
Abstract:
Simulations in stellar astrophysics involve the coupling of hydrodynamics and nuclear reactions under a wide variety of conditions, from simmering convective flows to explosive nucleosynthesis. Numerical techniques such as operator splitting (most notably Strang splitting) are usually employed to couple the physical processes, but this can affect the accuracy of the simulation, particularly when t…
▽ More
Simulations in stellar astrophysics involve the coupling of hydrodynamics and nuclear reactions under a wide variety of conditions, from simmering convective flows to explosive nucleosynthesis. Numerical techniques such as operator splitting (most notably Strang splitting) are usually employed to couple the physical processes, but this can affect the accuracy of the simulation, particularly when the burning is vigorous. Furthermore, Strang splitting does not have a straightforward extension to higher-order integration in time. We present a new temporal integration strategy based on spectral deferred corrections and describe the second- and fourth-order implementations in the open-source, finite-volume, compressible hydrodynamics code Castro. One notable advantage to these schemes is that they combine standard low-order discretizations for individual physical processes in a way that achieves an arbitrarily high order of accuracy. We demonstrate the improved accuracy of the new methods on several test problems of increasing complexity.
△ Less
Submitted 12 October, 2019; v1 submitted 9 August, 2019;
originally announced August 2019.
-
Numerical Stability of Detonations in White Dwarf Simulations
Authors:
Max P. Katz,
Michael Zingale
Abstract:
Some simulations of Type Ia supernovae feature self-consistent thermonuclear detonations. However, these detonations are not meaningful if the simulations are not resolved, so it is important to establish the requirements for achieving a numerically converged detonation. In this study we examine a test detonation problem inspired by collisions of white dwarfs. This test problem demonstrates that a…
▽ More
Some simulations of Type Ia supernovae feature self-consistent thermonuclear detonations. However, these detonations are not meaningful if the simulations are not resolved, so it is important to establish the requirements for achieving a numerically converged detonation. In this study we examine a test detonation problem inspired by collisions of white dwarfs. This test problem demonstrates that achieving a converged thermonuclear ignition requires spatial resolution much finer than 1 km in the burning region. Current computational resource constraints place this stringent resolution requirement out of reach for multi-dimensional supernova simulations. Consequently, contemporary simulations that self-consistently demonstrate detonations are possibly not converged and should be treated with caution.
△ Less
Submitted 3 March, 2019; v1 submitted 28 February, 2019;
originally announced March 2019.
-
Toward Resolved Simulations of Burning Fronts in Thermonuclear X-ray Bursts
Authors:
M. Zingale,
K. Eiden,
Y. Cavecchi,
A. Harpole,
J. B. Bell,
M. Chang,
I. Hawke,
M. P. Katz,
C. M. Malone,
A. J. Nonaka,
D. E. Willcox,
W. Zhang
Abstract:
We discuss the challenges of modeling X-ray bursts in multi-dimensions, review the different calculations done to date, and discuss our new set of ongoing simulations. We also describe algorithmic improvements that may help in the future to offset some of the expense of these simulations, and describe what may be possible with exascale computing.
We discuss the challenges of modeling X-ray bursts in multi-dimensions, review the different calculations done to date, and discuss our new set of ongoing simulations. We also describe algorithmic improvements that may help in the future to offset some of the expense of these simulations, and describe what may be possible with exascale computing.
△ Less
Submitted 8 January, 2019; v1 submitted 10 October, 2018;
originally announced October 2018.
-
Quantification of Incertitude in Black Box Simulation Codes
Authors:
Alan C. Calder,
Melissa M. Hoffman,
Donald E. Willcox,
Maximilian P. Katz,
F. Douglas Swesty,
Scott Ferson
Abstract:
We present early results from a study addressing the question of how one treats the propagation of incertitude, that is, epistemic uncertainty, in input parameters in astrophysical simulations. As an example, we look at the propagation of incertitude in control parameters for stellar winds in MESA stellar evolution simulations. We apply two methods of incertitude propagation, the Cauchy Deviates m…
▽ More
We present early results from a study addressing the question of how one treats the propagation of incertitude, that is, epistemic uncertainty, in input parameters in astrophysical simulations. As an example, we look at the propagation of incertitude in control parameters for stellar winds in MESA stellar evolution simulations. We apply two methods of incertitude propagation, the Cauchy Deviates method and the Quadratic Response Surface method, to quantify the output uncertainty in the final white dwarf mass given a range of values for wind parameters. The methodology we apply is applicable to the problem of propagating input incertitudes through any simulation code treated as a "black box," i.e. a code for which the algorithmic details are either inaccessible or prohibitively complicated. We have made the tools developed for this study freely available to the community.
△ Less
Submitted 24 May, 2018;
originally announced May 2018.
-
Meeting the Challenges of Modeling Astrophysical Thermonuclear Explosions: Castro, Maestro, and the AMReX Astrophysics Suite
Authors:
M. Zingale,
A. S. Almgren,
M. G. Barrios Sazo,
V. E. Beckner,
J. B. Bell,
B. Friesen,
A. M. Jacobs,
M. P. Katz,
C. M. Malone,
A. J. Nonaka,
D. E. Willcox,
W. Zhang
Abstract:
We describe the AMReX suite of astrophysics codes and their application to modeling problems in stellar astrophysics. Maestro is tuned to efficiently model subsonic convective flows while Castro models the highly compressible flows associated with stellar explosions. Both are built on the block-structured adaptive mesh refinement library AMReX. Together, these codes enable a thorough investigation…
▽ More
We describe the AMReX suite of astrophysics codes and their application to modeling problems in stellar astrophysics. Maestro is tuned to efficiently model subsonic convective flows while Castro models the highly compressible flows associated with stellar explosions. Both are built on the block-structured adaptive mesh refinement library AMReX. Together, these codes enable a thorough investigation of stellar phenomena, including Type Ia supernovae and X-ray bursts. We describe these science applications and the approach we are taking to make these codes performant on current and future many-core and GPU-based architectures.
△ Less
Submitted 16 November, 2017;
originally announced November 2017.
-
White Dwarf Mergers on Adaptive Meshes I. Methodology and Code Verification
Authors:
Max P. Katz,
Michael Zingale,
Alan C. Calder,
F. Douglas Swesty,
Ann S. Almgren,
Weiqun Zhang
Abstract:
The Type Ia supernova progenitor problem is one of the most perplexing and exciting problems in astrophysics, requiring detailed numerical modeling to complement observations of these explosions. One possible progenitor that has merited recent theoretical attention is the white dwarf merger scenario, which has the potential to naturally explain many of the observed characteristics of Type Ia super…
▽ More
The Type Ia supernova progenitor problem is one of the most perplexing and exciting problems in astrophysics, requiring detailed numerical modeling to complement observations of these explosions. One possible progenitor that has merited recent theoretical attention is the white dwarf merger scenario, which has the potential to naturally explain many of the observed characteristics of Type Ia supernovae. To date there have been relatively few self-consistent simulations of merging white dwarf systems using mesh-based hydrodynamics. This is the first paper in a series describing simulations of these systems using a hydrodynamics code with adaptive mesh refinement. In this paper we describe our numerical methodology and discuss our implementation in the compressible hydrodynamics code CASTRO, which solves the Euler equations, and the Poisson equation for self-gravity, and couples the gravitational and rotation forces to the hydrodynamics. Standard techniques for coupling gravitation and rotation forces to the hydrodynamics do not adequately conserve the total energy of the system for our problem, but recent advances in the literature allow progress and we discuss our implementation here. We present a set of test problems demonstrating the extent to which our software sufficiently models a system where large amounts of mass are advected on the computational domain over long timescales. Future papers in this series will describe our treatment of the initial conditions of these systems and will examine the early phases of the merger to determine its viability for triggering a thermonuclear detonation.
△ Less
Submitted 19 January, 2016; v1 submitted 18 December, 2015;
originally announced December 2015.
-
On the Piecewise Parabolic Method for Compressible Flow with Stellar Equations of State
Authors:
M. Zingale,
M. P. Katz
Abstract:
The piecewise parabolic method and related schemes are widely used to model stellar flows. Several different methods for extending the validity of these methods to a general equation of state have been proposed over time, but direct comparisons amongst one-another and exact solutions with stellar equations of state are not widely available. We introduce some simple test problems with exact solutio…
▽ More
The piecewise parabolic method and related schemes are widely used to model stellar flows. Several different methods for extending the validity of these methods to a general equation of state have been proposed over time, but direct comparisons amongst one-another and exact solutions with stellar equations of state are not widely available. We introduce some simple test problems with exact solutions run with a popular stellar equation of state and test how two existing codes with different approaches to incorporating general gases perform. The source code for generating the exact solutions is made available.
△ Less
Submitted 8 January, 2015;
originally announced January 2015.
