Showing 1–50 of 87 results for author: Schmidt, V

Stochastic 3D reconstruction of cracked polycrystalline NMC particles using 2D SEM data

Authors: Philipp Rieder, Orkun Furat, Francois L. E. Usseglio-Viretta, Jeffery Allen, Peter J. Weddle, Donal P. Finegan, Kandler Smith, Volker Schmidt

Abstract: Li-ion battery performance is strongly influenced by their cathodes' properties and consequently by the 3D microstructure of the particles the cathodes are comprised of. During calendaring and cycling, cracks develop within cathode particles, which may affect performance in multiple ways. On the one hand, cracks reduce internal connectivity such that electron transport within cathode particles is… ▽ More Li-ion battery performance is strongly influenced by their cathodes' properties and consequently by the 3D microstructure of the particles the cathodes are comprised of. During calendaring and cycling, cracks develop within cathode particles, which may affect performance in multiple ways. On the one hand, cracks reduce internal connectivity such that electron transport within cathode particles is hindered. On the other hand, intra-particle cracks can increase the cathode reactive surface. Due to these contradictory effects, it is necessary to quantitatively investigate how battery cycling effects cracking and how cracking in-turn influences battery performance. Thus, it is necessary to characterize the 3D particle morphology with structural descriptors and quantitatively correlate them with effective battery properties. Typically, 3D structural characterization is performed using image data. However, informative 3D imaging techniques are time-consuming, costly and rarely available, such that analyses often have to rely on 2D image data. This paper presents a novel stereological approach for generating virtual 3D cathode particles that exhibit crack networks that are statistically equivalent to those observed in 2D sections of experimentally measured particles. Consequently, more easily available 2D image data suffices for deriving a full 3D characterization of cracked cathodes particles. In future research, the virtually generated 3D particles will be used as geometry input for spatially resolved electro-chemo-mechanical simulations, to enhance our understanding of structure-property relationships of cathodes in Li-ion batteries. △ Less

Submitted 15 October, 2024; originally announced October 2024.

Is deeper always better? Replacing linear mappings with deep learning networks in the Discriminative Lexicon Model

Authors: Maria Heitmeier, Valeria Schmidt, Hendrik P. A. Lensch, R. Harald Baayen

Abstract: Recently, deep learning models have increasingly been used in cognitive modelling of language. This study asks whether deep learning can help us to better understand the learning problem that needs to be solved by speakers, above and beyond linear methods. We utilise the Discriminative Lexicon Model (DLM, Baayen et al., 2019), which models comprehension and production with mappings between numeric… ▽ More Recently, deep learning models have increasingly been used in cognitive modelling of language. This study asks whether deep learning can help us to better understand the learning problem that needs to be solved by speakers, above and beyond linear methods. We utilise the Discriminative Lexicon Model (DLM, Baayen et al., 2019), which models comprehension and production with mappings between numeric form and meaning vectors. While so far, these mappings have been linear (Linear Discriminative Learning, LDL), in the present study we replace them with deep dense neural networks (Deep Discriminative Learning, DDL). We find that DDL affords more accurate mappings for large and diverse datasets from English and Dutch, but not necessarily for Estonian and Taiwan Mandarin. DDL outperforms LDL in particular for words with pseudo-morphological structure such as slend+er. Applied to average reaction times, we find that DDL is outperformed by frequency-informed linear mappings (FIL). However, DDL trained in a frequency-informed way ('frequency-informed' deep learning, FIDDL) substantially outperforms FIL. Finally, while linear mappings can very effectively be updated from trial-to-trial to model incremental lexical learning (Heitmeier et al., 2023), deep mappings cannot do so as effectively. At present, both linear and deep mappings are informative for understanding language. △ Less

Submitted 5 October, 2024; originally announced October 2024.

Comments: 17 pages, 6 figures

Data-driven stochastic 3D modeling of the nanoporous binder-conductive additive phase in battery cathodes

Authors: Phillip Gräfensteiner, Markus Osenberg, André Hilger, Nicole Bohn, Joachim R. Binder, Ingo Manke, Volker Schmidt, Matthias Neumann

Abstract: A stochastic 3D modeling approach for the nanoporous binder-conductive additive phase in hierarchically structured cathodes of lithium-ion batteries is presented. The binder-conductive additive phase of these electrodes consists of carbon black, polyvinylidene difluoride binder and graphite particles. For its stochastic 3D modeling, a three-step procedure based on methods from stochastic geometry… ▽ More A stochastic 3D modeling approach for the nanoporous binder-conductive additive phase in hierarchically structured cathodes of lithium-ion batteries is presented. The binder-conductive additive phase of these electrodes consists of carbon black, polyvinylidene difluoride binder and graphite particles. For its stochastic 3D modeling, a three-step procedure based on methods from stochastic geometry is used. First, the graphite particles are described by a Boolean model with ellipsoidal grains. Second, the mixture of carbon black and binder is modeled by an excursion set of a Gaussian random field in the complement of the graphite particles. Third, large pore regions within the mixture of carbon black and binder are described by a Boolean model with spherical grains. The model parameters are calibrated to 3D image data of cathodes in lithium-ion batteries acquired by focused ion beam scanning electron microscopy. Subsequently, model validation is performed by comparing model realizations with measured image data in terms of various morphological descriptors that are not used for model fitting. Finally, we use the stochastic 3D model for predictive simulations, where we generate virtual, yet realistic, image data of nanoporous binder-conductive additives with varying amounts of graphite particles. Based on these virtual nanostructures, we can investigate structure-property relationships. In particular, we quantitatively study the influence of graphite particles on effective transport properties in the nanoporous binder-conductive additive phase, which have a crucial impact on electrochemical processes in the cathode and thus on the performance of battery cells. △ Less

Submitted 17 September, 2024; originally announced September 2024.

MSC Class: 62H11 (Primary) 62M40; 68U10 (Secondary)

Dissociative recombination of rotationally cold ArH$^+$

Authors: Ábel Kálosi, Manfred Grieser, Leonard W. Isberner, Holger Kreckel, Åsa Larson, David A. Neufeld, Ann E. Orel, Daniel Paul, Daniel W. Savin, Stefan Schippers, Viviane C. Schmidt, Andreas Wolf, Mark G. Wolfire, Oldřich Novotný

Abstract: We have experimentally studied dissociative recombination (DR) of electronically and vibrationally relaxed ArH$^+$ in its lowest rotational levels, using an electron--ion merged-beams setup at the Cryogenic Storage Ring. We report measurements for the merged-beams rate coefficient of ArH$^+$ and compare it to published experimental and theoretical results. In addition, by measuring the kinetic ene… ▽ More We have experimentally studied dissociative recombination (DR) of electronically and vibrationally relaxed ArH$^+$ in its lowest rotational levels, using an electron--ion merged-beams setup at the Cryogenic Storage Ring. We report measurements for the merged-beams rate coefficient of ArH$^+$ and compare it to published experimental and theoretical results. In addition, by measuring the kinetic energy released to the DR fragments, we have determined the internal state of the DR products after dissociation. At low collision energies, we find that the atomic products are in their respective ground states, which are only accessible via non-adiabatic couplings to neutral Rydberg states. Published theoretical results for ArH$^+$ have not included this DR pathway. From our measurements, we have also derived a kinetic temperature rate coefficient for use in astrochemical models. △ Less

Submitted 13 August, 2024; originally announced August 2024.

Comments: Main paper: PDFLaTeX with 12 pages, 7 figures, 1 table. Appendix starting on page 12: PDFLaTeX with 10 pages, 4 figures, 2 tables. This is the Accepted Manuscript version of an article accepted for publication in the Physical Review A

A length-scale insensitive cohesive phase-field interface model: application to concurrent bulk and interface fracture simulation in Lithium-ion battery materials

Authors: Wan-Xin Chen, Xiang-Long Peng, Jian-Ying Wu, Orkun Furat, Volker Schmidt, Bai-Xiang Xu

Abstract: A new cohesive phase-field (CPF) interface fracture model is proposed on the basis of the Euler-Lagrange equation of the phase-field theory and the interface fracture energy check w.r.t. that of the cohesive zone model. It employs an exponential function for the interpolation of fracture energy between the bulk phase and the interface, while the effective interface fracture energy $\tilde{G}_i$ is… ▽ More A new cohesive phase-field (CPF) interface fracture model is proposed on the basis of the Euler-Lagrange equation of the phase-field theory and the interface fracture energy check w.r.t. that of the cohesive zone model. It employs an exponential function for the interpolation of fracture energy between the bulk phase and the interface, while the effective interface fracture energy $\tilde{G}_i$ is derived in such a way that the integrated phase-field fracture energy across the diffusive interface region remains consistent with the sharp interface fracture energy $G_i$ defined in the classical cohesive zone model. This consistency is the key to ensure that the numerical results remain insensitive to the choice of length-scale parameters, particularly the regularized interface thickness $L$ and the regularized fracture surface thickness $b$. By employing this energy consistency check, various CPF interface models in the literature are reviewed. Besides the length-scale insensitivity, the proposed CPF interface model offers further advantages. Thanks to the fact that the exponential interpolation function can be obtained conveniently from the relaxation solution of an Allen-Cahn equation, the proposed CPF model is advantageous over other models with high flexibility in handling structures containing complicated interface topology. In order to demonstrate this merit and to check the length-scale insensitivity in multiphysics context, the proposed CPF interface model is employed further to derive a thermodynamically consistent chemo-mechanical model relevant to Lithium-ion battery materials. Finite element simulation results of the concurrent bulk and interface fracture in polycrystalline electrode particles, reconstructed from images with segmented interfaces, confirm the expected computational advantages and the length-scale insensitivity in chemo-mechanical context. △ Less

Submitted 24 July, 2024; originally announced July 2024.

Improving Molecular Modeling with Geometric GNNs: an Empirical Study

Authors: Ali Ramlaoui, Théo Saulus, Basile Terver, Victor Schmidt, David Rolnick, Fragkiskos D. Malliaros, Alexandre Duval

Abstract: Rapid advancements in machine learning (ML) are transforming materials science by significantly speeding up material property calculations. However, the proliferation of ML approaches has made it challenging for scientists to keep up with the most promising techniques. This paper presents an empirical study on Geometric Graph Neural Networks for 3D atomic systems, focusing on the impact of differe… ▽ More Rapid advancements in machine learning (ML) are transforming materials science by significantly speeding up material property calculations. However, the proliferation of ML approaches has made it challenging for scientists to keep up with the most promising techniques. This paper presents an empirical study on Geometric Graph Neural Networks for 3D atomic systems, focusing on the impact of different (1) canonicalization methods, (2) graph creation strategies, and (3) auxiliary tasks, on performance, scalability and symmetry enforcement. Our findings and insights aim to guide researchers in selecting optimal modeling components for molecular modeling tasks. △ Less

Submitted 11 July, 2024; originally announced July 2024.

Generating multi-scale NMC particles with radial grain architectures using spatial stochastics and GANs

Authors: Lukas Fuchs, Orkun Furat, Donal P. Finegan, Jeffery Allen, Francois L. E. Usseglio-Viretta, Bertan Ozdogru, Peter J. Weddle, Kandler Smith, Volker Schmidt

Abstract: Understanding structure-property relationships of Li-ion battery cathodes is crucial for optimizing rate-performance and cycle-life resilience. However, correlating the morphology of cathode particles, such as in NMC811, and their inner grain architecture with electrode performance is challenging, particularly, due to the significant length-scale difference between grain and particle sizes. Experi… ▽ More Understanding structure-property relationships of Li-ion battery cathodes is crucial for optimizing rate-performance and cycle-life resilience. However, correlating the morphology of cathode particles, such as in NMC811, and their inner grain architecture with electrode performance is challenging, particularly, due to the significant length-scale difference between grain and particle sizes. Experimentally, it is currently not feasible to image such a high number of particles with full granular detail to achieve representivity. A second challenge is that sufficiently high-resolution 3D imaging techniques remain expensive and are sparsely available at research institutions. To address these challenges, a stereological generative adversarial network (GAN)-based model fitting approach is presented that can generate representative 3D information from 2D data, enabling characterization of materials in 3D using cost-effective 2D data. Once calibrated, this multi-scale model is able to rapidly generate virtual cathode particles that are statistically similar to experimental data, and thus is suitable for virtual characterization and materials testing through numerical simulations. A large dataset of simulated particles with inner grain architecture has been made publicly available. △ Less

Submitted 19 July, 2024; v1 submitted 7 July, 2024; originally announced July 2024.

The role of the Silberstein/Thomas/Wigner-rotation in the rod and slit paradox

Authors: Mads Vestergaard Schmidt, Erich Schoedl

Abstract: The rod and slit paradox, as first proposed by R. Shaw, is revisited. In this paradox, a rod of rest length $l_0$ moves parallel to the horizontal x-axis. Simultaneously, a thin sheet parallel to the horizontal xz-plane with a rod-shaped slit of rest length $d < l_0$ moves along the vertical y-axis. The rod passes through the slit due to relativistic effects. Earlier papers do not link the thought… ▽ More The rod and slit paradox, as first proposed by R. Shaw, is revisited. In this paradox, a rod of rest length $l_0$ moves parallel to the horizontal x-axis. Simultaneously, a thin sheet parallel to the horizontal xz-plane with a rod-shaped slit of rest length $d < l_0$ moves along the vertical y-axis. The rod passes through the slit due to relativistic effects. Earlier papers do not link the thought experiment to the Silberstein/Thomas/Wigner-rotation (STW-rotation), which is essential to its outcome. In this paper the role of the STW-rotation is discussed, and additional clarifying figures are provided. Some misleading aspects of earlier treatments are pointed out and corrected. △ Less

Submitted 17 May, 2024; originally announced May 2024.

Autodetachment of diatomic carbon anions from long-lived high-rotation quartet states

Authors: Viviane C. Schmidt, Roman Čurík, Milan Ončák, Klaus Blaum, Sebastian George, Jürgen Göck, Manfred Grieser, Florian Grussie, Robert von Hahn, Claude Krantz, Holger Kreckel, Oldřich Novotný, Kaija Spruck, Andreas Wolf

Abstract: Highly excited C$_2{}^{-}$ ions prominently feature electron detachment at a mean decay time near 3 milliseconds with hitherto unexplained origin. Considering various sources of unimolecular decay, we attribute the signal to the electronic C$^4Σ^+_u$ state. Quartet C$_2{}^{-}$ levels are found to be stabilized against autodetachment by high rotation. Time constants of their rotationally assisted a… ▽ More Highly excited C$_2{}^{-}$ ions prominently feature electron detachment at a mean decay time near 3 milliseconds with hitherto unexplained origin. Considering various sources of unimolecular decay, we attribute the signal to the electronic C$^4Σ^+_u$ state. Quartet C$_2{}^{-}$ levels are found to be stabilized against autodetachment by high rotation. Time constants of their rotationally assisted autodetachment into levels opening energetically at lower rotation are calculated by a theory based on the non-local resonance model. For some final levels of significantly less rotation the results conclusively explain the puzzling observations. △ Less

Submitted 17 September, 2024; v1 submitted 10 May, 2024; originally announced May 2024.

Comments: This is a letter of a joint submission aimed to Phys. Rev. Lett. with a companion paper in Phys. Rev. A. The title of the companion paper is: "Unimolecular processes in diatomic carbon anions at high rotational excitation"; Updated version (09/2024): Minor revisions, results unchanged

Unimolecular processes in diatomic carbon anions at high rotational excitation

Authors: Viviane C. Schmidt, Roman Čurík, Milan Ončák, Klaus Blaum, Sebastian George, Jürgen Göck, Manfred Grieser, Florian Grussie, Robert von Hahn, Claude Krantz, Holger Kreckel, Oldřich Novotný, Kaija Spruck, Andreas Wolf

Abstract: On the millisecond to second time scale, stored beams of diatomic carbon anions C$_2{}^-$ from a sputter ion source feature unimolecular decay of yet unexplained origin by electron emission and fragmentation. To account for the magnitude and time dependence of the experimental rates, levels with high rotational and vibrational excitation are modeled for the lowest electronic states of C$_2{}^-$, a… ▽ More On the millisecond to second time scale, stored beams of diatomic carbon anions C$_2{}^-$ from a sputter ion source feature unimolecular decay of yet unexplained origin by electron emission and fragmentation. To account for the magnitude and time dependence of the experimental rates, levels with high rotational and vibrational excitation are modeled for the lowest electronic states of C$_2{}^-$, also including the lowest quartet potential. Energies, spontaneous radiative decay rates (including spin-forbidden quartet-level decay), and tunneling dissociation rates are determined for a large number of highly excited C$_2{}^-$ levels and their population in sputter-type ion sources is considered. For the quartet levels, the stability against autodetachment is addressed and recently calculated rates of rotationally assisted autodetachment are applied. Non-adiabatic vibrational autodetachment rates of high vibrational levels in the doublet C$_2{}^-$ ground potential are also calculated. The results are combined to model the experimental unimolecular decay signals. Comparison of the modeled to the experimental rates measured at the Croygenic Storage Ring (CSR) gives strong evidence that C$_2{}^-$ ions in quasi-stable levels of the quartet electronic states are the so far unidentified source of unimolecular decay. △ Less

Submitted 17 September, 2024; v1 submitted 10 May, 2024; originally announced May 2024.

Comments: This is a longer and detailed paper of a joint submission aimed to Phys. Rev. A with a companion letter in Phys. Rev. Lett.. The title of the companion paper is: "Autodetachment of diatomic carbon anions from long-lived high-rotation quartet states"; Updated version: Minor revisions, results unchanged

Generating Synthetic Rainfall Fields by R-vine Copulas Applied to Seamless Probabilistic Predictions

Authors: Peter Schaumann, Martin Rempel, Ulrich Blahak, Volker Schmidt

Abstract: Many post-processing methods improve forecasts at individual locations but remove their correlation structure, which is crucial for predicting larger-scale events like total precipitation amount over areas such as river catchments that are relevant for weather warnings and flood predictions. We propose a method to reintroduce spatial correlation into a post-processed forecast using an R-vine copul… ▽ More Many post-processing methods improve forecasts at individual locations but remove their correlation structure, which is crucial for predicting larger-scale events like total precipitation amount over areas such as river catchments that are relevant for weather warnings and flood predictions. We propose a method to reintroduce spatial correlation into a post-processed forecast using an R-vine copula fitted to historical observations. This method works similarly to related approaches like the Schaake shuffle and ensemble copula coupling, i.e., by rearranging predictions at individual locations and reintroducing spatial correlation while maintaining the post-processed marginal distribution. Here, the copula measures how well an arrangement compares with the historical distribution of precipitation. No close relationship is needed between the post-processed marginal distributions and the spatial correlation source. This is an advantage compared to Schaake shuffle and ensemble copula coupling, which rely on a ranking with no ties at each considered location in their source for spatial correlations. However, weather variables such as the precipitation amount, whose distribution has an atom at zero, have rankings with ties. To evaluate the proposed method, it is applied to a precipitation forecast produced by a combination model with two input forecasts that deliver calibrated marginal distributions but without spatial correlations. The obtained results indicate that the calibration of the combination model carries over to the output of the proposed model, i.e., the evaluation of area predictions shows a similar improvement in forecast quality as the predictions for individual locations. Additionally, the spatial correlation of the forecast is evaluated with the help of object-based metrics, for which the proposed model also shows an improvement compared to both input forecasts. △ Less

Submitted 20 April, 2024; originally announced April 2024.

Journal ref: Quarterly Journal of the Royal Meteorological Society, 150(762), 3078-3098 (2024)

Effect of crystallographic twins on the elastoplastic response of polycrystals

Authors: Lucas Monteiro Fernandes, Philipp Rieder, Matthias Neumann, Aude Mulard, Henry Proudhon, Volker Schmidt, François Willot

Abstract: We investigate the influence of crystallographic twins on the elastoplastic response of $γ$-TiAl intermetallics via full-field FFT-based computations. We first introduce a hierarchical stochastic model, which is used to simulate synthetic polycrystalline microstructures containing twin grains with certain morphologies, and apply it to generate representative volume elements. Second, we develop a F… ▽ More We investigate the influence of crystallographic twins on the elastoplastic response of $γ$-TiAl intermetallics via full-field FFT-based computations. We first introduce a hierarchical stochastic model, which is used to simulate synthetic polycrystalline microstructures containing twin grains with certain morphologies, and apply it to generate representative volume elements. Second, we develop a Fourier-based method with regularization for solving the effective and local mechanical response of polycrystalline media using the Méric-Cailletaud crystal plasticity constitutive law. Numerical results show that, across configurations of twinning, the corresponding average effective response is similar. Although differences were quantified, the effect of twins on the yield stress is negligible in practice (less than $1\%$). △ Less

Submitted 15 February, 2024; originally announced February 2024.

Virtual reassembling of 3D fragments for the data-driven analysis of fracture mechanisms in composite materials

Authors: Thomas Wilhelm, Trang Thu Võ, Orkun Furat, Urs A. Peuker, Volker Schmidt

Abstract: This paper introduces a novel method for characterizing fracture mechanisms in composite materials using 3D image data gained by computed tomography (CT) measurements. In mineral liberation, the understanding of these mechanisms is crucial, particularly whether fractures occur along the boundaries of mineral phases (intergranular fracture) and/or within mineral phases (transgranular fracture). Con… ▽ More This paper introduces a novel method for characterizing fracture mechanisms in composite materials using 3D image data gained by computed tomography (CT) measurements. In mineral liberation, the understanding of these mechanisms is crucial, particularly whether fractures occur along the boundaries of mineral phases (intergranular fracture) and/or within mineral phases (transgranular fracture). Conventional techniques for analyzing fracture mechanisms are focused on globally comparing the surface exposure of mineral phases extracted from image measurements before and after fracture. Instead, we present a virtual reassembling algorithm based on image registration techniques, which is applied to 3D data of composite materials before and after fracture in order to determine and characterize the individual fracture surfaces. This enables us to conduct a local quantitative analysis of fracture mechanisms by voxelwise comparing adjacent regions at fracture surfaces. A quantitative analysis of fracture mechanisms is especially important in the context of geometallurgical recycling processes. As primary deposits are decreasing worldwide, the focus is shifting to secondary raw materials containing low concentrations of valuable elements such as lithium. To extract these elements, they can be enriched as engineered artificial minerals in the slag phase of appropriately designed cooling processes. The subsequent liberation through comminution processes, such as crushing, is essential for the extraction of valuable minerals. A better understanding of crushing processes, especially fracture mechanisms in slags, is crucial for the success of recycling. The reassembling algorithm presented in this paper is evaluated through a simulation study, followed by an application to a naturally occurring ore and a slag resulting from a recycling process. △ Less

Submitted 11 February, 2024; originally announced February 2024.

Investigating the influence of particle size and shape on froth flotation based benefication of lithium-rich minerals in slags

Authors: Franziska Strube, Thomas Wilhelm, Johanna Sygusch, Bradley M. Guy, Orkun Furat, Volker Schmidt, Martin Rudolph

Abstract: The demand for lithium, as well as other critical resources, needed for electrochemical energy storage is expected to grow significantly in the future. Slags obtained from pyrometallurgical recycling represent a promising resource of valuable materials, among them lithium and rare earth elements found in artificial minerals particulate phases. This study investigates the flotation separation of en… ▽ More The demand for lithium, as well as other critical resources, needed for electrochemical energy storage is expected to grow significantly in the future. Slags obtained from pyrometallurgical recycling represent a promising resource of valuable materials, among them lithium and rare earth elements found in artificial minerals particulate phases. This study investigates the flotation separation of engineered artificial minerals (EnAMs) in slags, such as lithium aluminate and gehlenite as valuable and gangue phases, respectively. Flotation experiments are carried out in a Partridge-Smith cell using oleic acid (OA) as a benchmark surfactant. Particle characterization is performed using SEM-based Mineral Liberation Analysis (MLA), which provides particle discrete information. From this information, bivariate Tromp functions based on non-parametric kernel density estimation are computed to characterize the separation behavior with respect to particle descriptors. This approach enables investigating the influence of particle size and shape on separation behavior of EnAMs. Furthermore, these results allow for the optimization of flotation experiments for enriching Li-bearing EnAMs. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Investigating the multidimensional separation behavior of particles in a cyclosizer setting -- A case study on calcite, fluorite and magnesite

Authors: Johanna Sygusch, Thomas Wilhelm, Orkun Furat, Volker Schmidt, Martin Rudolph

Abstract: Particle separation is typically investigated regarding one particulate property only. Virtually all separation processes, however, act on various particle properties in different ways. Modern particle analytical modalities enable a statistically meaningful multidimensional particle characterization. Within this study, individual particle fractions of magnesite, calcite and fluorite (-71 $μm$) are… ▽ More Particle separation is typically investigated regarding one particulate property only. Virtually all separation processes, however, act on various particle properties in different ways. Modern particle analytical modalities enable a statistically meaningful multidimensional particle characterization. Within this study, individual particle fractions of magnesite, calcite and fluorite (-71 $μm$) are processed via the turbulent cross-flow separator cascade Cyclosizer (M16, MARC Technologies Pty Ltd), consisting of 5 hydrocyclones, thus producing 5 different product streams. Particle characterization is achieved via dynamic image analysis from which information on the particle shape and size is obtained. Using this data, bivariate Tromp functions are computed, which show the combined effect of the particle descriptors of roundness and area-equivalent diameter on the separation behavior. While the first cyclones recover predominantly coarse particles with high roundness values, fine particles with varying roundness are recovered in the latter cyclones. △ Less

Submitted 1 February, 2024; originally announced February 2024.

Application of multivariate Tromp functions for evaluating the joint impact of particle size, shape and wettability on the separation of ultrafine particles via flotation

Authors: Johanna Sygusch, Thomas Wilhelm, Orkun Furat, Kai Bachmann, Volker Schmidt, Martin Rudolph

Abstract: Froth flotation predominantly separates particles according to their differences in wettability. However, other particle properties such as size, shape or density significantly influence the separation outcome as well. Froth flotation is most efficient for particles within a size range of about $20-200μm$, but challenges arise for very fine or coarse particles that are accompanied by low recoverie… ▽ More Froth flotation predominantly separates particles according to their differences in wettability. However, other particle properties such as size, shape or density significantly influence the separation outcome as well. Froth flotation is most efficient for particles within a size range of about $20-200μm$, but challenges arise for very fine or coarse particles that are accompanied by low recoveries and poor selectivity. While the impact of particle size on the separation behavior in flotation is well-known by now, the effect of particle shape is less studied and varies based on the investigated zone (suspension or froth) and the separation apparatus used. A multidimensional perspective on the separation process, considering multiple particle properties, enhances the understanding of their collective influence. In this paper the two-dimensional case is studied, i.e., a parametric modeling approach is applied to determine bivariate Tromp functions from scanning electron microscopy-based image data of the feed and the separated fractions. With these functions it is possible to characterize the separation behavior of particle systems. Using a model system of ultrafine ($<10μm$) particles, consisting of differently shaped glass particles with different wettability states as the floatable and magnetite as the non-floatable fraction, allows for investigating the influence of particle size, shape and wettability, on the separation. In this way, the present paper contributes to a better understanding of the complex interplay between certain property vectors for the case of ultrafine particles. Furthermore, it demonstrates the benefits of using multivariate Tromp functions for evaluating separation processes, and points out the limitations of SEM based image measurements by means of mineral liberation analysis (MLA) for the studied particle size fraction. △ Less

Submitted 23 January, 2024; originally announced January 2024.

Stochastic 3D microstructure modeling of twinned polycrystals for investigating the mechanical behavior of $γ$-TiAl intermetallics

Authors: Philipp Rieder, Matthias Neumann, Lucas Monteiro Fernandes, Aude Mulard, Henry Proudhon, François Willot, Volker Schmidt

Abstract: A stochastic 3D microstructure model for polycrystals is introduced which incorporates two types of twin grains, namely neighboring and inclusion twins. They mimic the presence of crystal twins in $γ$-TiAl polycrystalline microstructures as observed by 3D imaging techniques. The polycrystal grain morphology is modeled by means of Voronoi and -- more generally -- Laguerre tessellations. The crystal… ▽ More A stochastic 3D microstructure model for polycrystals is introduced which incorporates two types of twin grains, namely neighboring and inclusion twins. They mimic the presence of crystal twins in $γ$-TiAl polycrystalline microstructures as observed by 3D imaging techniques. The polycrystal grain morphology is modeled by means of Voronoi and -- more generally -- Laguerre tessellations. The crystallographic orientation of each grain is either sampled uniformly on the space of orientations or chosen to be in a twinning relation with another grain. The model is used to quantitatively study relationships between morphology and mechanical properties of polycrystalline materials. For this purpose, full-field Fourier-based computations are performed to investigate the combined effect of grain morphology and twinning on the overall elastic response. For $γ$-TiAl polycrystallines, the presence of twins is associated with a softer response compared to polycrystalline aggregates without twins. However, when comparing the influence on the elastic response, a statistically different polycrystalline morphology has a much smaller effect than the presence of twin grains. Notably, the bulk modulus is almost insensitive to the grain morphology and exhibits much less sensitivity to the presence of twins compared to the shear modulus. The numerical results are consistent with a two-scale homogenization estimate that utilizes laminate materials to model the interactions of twins. △ Less

Submitted 28 February, 2024; v1 submitted 16 January, 2024; originally announced January 2024.

Pixel detector hybridization and integration with anisotropic conductive adhesives

Authors: Alexander Volker, Janis Viktor Schmidt, Dominik Dannheim, Peter Svihra, Mateus Vicente Barreto Pinto, Rui de Oliveira, Justus Braach, Xiao Yang, Marie Ruat, Débora Magalhaes, Matteo Centis Vignali, Giovanni Calderini, Helge Kristiansen

Abstract: A reliable and cost-effective interconnect technology is required for the development of hybrid pixel detectors. The interconnect technology needs to be adapted for the pitch and die sizes of the respective applications. For small-scale applications and during the ASIC and sensor development phase, interconnect technologies must also be suitable for the assembly of single-dies typically available… ▽ More A reliable and cost-effective interconnect technology is required for the development of hybrid pixel detectors. The interconnect technology needs to be adapted for the pitch and die sizes of the respective applications. For small-scale applications and during the ASIC and sensor development phase, interconnect technologies must also be suitable for the assembly of single-dies typically available from Multi-Project-Wafer submissions. Within the CERN EP R&D program and the AIDAinnova collaboration, innovative and scalable hybridization concepts are under development for pixel-detector applications in future colliders. This contribution presents recent results of a newly developed in-house single-die interconnection process based on Anisotropic Conductive Adhesives (ACA). The ACA interconnect technology replaces solder bumps with conductive micro-particles embedded in an epoxy layer applied as either film or paste. The electro-mechanical connection between the sensor and ASIC is achieved via thermocompression of the ACA using a flip-chip device bonder. A specific pixel-pad topology is required to enable the connection via micro-particles and create cavities into which excess epoxy can flow. This pixel-pad topology is achieved with an in-house Electroless Nickel Immersion Gold process that is also under development within the project. The ENIG and ACA processes are qualified with a variety of different ASICs, sensors, and dedicated test structures, with pad diameters ranging from 12 μm to 140 μm and pitches between 20 μm and 1.3 mm. The produced assemblies are characterized electrically, with radioactive-source exposures, and in tests with high-momentum particle beams. A focus is placed on recent optimization of the plating and interconnect processes, resulting in an improved plating uniformity and interconnect yield. △ Less

Submitted 18 March, 2024; v1 submitted 15 December, 2023; originally announced December 2023.

Comments: Procceding to IPRD23 conference in Siena 2023

A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems

Authors: Alexandre Duval, Simon V. Mathis, Chaitanya K. Joshi, Victor Schmidt, Santiago Miret, Fragkiskos D. Malliaros, Taco Cohen, Pietro Liò, Yoshua Bengio, Michael Bronstein

Abstract: Recent advances in computational modelling of atomic systems, spanning molecules, proteins, and materials, represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. In these graphs, the geometric attributes transform according to the inherent physical symmetries of 3D atomic systems, including rotations and translations in Euclidean space, as well as node permutations.… ▽ More Recent advances in computational modelling of atomic systems, spanning molecules, proteins, and materials, represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. In these graphs, the geometric attributes transform according to the inherent physical symmetries of 3D atomic systems, including rotations and translations in Euclidean space, as well as node permutations. In recent years, Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation. Their specificity lies in the inductive biases they leverage - such as physical symmetries and chemical properties - to learn informative representations of these geometric graphs. In this opinionated paper, we provide a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems. We cover fundamental background material and introduce a pedagogical taxonomy of Geometric GNN architectures: (1) invariant networks, (2) equivariant networks in Cartesian basis, (3) equivariant networks in spherical basis, and (4) unconstrained networks. Additionally, we outline key datasets and application areas and suggest future research directions. The objective of this work is to present a structured perspective on the field, making it accessible to newcomers and aiding practitioners in gaining an intuition for its mathematical abstractions. △ Less

Submitted 13 March, 2024; v1 submitted 12 December, 2023; originally announced December 2023.

Investigating microstructure-property relationships of nonwovens by model-based virtual materials testing

Authors: Matthias Weber, Andreas Grießer, Dennis Mosbach, Erik Glatt, Andreas Wiegmann, Volker Schmidt

Abstract: Quantifying the relationship between geometric descriptors of microstructure and effective properties like permeability is essential for understanding and improving the behavior of porous materials. In this paper, we employ a previously developed stochastic model to investigate microstructure-property relationships of nonwovens. First, we show the capability of the model to generate a wide variety… ▽ More Quantifying the relationship between geometric descriptors of microstructure and effective properties like permeability is essential for understanding and improving the behavior of porous materials. In this paper, we employ a previously developed stochastic model to investigate microstructure-property relationships of nonwovens. First, we show the capability of the model to generate a wide variety of realistic nonwovens by varying the model parameters. By computing various geometric descriptors, we investigate the relationship between model parameters and microstructure morphology and, in this way, assess the range of structures which may be described by our model. In a second step, we perform virtual materials testing based on the simulation of a wide range of nonwovens. For these 3D structures, we compute geometric descriptors and perform numerical simulations to obtain values for permeability as an effective material property. We then examine and quantify the relationship between microstructure morphology and permeability by fitting parametric regression formulas to the obtained data set, including but not limited to formulas from literature. We show that for structures which are captured by our model, predictive power may be improved by allowing for slightly more complex formulas. △ Less

Submitted 23 November, 2023; originally announced November 2023.

Comments: 20 pages, 9 figures

An AFM-based approach for quantification of guest particle deformation during mechano-fusion

Authors: Phillip Gräfensteiner, Judith Friebel, Lisa Ditscherlein, Orkun Furat, Urs A. Peuker, Volker Schmidt

Abstract: During the mechano-fusion process for dry particle coating, (hetero)-aggregates are formed consisting of host particles which are coated by smaller guest particles. During this process, the latter are exposed to intense particle-particle interactions and particle-wall impacts, which lead to deformation of the guest particles original shape. These deformations on the nano- and microscale can heavil… ▽ More During the mechano-fusion process for dry particle coating, (hetero)-aggregates are formed consisting of host particles which are coated by smaller guest particles. During this process, the latter are exposed to intense particle-particle interactions and particle-wall impacts, which lead to deformation of the guest particles original shape. These deformations on the nano- and microscale can heavily influence the effective macroscopic properties of the resutling coated particles. We present a method to quantify the shape deformation of guest particles during mechano-fusion based on measurements acquired by atomic force microscopy before and after mechano-fusion. To this end, we reconstruct the 3D shape of guest particles by means of an ellipsoidal fit, constrained by the known volume of the guest particles. Using these reconstructed shapes, we can quantify the degree of deformation by comparing the aspect ratios of the ellipsoidal fits before and after mechano-fusion. Such a quantification enhances the understanding of how process-related parameters influence the geometric descriptors of the involved particles, which in turn impact the overall macroscopic properties of the material. △ Less

Submitted 7 November, 2023; originally announced November 2023.

Journal ref: Powder Technology 434 (2024), 119293

Determination of droplet size from wide-angle light scattering image data using convolutional neural networks

Authors: Tom Kirstein, Simon Aßmann, Orkun Furat, Stefan Will, Volker Schmidt

Abstract: Wide-angle light scattering (WALS) offers the possibility of a highly temporally and spatially resolved measurement of droplets in spray-based methods for nanoparticle synthesis. The size of these droplets is a critical variable affecting the final properties of synthesized materials such as hetero-aggregates. However, conventional methods for determining droplet sizes from WALS image data are lab… ▽ More Wide-angle light scattering (WALS) offers the possibility of a highly temporally and spatially resolved measurement of droplets in spray-based methods for nanoparticle synthesis. The size of these droplets is a critical variable affecting the final properties of synthesized materials such as hetero-aggregates. However, conventional methods for determining droplet sizes from WALS image data are labor-intensive and may introduce biases, particularly when applied to complex systems like spray flame synthesis (SFS). To address these challenges, we introduce a fully automatic machine learning-based approach that employs convolutional neural networks (CNNs) in order to streamline the droplet sizing process. This CNN-based methodology offers further advantages: it requires few manual labels and can utilize transfer learning, making it a promising alternative to conventional methods, specifically with respect to efficiency. To evaluate the performance of our machine learning models, we consider WALS data from an ethanol spray flame process at various heights above the burner surface (HABs), where the models are trained and cross-validated on a large dataset comprising nearly 35000 WALS images. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Influence of Electrode Structuring Techniques on the Performance of All-Solid-State Batteries

Authors: Moritz Clausnitzer, Timo Danner, Benedikt Prifling, Matthias Neumann, Volker Schmidt, Arnulf Latz

Abstract: All-solid-state batteries (ASSBs) offer a promising route to safer batteries with superior energy density compared to conventional Li-ion batteries (LIBs). However, the design of the composite cathode and optimization of the underlying microstructure is one of the aspects requiring intensive research. Achieving both high energy and power density remains challenging due to limitations in ionic cond… ▽ More All-solid-state batteries (ASSBs) offer a promising route to safer batteries with superior energy density compared to conventional Li-ion batteries (LIBs). However, the design of the composite cathode and optimization of the underlying microstructure is one of the aspects requiring intensive research. Achieving both high energy and power density remains challenging due to limitations in ionic conductivity and active material loading. Using structure-resolved simulations, we investigate the potential of perforated and layered electrode designs to enhance ASSB performance. Design strategies showing significant performance increase in LIBs are evaluated regarding their application to ASSBs. Composite cathodes with solid electrolyte channels in the structure do not significantly increase cell performance compared to unstructured electrodes. However, the design with a two-layer cathode proves promising. The layered structure effectively balances improved ionic transport due to increased solid electrolyte fraction at the separator side and substantial active material loading through increased active material fraction at the current collector side of the cathode. Our research highlights key challenges in ASSB development and provides a clear direction for future studies in the field. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Comments: 46 pages, 15 figures

Using convolutional neural networks for stereological characterization of 3D hetero-aggregates based on synthetic STEM data

Authors: Lukas Fuchs, Tom Kirstein, Christoph Mahr, Orkun Furat, Valentin Baric, Andreas Rosenauer, Lutz Maedler, Volker Schmidt

Abstract: The structural characterization of hetero-aggregates in 3D is of great interest, e.g., for deriving process-structure or structure-property relationships. However, since 3D imaging techniques are often difficult to perform as well as time and cost intensive, a characterization of hetero-aggregates based on 2D image data is desirable, but often non-trivial. To overcome the issues of characterizing… ▽ More The structural characterization of hetero-aggregates in 3D is of great interest, e.g., for deriving process-structure or structure-property relationships. However, since 3D imaging techniques are often difficult to perform as well as time and cost intensive, a characterization of hetero-aggregates based on 2D image data is desirable, but often non-trivial. To overcome the issues of characterizing 3D structures from 2D measurements, a method is presented that relies on machine learning combined with methods of spatial stochastic modeling, where the latter are utilized for the generation of synthetic training data. This kind of training data has the advantage that time-consuming experiments for the synthesis of differently structured materials followed by their 3D imaging can be avoided. More precisely, a parametric stochastic 3D model is presented, from which a wide spectrum of virtual hetero-aggregates can be generated. Additionally, the virtual structures are passed to a physics-based simulation tool in order to generate virtual scanning transmission electron microscopy (STEM) images. The preset parameters of the 3D model together with the simulated STEM images serve as a database for the training of convolutional neural networks, which can be used to determine the parameters of the underlying 3D model and, consequently, to predict 3D structures of hetero-aggregates from 2D STEM images. Furthermore, an error analysis is performed to evaluate the prediction power of the trained neural networks with respect to structural descriptors, e.g. the hetero-coordination number. △ Less

Submitted 27 October, 2023; originally announced October 2023.

Comments: 37 pages, 16 figures, 5 tables

On the importance of catalyst-adsorbate 3D interactions for relaxed energy predictions

Authors: Alvaro Carbonero, Alexandre Duval, Victor Schmidt, Santiago Miret, Alex Hernandez-Garcia, Yoshua Bengio, David Rolnick

Abstract: The use of machine learning for material property prediction and discovery has traditionally centered on graph neural networks that incorporate the geometric configuration of all atoms. However, in practice not all this information may be readily available, e.g.~when evaluating the potentially unknown binding of adsorbates to catalyst. In this paper, we investigate whether it is possible to predic… ▽ More The use of machine learning for material property prediction and discovery has traditionally centered on graph neural networks that incorporate the geometric configuration of all atoms. However, in practice not all this information may be readily available, e.g.~when evaluating the potentially unknown binding of adsorbates to catalyst. In this paper, we investigate whether it is possible to predict a system's relaxed energy in the OC20 dataset while ignoring the relative position of the adsorbate with respect to the electro-catalyst. We consider SchNet, DimeNet++ and FAENet as base architectures and measure the impact of four modifications on model performance: removing edges in the input graph, pooling independent representations, not sharing the backbone weights and using an attention mechanism to propagate non-geometric relative information. We find that while removing binding site information impairs accuracy as expected, modified models are able to predict relaxed energies with remarkably decent MAE. Our work suggests future research directions in accelerated materials discovery where information on reactant configurations can be reduced or altogether omitted. △ Less

Submitted 10 October, 2023; originally announced October 2023.

Crystal-GFN: sampling crystals with desirable properties and constraints

Authors: Mila AI4Science, Alex Hernandez-Garcia, Alexandre Duval, Alexandra Volokhova, Yoshua Bengio, Divya Sharma, Pierre Luc Carrier, Yasmine Benabed, Michał Koziarski, Victor Schmidt

Abstract: Accelerating material discovery holds the potential to greatly help mitigate the climate crisis. Discovering new solid-state materials such as electrocatalysts, super-ionic conductors or photovoltaic materials can have a crucial impact, for instance, in improving the efficiency of renewable energy production and storage. In this paper, we introduce Crystal-GFN, a generative model of crystal struct… ▽ More Accelerating material discovery holds the potential to greatly help mitigate the climate crisis. Discovering new solid-state materials such as electrocatalysts, super-ionic conductors or photovoltaic materials can have a crucial impact, for instance, in improving the efficiency of renewable energy production and storage. In this paper, we introduce Crystal-GFN, a generative model of crystal structures that sequentially samples structural properties of crystalline materials, namely the space group, composition and lattice parameters. This domain-inspired approach enables the flexible incorporation of physical and structural hard constraints, as well as the use of any available predictive model of a desired physicochemical property as an objective function. To design stable materials, one must target the candidates with the lowest formation energy. Here, we use as objective the formation energy per atom of a crystal structure predicted by a new proxy machine learning model trained on MatBench. The results demonstrate that Crystal-GFN is able to sample highly diverse crystals with low (median -3.1 eV/atom) predicted formation energy. △ Less

Submitted 13 December, 2023; v1 submitted 7 October, 2023; originally announced October 2023.

Comments: Main paper (10 pages) + references + appendix

Dissociative Recombination of Rotationally Cold OH$^+$ and Its Implications for the Cosmic Ray Ionization Rate in Diffuse Clouds

Authors: Ábel Kálosi, Lisa Gamer, Manfred Grieser, Robert von Hahn, Leonard W. Isberner, Julia I. Jäger, Holger Kreckel, David A. Neufeld, Daniel Paul, Daniel W. Savin, Stefan Schippers, Viviane C. Schmidt, Andreas Wolf, Mark G. Wolfire, Oldřich Novotný

Abstract: Observations of OH$^+$ are used to infer the interstellar cosmic ray ionization rate in diffuse atomic clouds, thereby constraining the propagation of cosmic rays through and the shielding by interstellar clouds, as well as the low energy cosmic ray spectrum. In regions where the H$_2$ to H number density ratio is low, dissociative recombination (DR) is the dominant destruction process for OH$^+$… ▽ More Observations of OH$^+$ are used to infer the interstellar cosmic ray ionization rate in diffuse atomic clouds, thereby constraining the propagation of cosmic rays through and the shielding by interstellar clouds, as well as the low energy cosmic ray spectrum. In regions where the H$_2$ to H number density ratio is low, dissociative recombination (DR) is the dominant destruction process for OH$^+$ and the DR rate coefficient is important for predicting the OH$^+$ abundance and inferring the cosmic ray ionization rate. We have experimentally studied DR of electronically and vibrationally relaxed OH$^+$ in its lowest rotational levels, using an electron--ion merged-beams setup at the Cryogenic Storage Ring. From these measurements, we have derived a kinetic temperature rate coefficient applicable to diffuse cloud chemical models, i.e., for OH$^+$ in its electronic, vibrational, and rotational ground level. At typical diffuse cloud temperatures, our kinetic temperature rate coefficient is a factor of $\sim 5$ times larger than the previous experimentally derived value and a factor of $\sim 33$ times larger than the value calculated by theory. Our combined experimental and modelling results point to a significant increase for the cosmic ray ionization rate inferred from observations of OH$^+$ and H$_2$O$^+$, corresponding to a geometric mean of $(6.6 \pm 1.0) \times 10^{-16}\,\mathrm{s}^{-1}$, which is more than a factor of two larger than the previously inferred values of the cosmic ray ionization rate in diffuse atomic clouds. Combined with observations of diffuse and dense molecular clouds, these findings indicate a greater degree of cosmic ray shielding in interstellar clouds than has been previously inferred. △ Less

Submitted 29 September, 2023; originally announced September 2023.

Comments: Main paper: PDFLaTeX with 10 pages, 4 figures. Appendix starting on page 11: PDFLaTeX with 10 pages, 3 figures, 2 tables. This is the Accepted Manuscript version of an article accepted for publication in The Astrophysical Journal Letters. IOP Publishing Ltd is not responsible for any errors or omissions in this version of the manuscript or any version derived from it

Unveiling the impact of crosslinking redox-active polymers on their electrochemical behavior by 3D imaging and statistical microstructure analysis

Authors: Marten Ademmer, Po-Hua Su, Lukas Dodell, Jakob Asenbauer, Markus Osenberg, André Hilger, Jeng-Kuei Chang, Ingo Manke, Matthias Neumann, Volker Schmidt, Dominic Bresser

Abstract: Polymer-based batteries offer potentially higher power densities and a smaller ecological footprint compared to state-of-the-art lithium-ion batteries comprising inorganic active materials. However, in order to benefit from this potential advantages, further research to find suitable material compositions is required. In the present paper, we compare two different electrode composites of poly(2,2,… ▽ More Polymer-based batteries offer potentially higher power densities and a smaller ecological footprint compared to state-of-the-art lithium-ion batteries comprising inorganic active materials. However, in order to benefit from this potential advantages, further research to find suitable material compositions is required. In the present paper, we compare two different electrode composites of poly(2,2,6,6-tetramethylpiperidinyloxy-4-ylmethacrylate) (PTMA) and CMK-8, one produced with and one without crosslinking the PTMA. The influence of both approaches on the corresponding electrodes is comparatively investigated using electrochemical measurements and statistical 3D microstructure analysis based on synchrotron X-ray tomography. A particular focus is put on the local heterogeneity in the coating and how the crosslinking influences the interaction between PTMA and CMK-8. It is shown that crosslinked PTMA--compared to its non-crosslinked counterpart--exhibits a more heterogeneous microstructure and, furthermore, leads to better surface coverage of CMK-8, larger pores and shorter transportation pathways through the latter. These changes improve the electrochemical properties of the electrode. △ Less

Submitted 21 June, 2023; originally announced June 2023.

Comments: 43 pages, 13 figures

MSC Class: 62P35; 62H35

torchgfn: A PyTorch GFlowNet library

Authors: Salem Lahlou, Joseph D. Viviano, Victor Schmidt, Yoshua Bengio

Abstract: The growing popularity of generative flow networks (GFlowNets or GFNs) from a range of researchers with diverse backgrounds and areas of expertise necessitates a library which facilitates the testing of new features such as training losses that can be easily compared to standard benchmark implementations, or on a set of common environments. torchgfn is a PyTorch library that aims to address this n… ▽ More The growing popularity of generative flow networks (GFlowNets or GFNs) from a range of researchers with diverse backgrounds and areas of expertise necessitates a library which facilitates the testing of new features such as training losses that can be easily compared to standard benchmark implementations, or on a set of common environments. torchgfn is a PyTorch library that aims to address this need. It provides users with a simple API for environments and useful abstractions for samplers and losses. Multiple examples are provided, replicating and unifying published results. The code is available in https://github.com/saleml/torchgfn. △ Less

Submitted 29 August, 2023; v1 submitted 23 May, 2023; originally announced May 2023.

FAENet: Frame Averaging Equivariant GNN for Materials Modeling

Authors: Alexandre Duval, Victor Schmidt, Alex Hernandez Garcia, Santiago Miret, Fragkiskos D. Malliaros, Yoshua Bengio, David Rolnick

Abstract: Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to specific symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they enforce symmetries via the model architecture, which often reduces their expressivity, scalability and comprehensibility. In this paper, we introduce (1) a flexible f… ▽ More Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to specific symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they enforce symmetries via the model architecture, which often reduces their expressivity, scalability and comprehensibility. In this paper, we introduce (1) a flexible framework relying on stochastic frame-averaging (SFA) to make any model E(3)-equivariant or invariant through data transformations. (2) FAENet: a simple, fast and expressive GNN, optimized for SFA, that processes geometric information without any symmetrypreserving design constraints. We prove the validity of our method theoretically and empirically demonstrate its superior accuracy and computational scalability in materials modeling on the OC20 dataset (S2EF, IS2RE) as well as common molecular modeling tasks (QM9, QM7-X). A package implementation is available at https://faenet.readthedocs.io. △ Less

Submitted 28 April, 2023; originally announced May 2023.

Comments: Accepted at ICML 2023

Hot QCD White Paper

Authors: M. Arslandok, S. A. Bass, A. A. Baty, I. Bautista, C. Beattie, F. Becattini, R. Bellwied, Y. Berdnikov, A. Berdnikov, J. Bielcik, J. T. Blair, F. Bock, B. Boimska, H. Bossi, H. Caines, Y. Chen, Y. -T. Chien, M. Chiu, M. E. Connors, M. Csanád, C. L. da Silva, A. P. Dash, G. David, K. Dehmelt, V. Dexheimer , et al. (149 additional authors not shown)

Abstract: Hot QCD physics studies the nuclear strong force under extreme temperature and densities. Experimentally these conditions are achieved via high-energy collisions of heavy ions at the Relativistic Heavy Ion Collider (RHIC) and the Large Hadron Collider (LHC). In the past decade, a unique and substantial suite of data was collected at RHIC and the LHC, probing hydrodynamics at the nucleon scale, the… ▽ More Hot QCD physics studies the nuclear strong force under extreme temperature and densities. Experimentally these conditions are achieved via high-energy collisions of heavy ions at the Relativistic Heavy Ion Collider (RHIC) and the Large Hadron Collider (LHC). In the past decade, a unique and substantial suite of data was collected at RHIC and the LHC, probing hydrodynamics at the nucleon scale, the temperature dependence of the transport properties of quark-gluon plasma, the phase diagram of nuclear matter, the interaction of quarks and gluons at different scales and much more. This document, as part of the 2023 nuclear science long range planning process, was written to review the progress in hot QCD since the 2015 Long Range Plan for Nuclear Science, as well as highlight the realization of previous recommendations, and present opportunities for the next decade, building on the accomplishments and investments made in theoretical developments and the construction of new detectors. Furthermore, this document provides additional context to support the recommendations voted on at the Joint Hot and Cold QCD Town Hall Meeting, which are reported in a separate document. △ Less

Submitted 30 March, 2023; originally announced March 2023.

Comments: 190 pages, 69 figures

Development of novel low-mass module concepts based on MALTA monolithic pixel sensors

Authors: J Weick, F Dachs, P Riedler, M Vicente Barreto Pinto, A M. Zoubir, L Flores Sanz de Acedo, I Asensi Tortajada, V Dao, D Dobrijevic, H Pernegger, M Van Rijnbach, A Sharma, C Solans Sanchez, R de Oliveira, D Dannheim, J V Schmidt

Abstract: The MALTA CMOS monolithic silicon pixel sensors has been developed in the Tower 180 nm CMOS imaging process. It includes an asynchronous readout scheme and complies with the ATLAS inner tracker requirements for the HL-LHC. Several 4-chip MALTA modules have been built using Al wedge wire bonding to demonstrate the direct transfer of data from chip-to-chip and to read out the data of the entire modu… ▽ More The MALTA CMOS monolithic silicon pixel sensors has been developed in the Tower 180 nm CMOS imaging process. It includes an asynchronous readout scheme and complies with the ATLAS inner tracker requirements for the HL-LHC. Several 4-chip MALTA modules have been built using Al wedge wire bonding to demonstrate the direct transfer of data from chip-to-chip and to read out the data of the entire module via one chip only. Novel technologies such as Anisotropic Conductive Films (ACF) and nanowires have been investigated to build a compact module. A lightweight flex with 17 μm trace spacing has been designed, allowing compact packaging with a direct attachment of the chip connection pads to the flex using these interconnection technologies. This contribution shows the current state of our work towards a flexible, low material, dense and reliable packaging and modularization of pixel detectors. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: 5 pages + 1 page references,8 figures

Multidimensional characterization of particle morphology and mineralogical composition using CT data and R-vine copulas

Authors: Orkun Furat, Tom Kirstein, Thomas Leißner, Kai Bachmann, Jens Gutzmer, Urs A. Peuker, Volker Schmidt

Abstract: Computed tomography (CT) can capture volumes large enough to measure a statistically meaningful number of micron-sized particles with a sufficiently good resolution to allow for the analysis of individual particles. However, the development of methods to efficiently investigate such image data and interpretably model the observed particle features is still an active field of research. When image d… ▽ More Computed tomography (CT) can capture volumes large enough to measure a statistically meaningful number of micron-sized particles with a sufficiently good resolution to allow for the analysis of individual particles. However, the development of methods to efficiently investigate such image data and interpretably model the observed particle features is still an active field of research. When image data of particles exhibiting a wide range of shapes and sizes is considered, traditional image segmentation methods, such as the classic watershed algorithm, struggle to recognize particles with satisfying accuracy. Thus, more advanced methods of machine learning must be utilized for image segmentation to improve the validity of subsequent analyzes. Moreover, CT data does not include information about the mineralogical composition of particles and, therefore, additional SEM-EDS image data has to be acquired. In this paper, micro-CT image data of a particle system mostly consisting of zinnwaldite-quartz composites is considered. First, an image segmentation method is applied which uses deep convolutional neural networks, in particular an adaptation of the U-net architecture. This has the advantage of requiring less hand-labeling than other machine learning methods, while also being more flexible with the possibility of transfer learning. Then, fully parameterized models based on vine copulas are designed to determine multivariate probability distributions of descriptor vectors for the size, shape, texture and composition of particles -- allowing for the estimation and interpretable characterization of interdependencies between particle descriptors. For model fitting, the segmented three-dimensional CT data and co-registered two-dimensional SEM-EDS data are used. △ Less

Submitted 18 January, 2023; originally announced January 2023.

Hot and Cold QCD White Paper from ALICE-USA: Input for 2023 U.S. Long Range Plan for Nuclear Science

Authors: N. Alizadehvandchali, N. Apadula, M. Arslandok, C. Beattie, R. Bellwied, J. T. Blair, F. Bock, H. Bossi, A. Bylinkin, H. Caines, I. Chakaberia, M. Cherney, T. M. Cormier, R. Cruz-Torres, P. Dhankher, D. U. Dixit, R. J. Ehlers, W. Fan, M. Fasel, F. Flor, A. N. Flores, D. R. Gangadharan, E. Garcia-Solis, A. Gautam, E. Glimos , et al. (58 additional authors not shown)

Abstract: The ALICE-USA collaboration presents its plans for the 2023 U.S. Long Range Plan for Nuclear Science. The ALICE-USA collaboration presents its plans for the 2023 U.S. Long Range Plan for Nuclear Science. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Comments: 26 pages. 1 figure

PhAST: Physics-Aware, Scalable, and Task-specific GNNs for Accelerated Catalyst Design

Authors: Alexandre Duval, Victor Schmidt, Santiago Miret, Yoshua Bengio, Alex Hernández-García, David Rolnick

Abstract: Mitigating the climate crisis requires a rapid transition towards lower-carbon energy. Catalyst materials play a crucial role in the electrochemical reactions involved in numerous industrial processes key to this transition, such as renewable energy storage and electrofuel synthesis. To reduce the energy spent on such activities, we must quickly discover more efficient catalysts to drive electroch… ▽ More Mitigating the climate crisis requires a rapid transition towards lower-carbon energy. Catalyst materials play a crucial role in the electrochemical reactions involved in numerous industrial processes key to this transition, such as renewable energy storage and electrofuel synthesis. To reduce the energy spent on such activities, we must quickly discover more efficient catalysts to drive electrochemical reactions. Machine learning (ML) holds the potential to efficiently model materials properties from large amounts of data, accelerating electrocatalyst design. The Open Catalyst Project OC20 dataset was constructed to that end. However, ML models trained on OC20 are still neither scalable nor accurate enough for practical applications. In this paper, we propose task-specific innovations applicable to most architectures, enhancing both computational efficiency and accuracy. This includes improvements in (1) the graph creation step, (2) atom representations, (3) the energy prediction head, and (4) the force prediction head. We describe these contributions, referred to as PhAST, and evaluate them thoroughly on multiple architectures. Overall, PhAST improves energy MAE by 4 to 42$\%$ while dividing compute time by 3 to 8$\times$ depending on the targeted task/model. PhAST also enables CPU training, leading to 40$\times$ speedups in highly parallelized settings. Python package: \url{https://phast.readthedocs.io}. △ Less

Submitted 11 March, 2024; v1 submitted 22 November, 2022; originally announced November 2022.

Comments: Journal of Machine Learning Research (JMLR)

Pixel detector hybridisation with Anisotropic Conductive Films

Authors: J. V. Schmidt, J. Braach, D. Dannheim, R. De Oliveira, P. Svihra, M. Vicente Barreto Pinto

Abstract: Hybrid pixel detectors require a reliable and cost-effective interconnect technology adapted to the pitch and die sizes of the respective applications. During the ASIC and sensor R&D phase, and in general for small-scale applications, such interconnect technologies need to be suitable for the assembly of single-dies, typically available from Multi-Project-Wafer submissions. Within the CERN EP R&D… ▽ More Hybrid pixel detectors require a reliable and cost-effective interconnect technology adapted to the pitch and die sizes of the respective applications. During the ASIC and sensor R&D phase, and in general for small-scale applications, such interconnect technologies need to be suitable for the assembly of single-dies, typically available from Multi-Project-Wafer submissions. Within the CERN EP R&D programme and the AIDAinnova collaboration, innovative hybridisation concepts targeting vertex-detector applications at future colliders are under development. This contribution presents recent results of a newly developed in-house single-die interconnection process based on Anisotropic Conductive Film (ACF). The ACF interconnect technology replaces the solder bumps with conductive particles embedded in an adhesive film. The electro-mechanical connection between the sensor and the read-out chip is achieved via thermo-compression of the ACF using a flip-chip device bonder. A specific pad topology is required to enable the connection via conductive particles and create cavities into which excess epoxy can flow. This pixel-pad topology is achieved with an in-house Electroless Nickel Immersion Gold (ENIG) plating process that is also under development within the project. The ENIG and ACF processes are qualified with the Timepix3 ASIC and sensors, with 55 um pixel pitch and 14 um pad diameter. The ACF technology can also be used for ASIC-PCB/FPC integration, replacing wire bonding or large-pitch solder bumping techniques. This contribution introduces the ENIG plating and ACF processes and presents recent results on Timepix3 hybrid assemblies. △ Less

Submitted 24 October, 2022; originally announced October 2022.

Journal ref: JINST 18 C01040 (2023)

Development of novel single-die hybridisation processes for small-pitch pixel detectors

Authors: Peter Svihra, Justus Braach, Eric Buschmann, Dominik Dannheim, Katharina Dort, Thomas Fritzsch, Helge Kristiansen, Mario Rothermund, Janis Viktor Schmidt, Mateus Vicente Barreto Pinto, Morag Williams

Abstract: Hybrid pixel detectors require a reliable and cost-effective interconnect technology adapted to the pitch and die sizes of the respective applications. During the ASIC and sensor R\&D phase, especially for small-scale applications, such interconnect technologies need to be suitable for the assembly of single dies, typically available from Multi-Project-Wafer submissions. Within the CERN EP R&D pro… ▽ More Hybrid pixel detectors require a reliable and cost-effective interconnect technology adapted to the pitch and die sizes of the respective applications. During the ASIC and sensor R\&D phase, especially for small-scale applications, such interconnect technologies need to be suitable for the assembly of single dies, typically available from Multi-Project-Wafer submissions. Within the CERN EP R&D programme and the AIDAinnova collaboration, innovative hybridisation concepts targeting vertex-detector applications at future colliders are under development. Recent results of two novel interconnect methods for pixel pitches of 25um and 55um are presented in this contribution -- an industrial fine-pitch SnAg solder bump-bonding process adapted to single-die processing using support wafers, as well as a newly developed in-house single-die interconnection process based on ACF. The fine-pitch bump-bonding process is qualified with hybrid assemblies from a recent bonding campaign at Frauenhofer IZM. Individual CLICpix2 ASICs with 25um pixel pitch were bump-bonded to active-edge silicon sensors with thicknesses ranging from 50um to 130um. The device characterisation was conducted in the laboratory as well as during a beam test campaign at the CERN SPS beam-line, demonstrating an interconnect yield of about 99.7%. The ACF interconnect technology replaces the solder bumps by conductive micro-particles embedded in an epoxy film. The electro-mechanical connection between the sensor and ASIC is achieved via thermocompression of the ACF using a flip-chip device bonder. The required pixel pad topology is achieved with an in-house ENIG plating process. This newly developed ACF hybridisation process is first qualified with the Timepix3 ASICs and sensors with 55um pixel pitch. The technology can be also used for ASIC-PCB/FPC integration, replacing wire bonding or large-pitch solder bumping techniques. △ Less

Submitted 5 October, 2022; originally announced October 2022.

Comments: 23rd iWoRiD proceedings

Journal ref: 2023_JINST_18_C03008

Testing Causality in Scientific Modelling Software

Authors: Andrew G. Clark, Michael Foster, Benedikt Prifling, Neil Walkinshaw, Robert M. Hierons, Volker Schmidt, Robert D. Turner

Abstract: From simulating galaxy formation to viral transmission in a pandemic, scientific models play a pivotal role in developing scientific theories and supporting government policy decisions that affect us all. Given these critical applications, a poor modelling assumption or bug could have far-reaching consequences. However, scientific models possess several properties that make them notoriously diffic… ▽ More From simulating galaxy formation to viral transmission in a pandemic, scientific models play a pivotal role in developing scientific theories and supporting government policy decisions that affect us all. Given these critical applications, a poor modelling assumption or bug could have far-reaching consequences. However, scientific models possess several properties that make them notoriously difficult to test, including a complex input space, long execution times, and non-determinism, rendering existing testing techniques impractical. In fields such as epidemiology, where researchers seek answers to challenging causal questions, a statistical methodology known as Causal Inference has addressed similar problems, enabling the inference of causal conclusions from noisy, biased, and sparse data instead of costly experiments. This paper introduces the Causal Testing Framework: a framework that uses Causal Inference techniques to establish causal effects from existing data, enabling users to conduct software testing activities concerning the effect of a change, such as Metamorphic Testing, a posteriori. We present three case studies covering real-world scientific models, demonstrating how the Causal Testing Framework can infer metamorphic test outcomes from reused, confounded test data to provide an efficient solution for testing scientific modelling software. △ Less

Submitted 30 June, 2023; v1 submitted 1 September, 2022; originally announced September 2022.

ACM Class: D.2.5; I.6.4

Quantitative comparison of different approaches for reconstructing the carbon-binder domain from tomographic image data of cathodes in lithium-ion batteries and its influence on electrochemical properties

Authors: Benedikt Prifling, Matthias Neumann, Simon Hein, Timo Danner, Emanuel Heider, Alice Hoffmann, Philipp Rieder, André Hilger, Markus Osenberg, Ingo Manke, Margret Wohlfahrt-Mehrens, Arnulf Latz, Volker Schmidt

Abstract: It is well known that the spatial distribution of the carbon-binder domain (CBD) offers a large potential to further optimize lithium-ion batteries. However, it is challenging to reconstruct the CBD from tomographic image data obtained by synchrotron tomography. In the present paper, we consider several approaches to segment 3D image data of two different cathodes into three phases, namely active… ▽ More It is well known that the spatial distribution of the carbon-binder domain (CBD) offers a large potential to further optimize lithium-ion batteries. However, it is challenging to reconstruct the CBD from tomographic image data obtained by synchrotron tomography. In the present paper, we consider several approaches to segment 3D image data of two different cathodes into three phases, namely active material, CBD and pores. More precisely, we focus on global thresholding, a local closing approach based on EDX data, a k-means clustering method, and a procedure based on a neural network that has been trained by correlative microscopy, i.e., based on data gained by synchrotron tomography and FIB-SEM data representing the same electrode. We quantify the impact of the considered segmentation approaches on morphological characteristics as well as on the resulting performance by spatially-resolved transport simulations. Furthermore, we use experimentally determined electrochemical properties to identify an appropriate range for the effective transport parameter of the CBD. The developed methodology is applied to two differently manufactured cathodes, namely an ultra-thick unstructured cathode and a two-layer cathode with varying CBD content in both layers. This comparison elucidates the impact of a specific structuring concept on the 3D microstructure of cathodes. △ Less

Submitted 28 July, 2022; originally announced July 2022.

Comments: 35 pages and 19 figures

Classification of FIB/SEM-tomography images for highly porous multiphase materials using random forest classifiers

Authors: Markus Osenberg, André Hilger, Matthias Neumann, Amalia Wagner, Nicole Bohn, Joachim R. Binder, Volker Schmidt, John Banhart, Ingo Manke

Abstract: FIB/SEM tomography represents an indispensable tool for the characterization of three-dimensional nanostructures in battery research and many other fields. However, contrast and 3D classification/reconstruction problems occur in many cases, which strongly limits the applicability of the technique especially on porous materials, like those used for electrode materials in batteries or fuel cells. Di… ▽ More FIB/SEM tomography represents an indispensable tool for the characterization of three-dimensional nanostructures in battery research and many other fields. However, contrast and 3D classification/reconstruction problems occur in many cases, which strongly limits the applicability of the technique especially on porous materials, like those used for electrode materials in batteries or fuel cells. Distinguishing the different components like active Li storage particles and carbon/binder materials is difficult and often prevents a reliable quantitative analysis of image data, or may even lead to wrong conclusions about structure-property relationships. In this contribution, we present a novel approach for data classification in three-dimensional image data obtained by FIB/SEM tomography and its applications to NMC battery electrode materials. We use two different image signals, namely the signal of the angled SE2 chamber detector and the Inlens detector signal, combine both signals and train a random forest, i.e. a particular machine learning algorithm. We demonstrate that this approach can overcome current limitations of existing techniques suitable for multi-phase measurements and that it allows for quantitative data reconstruction even where current state-of the art techniques fail, or demand for large training sets. This approach may yield as guideline for future research using FIB/SEM tomography. △ Less

Submitted 28 July, 2022; originally announced July 2022.

Understanding Electrolyte Filling of Lithium-Ion Battery Electrodes on the Pore Scale Using the Lattice Boltzmann Method

Authors: Martin P. Lautenschlaeger, Benedikt Prifling, Benjamin Kellers, Julius Weinmiller, Timo Danner, Volker Schmidt, Arnulf Latz

Abstract: Electrolyte filling is a time-critical step during battery manufacturing that also affects the battery performance. The underlying physical phenomena during filling mainly occur on the pore scale and are hard to study experimentally. In this paper, a computational approach, i.e.\ the lattice Boltzmann method, is used to study the filling process and corresponding pore-scale phenomena in 3D lithium… ▽ More Electrolyte filling is a time-critical step during battery manufacturing that also affects the battery performance. The underlying physical phenomena during filling mainly occur on the pore scale and are hard to study experimentally. In this paper, a computational approach, i.e.\ the lattice Boltzmann method, is used to study the filling process and corresponding pore-scale phenomena in 3D lithium-ion battery cathodes. The electrolyte flow through the nanoporous binder is simulated using a homogenization approach. Besides the process time, the influence of structural and physico-chemical properties is investigated. Those are the particle size, the binder distribution, and the volume fraction and wetting behavior of active material and binder. Optimized filling conditions are discussed by capillary pressure-saturation relationships. It is shown how the aforementioned influencing factors affect the electrolyte saturation. Moreover, the amount of the entrapped residual gas phase and the corresponding size distribution of the gas agglomerates are analyzed in detail. Both factors are shown to have a strong impact on mechanisms that can adversely affect the battery performance. The results obtained here indicate how the filling process, the final electrolyte saturation, and potentially also the battery performance can be optimized by adapting process parameters and the electrode and electrolyte design. △ Less

Submitted 10 March, 2022; originally announced March 2022.

Journal ref: Batteries & Supercaps (2022) 5, e202200090

Model-based scenario analysis for effective site-specific weed control on grassland sites

Authors: Lukas Petrich, Georg Lohrmann, Fabio Martin, Albert Stoll, Volker Schmidt

Abstract: The site-specific management of weeds in grassland is often challenging because different weed control strategies have different trade-offs regarding the required resources and treatment efficiency. So, the question arises whether a wide tractor-based system with section control or a small agricultural robot has a higher weed control performance for a given infestation scenario. For example, a sma… ▽ More The site-specific management of weeds in grassland is often challenging because different weed control strategies have different trade-offs regarding the required resources and treatment efficiency. So, the question arises whether a wide tractor-based system with section control or a small agricultural robot has a higher weed control performance for a given infestation scenario. For example, a small autonomous robot moving from one weed to the next might have much shorter travel distances (and thus lower energy and time costs) than a tractor-mounted system if the locations of the weeds are relatively isolated across the field. However, if the plants are highly concentrated in small areas so-called clusters, the increased width of the tractor-mounted implement could be beneficial because of shorter travel distances and greater working width. An additional challenge is the fact that there is no complete knowledge of the weed locations. Weeds may not have been detected, for example, due to their growth stage, occlusion by other objects, or misclassification. Weed control strategies must therefore also be evaluated with regard to this issue. Thus, in addition to the driving distance, other metrics are also of interest, such as the number of plants that were actually controlled or the size of the total treatment area. We performed this investigation for the treatment of the toxic Colchicum autumnale, which had been detected in drone images of extensive grassland sites. In addition to real data, we generated and analyzed simulated weed locations using mathematical models of stochastic geometry. These offer the possibility to simulate very different spatial distributions of toxic plant locations. Different treatment strategies were then virtually tested on this data using Monte Carlo simulations and their performance was statistically evaluated. △ Less

Submitted 10 December, 2021; originally announced December 2021.

Comments: 20 pages, 9 figures

Asymptotic properties of one-layer artificial neural networks with sparse connectivity

Authors: Christian Hirsch, Matthias Neumann, Volker Schmidt

Abstract: A law of large numbers for the empirical distribution of parameters of a one-layer artificial neural networks with sparse connectivity is derived for a simultaneously increasing number of both, neurons and training iterations of the stochastic gradient descent. A law of large numbers for the empirical distribution of parameters of a one-layer artificial neural networks with sparse connectivity is derived for a simultaneously increasing number of both, neurons and training iterations of the stochastic gradient descent. △ Less

Submitted 9 December, 2021; v1 submitted 1 December, 2021; originally announced December 2021.

Comments: 12 pages, 4 figures

MSC Class: 60D05; 60G55; 68T07

ClimateGAN: Raising Climate Change Awareness by Generating Images of Floods

Authors: Victor Schmidt, Alexandra Sasha Luccioni, Mélisande Teng, Tianyu Zhang, Alexia Reynaud, Sunand Raghupathi, Gautier Cosne, Adrien Juraver, Vahe Vardanyan, Alex Hernandez-Garcia, Yoshua Bengio

Abstract: Climate change is a major threat to humanity, and the actions required to prevent its catastrophic consequences include changes in both policy-making and individual behaviour. However, taking action requires understanding the effects of climate change, even though they may seem abstract and distant. Projecting the potential consequences of extreme climate events such as flooding in familiar places… ▽ More Climate change is a major threat to humanity, and the actions required to prevent its catastrophic consequences include changes in both policy-making and individual behaviour. However, taking action requires understanding the effects of climate change, even though they may seem abstract and distant. Projecting the potential consequences of extreme climate events such as flooding in familiar places can help make the abstract impacts of climate change more concrete and encourage action. As part of a larger initiative to build a website that projects extreme climate events onto user-chosen photos, we present our solution to simulate photo-realistic floods on authentic images. To address this complex task in the absence of suitable training data, we propose ClimateGAN, a model that leverages both simulated and real data for unsupervised domain adaptation and conditional image generation. In this paper, we describe the details of our framework, thoroughly evaluate components of our architecture and demonstrate that our model is capable of robustly generating photo-realistic flooding. △ Less

Submitted 6 October, 2021; originally announced October 2021.

Journal ref: ICLR 2022

Independent Action Models and Prediction of Combination Treatment Effects for Response Rate, Duration of Response and Tumor Size Change in Oncology Drug Development

Authors: Linda Z. Sun, Cai, Wu, Xiaoyun, Li, Cong Chen, Emmett V. Schmidt

Abstract: An unprecedented number of new cancer targets are in development, and most are being developed in combination therapies. Early oncology development is strategically challenged in choosing the best combinations to move forward to late stage development. The most common early endpoints to be assessed in such decision-making include objective response rate, duration of response and tumor size change.… ▽ More An unprecedented number of new cancer targets are in development, and most are being developed in combination therapies. Early oncology development is strategically challenged in choosing the best combinations to move forward to late stage development. The most common early endpoints to be assessed in such decision-making include objective response rate, duration of response and tumor size change. In this paper, using independent-drug-action and Bliss-drug-independence concepts as a foundation, we introduce simple models to predict combination therapy efficacy for duration of response and tumor size change. These models complement previous publications using the independent action models (Palmer 2017, Schmidt 2020) to predict progression-free survival and objective response rate and serve as new predictive models to understand drug combinations for early endpoints. The models can be applied to predict the combination treatment effect for early endpoints given monotherapy data, or to estimate the possible effect of one monotherapy in the combination if data are available from the combination therapy and the other monotherapy. Such quantitative work facilitates efficient oncology drug development. △ Less

Submitted 6 January, 2021; originally announced January 2021.

COVI-AgentSim: an Agent-based Model for Evaluating Methods of Digital Contact Tracing

Authors: Prateek Gupta, Tegan Maharaj, Martin Weiss, Nasim Rahaman, Hannah Alsdurf, Abhinav Sharma, Nanor Minoyan, Soren Harnois-Leblanc, Victor Schmidt, Pierre-Luc St. Charles, Tristan Deleu, Andrew Williams, Akshay Patel, Meng Qu, Olexa Bilaniuk, Gaétan Marceau Caron, Pierre Luc Carrier, Satya Ortiz-Gagné, Marc-Andre Rousseau, David Buckeridge, Joumana Ghosn, Yang Zhang, Bernhard Schölkopf, Jian Tang, Irina Rish , et al. (4 additional authors not shown)

Abstract: The rapid global spread of COVID-19 has led to an unprecedented demand for effective methods to mitigate the spread of the disease, and various digital contact tracing (DCT) methods have emerged as a component of the solution. In order to make informed public health choices, there is a need for tools which allow evaluation and comparison of DCT methods. We introduce an agent-based compartmental si… ▽ More The rapid global spread of COVID-19 has led to an unprecedented demand for effective methods to mitigate the spread of the disease, and various digital contact tracing (DCT) methods have emerged as a component of the solution. In order to make informed public health choices, there is a need for tools which allow evaluation and comparison of DCT methods. We introduce an agent-based compartmental simulator we call COVI-AgentSim, integrating detailed consideration of virology, disease progression, social contact networks, and mobility patterns, based on parameters derived from empirical research. We verify by comparing to real data that COVI-AgentSim is able to reproduce realistic COVID-19 spread dynamics, and perform a sensitivity analysis to verify that the relative performance of contact tracing methods are consistent across a range of settings. We use COVI-AgentSim to perform cost-benefit analyses comparing no DCT to: 1) standard binary contact tracing (BCT) that assigns binary recommendations based on binary test results; and 2) a rule-based method for feature-based contact tracing (FCT) that assigns a graded level of recommendation based on diverse individual features. We find all DCT methods consistently reduce the spread of the disease, and that the advantage of FCT over BCT is maintained over a wide range of adoption rates. Feature-based methods of contact tracing avert more disability-adjusted life years (DALYs) per socioeconomic cost (measured by productive hours lost). Our results suggest any DCT method can help save lives, support re-opening of economies, and prevent second-wave outbreaks, and that FCT methods are a promising direction for enriching BCT using self-reported symptoms, yielding earlier warning signals and a significantly reduced spread of the virus per socioeconomic cost. △ Less

Submitted 29 October, 2020; originally announced October 2020.

Predicting Infectiousness for Proactive Contact Tracing

Authors: Yoshua Bengio, Prateek Gupta, Tegan Maharaj, Nasim Rahaman, Martin Weiss, Tristan Deleu, Eilif Muller, Meng Qu, Victor Schmidt, Pierre-Luc St-Charles, Hannah Alsdurf, Olexa Bilanuik, David Buckeridge, Gáetan Marceau Caron, Pierre-Luc Carrier, Joumana Ghosn, Satya Ortiz-Gagne, Chris Pal, Irina Rish, Bernhard Schölkopf, Abhinav Sharma, Jian Tang, Andrew Williams

Abstract: The COVID-19 pandemic has spread rapidly worldwide, overwhelming manual contact tracing in many countries and resulting in widespread lockdowns for emergency containment. Large-scale digital contact tracing (DCT) has emerged as a potential solution to resume economic and social activity while minimizing spread of the virus. Various DCT methods have been proposed, each making trade-offs between pri… ▽ More The COVID-19 pandemic has spread rapidly worldwide, overwhelming manual contact tracing in many countries and resulting in widespread lockdowns for emergency containment. Large-scale digital contact tracing (DCT) has emerged as a potential solution to resume economic and social activity while minimizing spread of the virus. Various DCT methods have been proposed, each making trade-offs between privacy, mobility restrictions, and public health. The most common approach, binary contact tracing (BCT), models infection as a binary event, informed only by an individual's test results, with corresponding binary recommendations that either all or none of the individual's contacts quarantine. BCT ignores the inherent uncertainty in contacts and the infection process, which could be used to tailor messaging to high-risk individuals, and prompt proactive testing or earlier warnings. It also does not make use of observations such as symptoms or pre-existing medical conditions, which could be used to make more accurate infectiousness predictions. In this paper, we use a recently-proposed COVID-19 epidemiological simulator to develop and test methods that can be deployed to a smartphone to locally and proactively predict an individual's infectiousness (risk of infecting others) based on their contact history and other information, while respecting strong privacy constraints. Predictions are used to provide personalized recommendations to the individual via an app, as well as to send anonymized messages to the individual's contacts, who use this information to better predict their own infectiousness, an approach we call proactive contact tracing (PCT). We find a deep-learning based PCT method which improves over BCT for equivalent average mobility, suggesting PCT could help in safe re-opening and second-wave prevention. △ Less

Submitted 23 October, 2020; originally announced October 2020.

Image-to-image Mapping with Many Domains by Sparse Attribute Transfer

Authors: Matthew Amodio, Rim Assouel, Victor Schmidt, Tristan Sylvain, Smita Krishnaswamy, Yoshua Bengio

Abstract: Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a discriminator to encourage the generator to change the image to match the target domain, while training the generator to be inverted with another mapping. While… ▽ More Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a discriminator to encourage the generator to change the image to match the target domain, while training the generator to be inverted with another mapping. While ending up with paired inverse functions may be a good end result, enforcing this restriction at all times during training can be a hindrance to effective modeling. We propose an alternate approach that directly restricts the generator to performing a simple sparse transformation in a latent layer, motivated by recent work from cognitive neuroscience suggesting an architectural prior on representations corresponding to consciousness. Our biologically motivated approach leads to representations more amenable to transformation by disentangling high-level abstract concepts in the latent space. We demonstrate that image-to-image domain translation with many different domains can be learned more effectively with our architecturally constrained, simple transformation than with previous unconstrained architectures that rely on a cycle-consistency loss. △ Less

Submitted 23 June, 2020; originally announced June 2020.

Towards Lifelong Self-Supervision For Unpaired Image-to-Image Translation

Authors: Victor Schmidt, Makesh Narsimhan Sreedhar, Mostafa ElAraby, Irina Rish

Abstract: Unpaired Image-to-Image Translation (I2IT) tasks often suffer from lack of data, a problem which self-supervised learning (SSL) has recently been very popular and successful at tackling. Leveraging auxiliary tasks such as rotation prediction or generative colorization, SSL can produce better and more robust representations in a low data regime. Training such tasks along an I2IT task is however com… ▽ More Unpaired Image-to-Image Translation (I2IT) tasks often suffer from lack of data, a problem which self-supervised learning (SSL) has recently been very popular and successful at tackling. Leveraging auxiliary tasks such as rotation prediction or generative colorization, SSL can produce better and more robust representations in a low data regime. Training such tasks along an I2IT task is however computationally intractable as model size and the number of task grow. On the other hand, learning sequentially could incur catastrophic forgetting of previously learned tasks. To alleviate this, we introduce Lifelong Self-Supervision (LiSS) as a way to pre-train an I2IT model (e.g., CycleGAN) on a set of self-supervised auxiliary tasks. By keeping an exponential moving average of past encoders and distilling the accumulated knowledge, we are able to maintain the network's validation performance on a number of tasks without any form of replay, parameter isolation or retraining techniques typically used in continual learning. We show that models trained with LiSS perform better on past tasks, while also being more robust than the CycleGAN baseline to color bias and entity entanglement (when two entities are very close). △ Less

Submitted 31 March, 2020; originally announced April 2020.

Measurement of deuteron carbon vector analyzing powers in the kinetic energy range 170-380 MeV

Authors: JEDI Collaboration, F. Müller, M. Zurek, Z. Bagdasarian, L. Barion, M. Berz, I. Ciepal, G. Ciullo, S. Dymov, D. Eversmann, M. Gaisser, R. Gebel, K. Grigoryev, D. Grzonka, V. Hejny, N. Hempelmann, J. Hetzel, F. Hinder, A. Kacharava, V. Kamerdzhiev, I. Keshelashvili, I. Koop, A. Kulikov, A. Lehrach, P. Lenisa , et al. (36 additional authors not shown)

Abstract: A measurement of vector analyzing powers in elastic deuteron-carbon scattering has been performed at the Cooler Synchrotron COSY of Forschungszentrum Jülich, Germany. Seven kinetic beam energies between 170 and 380 MeV have been used. A vector-polarized beam from a polarized deuteron source was injected, accelerated to the final desired energy and stored in COSY. A thin needle-shaped diamond strip… ▽ More A measurement of vector analyzing powers in elastic deuteron-carbon scattering has been performed at the Cooler Synchrotron COSY of Forschungszentrum Jülich, Germany. Seven kinetic beam energies between 170 and 380 MeV have been used. A vector-polarized beam from a polarized deuteron source was injected, accelerated to the final desired energy and stored in COSY. A thin needle-shaped diamond strip was used as a carbon target, onto which the beam was slowly steered. Elastically scattered deuterons were identified in the forward direction using various layers of scintillators and straw tubes. Where data exist in the literature (at 200 and 270 MeV), excellent agreement of the angular shape was found. The beam polarization of the presented data was deduced by fitting the absolute scale of the analyzing power to these references. Our results extend the world data set and are necessary for polarimetry of future electric dipole moment searches at storage rings. They will as well serve as an input for theoretical description of polarized hadron-hadron scattering. △ Less

Submitted 2 September, 2020; v1 submitted 17 March, 2020; originally announced March 2020.