Showing 1–50 of 236 results for author: Morris, C

First experimental study of multiple orientation muon tomography, with image optimization in sparse data environments

Authors: Jesus J. Valencia, Adam A. Hecht, C. L. Morris, E. Guardincerri, D. Poulson, J. Bacon, J. M. Durham

Abstract: Due to the high penetrating power of cosmic ray muons, they can be used to probe very thick and dense objects. As charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object, particle direction changes can be used to extract scattering information within an object. This can be used to produce a scat… ▽ More Due to the high penetrating power of cosmic ray muons, they can be used to probe very thick and dense objects. As charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object, particle direction changes can be used to extract scattering information within an object. This can be used to produce a scattering intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies have been published with multi-orientation tomography, which can form a three-dimensional representation faster than a single orientation view. In this work we present the first experimental multiple orientation muon tomography study. Experimental muon-scatter based tomography was performed using a concrete filled steel drum with several different metal wedges inside, between detector planes. Data was collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were then combined using two different tomographic methods. Results showed that using a combination of multiple depth-of-field reconstructions, rather than a traditional inverse Radon transform approach used for CT, resulted in more useful images for sparser data. As cosmic ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedge compositions. △ Less

Submitted 8 October, 2024; originally announced October 2024.

The hypothetical track-length fitting algorithm for energy measurement in liquid argon TPCs

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, F. Akbar, N. S. Alex, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, T. Alves, H. Amar, P. Amedo, J. Anderson, C. Andreopoulos , et al. (1348 additional authors not shown)

Abstract: This paper introduces the hypothetical track-length fitting algorithm, a novel method for measuring the kinetic energies of ionizing particles in liquid argon time projection chambers (LArTPCs). The algorithm finds the most probable offset in track length for a track-like object by comparing the measured ionization density as a function of position with a theoretical prediction of the energy loss… ▽ More This paper introduces the hypothetical track-length fitting algorithm, a novel method for measuring the kinetic energies of ionizing particles in liquid argon time projection chambers (LArTPCs). The algorithm finds the most probable offset in track length for a track-like object by comparing the measured ionization density as a function of position with a theoretical prediction of the energy loss as a function of the energy, including models of electron recombination and detector response. The algorithm can be used to measure the energies of particles that interact before they stop, such as charged pions that are absorbed by argon nuclei. The algorithm's energy measurement resolutions and fractional biases are presented as functions of particle kinetic energy and number of track hits using samples of stopping secondary charged pions in data collected by the ProtoDUNE-SP detector, and also in a detailed simulation. Additional studies describe impact of the dE/dx model on energy measurement performance. The method described in this paper to characterize the energy measurement performance can be repeated in any LArTPC experiment using stopping secondary charged pions. △ Less

Submitted 1 October, 2024; v1 submitted 26 September, 2024; originally announced September 2024.

Report number: FERMILAB-PUB-24-0561-LBNF-PPD, CERN-EP-2024-256

Measurement of the Free Neutron Lifetime in a Magneto-Gravitational Trap with In Situ Detection

Authors: R. Musedinovic, L. S. Blokland, C. B. Cude-Woods, M. Singh, M. A. Blatnik, N. Callahan, J. H. Choi, S. Clayton, B. W. Filippone, W. R. Fox, E. Fries, P. Geltenbort, F. M. Gonzalez, L. Hayen, K. P. Hickerson, A. T. Holley, T. M. Ito, A. Komives, S Lin, Chen-Yu Liu, M. F. Makela, C. M. O'Shaughnessy, R. W. Pattie Jr, J. C. Ramsey, D. J. Salvat , et al. (10 additional authors not shown)

Abstract: Here we publish three years of data for the UCNtau experiment performed at the Los Alamos Ultra Cold Neutron Facility at the Los Alamos Neutron Science Center. These data are in addition to our previously published data. Our goals in this paper are to better understand and quantify systematic uncertainties and to improve the lifetime statistical precision. We report a measured value for these runs… ▽ More Here we publish three years of data for the UCNtau experiment performed at the Los Alamos Ultra Cold Neutron Facility at the Los Alamos Neutron Science Center. These data are in addition to our previously published data. Our goals in this paper are to better understand and quantify systematic uncertainties and to improve the lifetime statistical precision. We report a measured value for these runs from 2020-2022 for the neutron lifetime of 877.94+/-0.37 s; when all the data from UCNtau are averaged we report an updated value for the lifetime of 877.82+/-0.22 (statistical)+0.20-0.17 (systematic) s. We utilized improved monitor detectors, reduced our correction due to UCN upscattering on ambient gas, and employed four different main UCN detector geometries both to reduce the correction required for rate dependence and explore potential contributions due to phase space evolution. △ Less

Submitted 9 September, 2024; originally announced September 2024.

DUNE Phase II: Scientific Opportunities, Detector Concepts, Technological Solutions

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, T. Alves, H. Amar, P. Amedo, J. Anderson, C. Andreopoulos, M. Andreotti , et al. (1347 additional authors not shown)

Abstract: The international collaboration designing and constructing the Deep Underground Neutrino Experiment (DUNE) at the Long-Baseline Neutrino Facility (LBNF) has developed a two-phase strategy toward the implementation of this leading-edge, large-scale science project. The 2023 report of the US Particle Physics Project Prioritization Panel (P5) reaffirmed this vision and strongly endorsed DUNE Phase I… ▽ More The international collaboration designing and constructing the Deep Underground Neutrino Experiment (DUNE) at the Long-Baseline Neutrino Facility (LBNF) has developed a two-phase strategy toward the implementation of this leading-edge, large-scale science project. The 2023 report of the US Particle Physics Project Prioritization Panel (P5) reaffirmed this vision and strongly endorsed DUNE Phase I and Phase II, as did the European Strategy for Particle Physics. While the construction of the DUNE Phase I is well underway, this White Paper focuses on DUNE Phase II planning. DUNE Phase-II consists of a third and fourth far detector (FD) module, an upgraded near detector complex, and an enhanced 2.1 MW beam. The fourth FD module is conceived as a "Module of Opportunity", aimed at expanding the physics opportunities, in addition to supporting the core DUNE science program, with more advanced technologies. This document highlights the increased science opportunities offered by the DUNE Phase II near and far detectors, including long-baseline neutrino oscillation physics, neutrino astrophysics, and physics beyond the standard model. It describes the DUNE Phase II near and far detector technologies and detector design concepts that are currently under consideration. A summary of key R&D goals and prototyping phases needed to realize the Phase II detector technical designs is also provided. DUNE's Phase II detectors, along with the increased beam power, will complete the full scope of DUNE, enabling a multi-decadal program of groundbreaking science with neutrinos. △ Less

Submitted 22 August, 2024; originally announced August 2024.

Report number: FERMILAB-TM-2833-LBNF

First Measurement of the Total Inelastic Cross-Section of Positively-Charged Kaons on Argon at Energies Between 5.0 and 7.5 GeV

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, T. Alves, H. Amar, P. Amedo, J. Anderson, C. Andreopoulos, M. Andreotti , et al. (1341 additional authors not shown)

Abstract: ProtoDUNE Single-Phase (ProtoDUNE-SP) is a 770-ton liquid argon time projection chamber that operated in a hadron test beam at the CERN Neutrino Platform in 2018. We present a measurement of the total inelastic cross section of charged kaons on argon as a function of kaon energy using 6 and 7 GeV/$c$ beam momentum settings. The flux-weighted average of the extracted inelastic cross section at each… ▽ More ProtoDUNE Single-Phase (ProtoDUNE-SP) is a 770-ton liquid argon time projection chamber that operated in a hadron test beam at the CERN Neutrino Platform in 2018. We present a measurement of the total inelastic cross section of charged kaons on argon as a function of kaon energy using 6 and 7 GeV/$c$ beam momentum settings. The flux-weighted average of the extracted inelastic cross section at each beam momentum setting was measured to be 380$\pm$26 mbarns for the 6 GeV/$c$ setting and 379$\pm$35 mbarns for the 7 GeV/$c$ setting. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Report number: CERN-EP-2024-211, FERMILAB-PUB-24-0216-V

Supernova Pointing Capabilities of DUNE

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, T. Alves, H. Amar, P. Amedo, J. Anderson, D. A. Andrade , et al. (1340 additional authors not shown)

Abstract: The determination of the direction of a stellar core collapse via its neutrino emission is crucial for the identification of the progenitor for a multimessenger follow-up. A highly effective method of reconstructing supernova directions within the Deep Underground Neutrino Experiment (DUNE) is introduced. The supernova neutrino pointing resolution is studied by simulating and reconstructing electr… ▽ More The determination of the direction of a stellar core collapse via its neutrino emission is crucial for the identification of the progenitor for a multimessenger follow-up. A highly effective method of reconstructing supernova directions within the Deep Underground Neutrino Experiment (DUNE) is introduced. The supernova neutrino pointing resolution is studied by simulating and reconstructing electron-neutrino charged-current absorption on $^{40}$Ar and elastic scattering of neutrinos on electrons. Procedures to reconstruct individual interactions, including a newly developed technique called ``brems flipping'', as well as the burst direction from an ensemble of interactions are described. Performance of the burst direction reconstruction is evaluated for supernovae happening at a distance of 10 kpc for a specific supernova burst flux model. The pointing resolution is found to be 3.4 degrees at 68% coverage for a perfect interaction-channel classification and a fiducial mass of 40 kton, and 6.6 degrees for a 10 kton fiducial mass respectively. Assuming a 4% rate of charged-current interactions being misidentified as elastic scattering, DUNE's burst pointing resolution is found to be 4.3 degrees (8.7 degrees) at 68% coverage. △ Less

Submitted 14 July, 2024; originally announced July 2024.

Comments: 25 pages, 16 figures

Report number: FERMILAB-PUB-24-0319-LBNF

DaBiT: Depth and Blur informed Transformer for Joint Refocusing and Super-Resolution

Authors: Crispian Morris, Nantheera Anantrasirichai, Fan Zhang, David Bull

Abstract: In many real-world scenarios, recorded videos suffer from accidental focus blur, and while video deblurring methods exist, most specifically target motion blur. This paper introduces a framework optimised for the joint task of focal deblurring (refocusing) and video super-resolution (VSR). The proposed method employs novel map guided transformers, in addition to image propagation, to effectively l… ▽ More In many real-world scenarios, recorded videos suffer from accidental focus blur, and while video deblurring methods exist, most specifically target motion blur. This paper introduces a framework optimised for the joint task of focal deblurring (refocusing) and video super-resolution (VSR). The proposed method employs novel map guided transformers, in addition to image propagation, to effectively leverage the continuous spatial variance of focal blur and restore the footage. We also introduce a flow re-focusing module to efficiently align relevant features between the blurry and sharp domains. Additionally, we propose a novel technique for generating synthetic focal blur data, broadening the model's learning capabilities to include a wider array of content. We have made a new benchmark dataset, DAVIS-Blur, available. This dataset, a modified extension of the popular DAVIS video segmentation set, provides realistic out-of-focus blur degradations as well as the corresponding blur maps. Comprehensive experiments on DAVIS-Blur demonstrate the superiority of our approach. We achieve state-of-the-art results with an average PSNR performance over 1.9dB greater than comparable existing video restoration methods. Our source code will be made available at https://github.com/crispianm/DaBiT △ Less

Submitted 10 July, 2024; v1 submitted 1 July, 2024; originally announced July 2024.

The VISTA Variables in the Vía Láctea eXtended (VVVX) ESO public survey: Completion of the observations and legacy

Authors: R. K. Saito, M. Hempel, J. Alonso-García, P. W. Lucas, D. Minniti, S. Alonso, L. Baravalle, J. Borissova, C. Caceres, A. N. Chené, N. J. G. Cross, F. Duplancic, E. R. Garro, M. Gómez, V. D. Ivanov, R. Kurtev, A. Luna, D. Majaess, M. G. Navarro, J. B. Pullen, M. Rejkuba, J. L. Sanders, L. C. Smith, P. H. C. Albino, M. V. Alonso , et al. (121 additional authors not shown)

Abstract: The ESO public survey VISTA Variables in the Vía Láctea (VVV) surveyed the inner Galactic bulge and the adjacent southern Galactic disk from $2009-2015$. Upon its conclusion, the complementary VVV eXtended (VVVX) survey has expanded both the temporal as well as spatial coverage of the original VVV area, widening it from $562$ to $1700$ sq. deg., as well as providing additional epochs in… ▽ More The ESO public survey VISTA Variables in the Vía Láctea (VVV) surveyed the inner Galactic bulge and the adjacent southern Galactic disk from $2009-2015$. Upon its conclusion, the complementary VVV eXtended (VVVX) survey has expanded both the temporal as well as spatial coverage of the original VVV area, widening it from $562$ to $1700$ sq. deg., as well as providing additional epochs in $JHK_{\rm s}$ filters from $2016-2023$. With the completion of VVVX observations during the first semester of 2023, we present here the observing strategy, a description of data quality and access, and the legacy of VVVX. VVVX took $\sim 2000$ hours, covering about 4% of the sky in the bulge and southern disk. VVVX covered most of the gaps left between the VVV and the VISTA Hemisphere Survey (VHS) areas and extended the VVV time baseline in the obscured regions affected by high extinction and hence hidden from optical observations. VVVX provides a deep $JHK_{\rm s}$ catalogue of $\gtrsim 1.5\times10^9$ point sources, as well as a $K_{\rm s}$ band catalogue of $\sim 10^7$ variable sources. Within the existing VVV area, we produced a $5D$ map of the surveyed region by combining positions, distances, and proper motions of well-understood distance indicators such as red clump stars, RR Lyrae, and Cepheid variables. In March 2023 we successfully finished the VVVX survey observations that started in 2016, an accomplishment for ESO Paranal Observatory upon 4200 hours of observations for VVV+VVVX. The VVV+VVVX catalogues complement those from the Gaia mission at low Galactic latitudes and provide spectroscopic targets for the forthcoming ESO high-multiplex spectrographs MOONS and 4MOST. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Comments: 17 pages, 11 figures (+ appendix). Accepted for publication in Astronomy and Astrophysics in section 14: Catalogs and data

Journal ref: A&A 689, A148 (2024)

An experimental search for an explanation of the difference between beam and bottle neutron lifetime measurements

Authors: M. F. Blatnik, L. S. Blokland, N. Callahan, J. H. Choi, S. Clayton, C. B Cude-Woods, B. W. Filippone, W. R. Fox, E. Fries, P. Geltenbort, F. M. Gonzalez, L. Hayen, K. P. Hickerson, A. T. Holley, T. M. Ito, A. Komives, S Lin, Chen-Yu Liu, M. F. Makela, C. L. Morris, R. Musedinovic, C. M. O'Shaughnessy, R. W. Pattie Jr., J. C. Ramsey, D. J. Salvat , et al. (10 additional authors not shown)

Abstract: The past two decades have yielded several new measurements and reanalysis of older measurements of the neutron lifetime. These have led to a 4.4 standard deviation discrepancy between the most precise measurements of the neutron decay rate producing protons in cold neutron beams and the most precise lifetime measured in neutron storage experiments. Here we publish an analysis of the recently publi… ▽ More The past two decades have yielded several new measurements and reanalysis of older measurements of the neutron lifetime. These have led to a 4.4 standard deviation discrepancy between the most precise measurements of the neutron decay rate producing protons in cold neutron beams and the most precise lifetime measured in neutron storage experiments. Here we publish an analysis of the recently published UCN aimed a searching for an explanation of this difference using the model proposed by Koch and Hummel. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Report number: LA-UR-24-25619

The verification of periodicity with the use of recurrent neural networks

Authors: Niall Miller, Philip Lucas, Yi Sun, Zhen Guo, Calum Morris, William Cooper

Abstract: The ability to automatically and robustly self-verify periodicity present in time-series astronomical data is becoming more important as data sets rapidly increase in size. The age of large astronomical surveys has rendered manual inspection of time-series data less practical. Previous efforts in generating a false alarm probability to verify the periodicity of stars have been aimed towards the an… ▽ More The ability to automatically and robustly self-verify periodicity present in time-series astronomical data is becoming more important as data sets rapidly increase in size. The age of large astronomical surveys has rendered manual inspection of time-series data less practical. Previous efforts in generating a false alarm probability to verify the periodicity of stars have been aimed towards the analysis of a constructed periodogram. However, these methods feature correlations with features that do not pertain to periodicity, such as light curve shape, slow trends and stochastic variability. The common assumption that photometric errors are Gaussian and well determined is also a limitation of analytic methods. We present a novel machine learning based technique which directly analyses the phase folded light curve for its false alarm probability. We show that the results of this method are largely insensitive to the shape of the light curve, and we establish minimum values for the number of data points and the amplitude to noise ratio. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Cometh: A continuous-time discrete-state graph diffusion model

Authors: Antoine Siraudin, Fragkiskos D. Malliaros, Christopher Morris

Abstract: Discrete-state denoising diffusion models led to state-of-the-art performance in graph generation, especially in the molecular domain. Recently, they have been transposed to continuous time, allowing more flexibility in the reverse process and a better trade-off between sampling efficiency and quality. Here, to leverage the benefits of both approaches, we propose Cometh, a continuous-time discrete… ▽ More Discrete-state denoising diffusion models led to state-of-the-art performance in graph generation, especially in the molecular domain. Recently, they have been transposed to continuous time, allowing more flexibility in the reverse process and a better trade-off between sampling efficiency and quality. Here, to leverage the benefits of both approaches, we propose Cometh, a continuous-time discrete-state graph diffusion model, tailored to the specificities of graph data. In addition, we also successfully replaced the set of structural encodings previously used in the discrete graph diffusion model with a single random-walk-based encoding, providing a simple and principled way to boost the model's expressive power. Empirically, we show that integrating continuous time leads to significant improvements across various metrics over state-of-the-art discrete-state diffusion models on a large set of molecular and non-molecular benchmark datasets. In terms of VUN samples, Cometh obtains a near-perfect performance of 99.5% on the planar graph dataset and outperforms DiGress by 12.6% on the large GuacaMol dataset. △ Less

Submitted 4 October, 2024; v1 submitted 10 June, 2024; originally announced June 2024.

Comments: 23 pages

Aligning Transformers with Weisfeiler-Leman

Authors: Luis Müller, Christopher Morris

Abstract: Graph neural network architectures aligned with the $k$-dimensional Weisfeiler--Leman ($k$-WL) hierarchy offer theoretically well-understood expressive power. However, these architectures often fail to deliver state-of-the-art predictive performance on real-world graphs, limiting their practical utility. While recent works aligning graph transformer architectures with the $k$-WL hierarchy have sho… ▽ More Graph neural network architectures aligned with the $k$-dimensional Weisfeiler--Leman ($k$-WL) hierarchy offer theoretically well-understood expressive power. However, these architectures often fail to deliver state-of-the-art predictive performance on real-world graphs, limiting their practical utility. While recent works aligning graph transformer architectures with the $k$-WL hierarchy have shown promising empirical results, employing transformers for higher orders of $k$ remains challenging due to a prohibitive runtime and memory complexity of self-attention as well as impractical architectural assumptions, such as an infeasible number of attention heads. Here, we advance the alignment of transformers with the $k$-WL hierarchy, showing stronger expressivity results for each $k$, making them more feasible in practice. In addition, we develop a theoretical framework that allows the study of established positional encodings such as Laplacian PEs and SPE. We evaluate our transformers on the large-scale PCQM4Mv2 dataset, showing competitive predictive performance with the state-of-the-art and demonstrating strong downstream performance when fine-tuning them on small-scale molecular datasets. Our code is available at https://github.com/luis-mueller/wl-transformers. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: Accepted at ICML 2024

Probabilistic Graph Rewiring via Virtual Nodes

Authors: Chendi Qian, Andrei Manolache, Christopher Morris, Mathias Niepert

Abstract: Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields and structural bottlenecks hinder information flow in the graph. While graph transformers hold promise in addressing these issues, their scalability is limited… ▽ More Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields and structural bottlenecks hinder information flow in the graph. While graph transformers hold promise in addressing these issues, their scalability is limited due to quadratic complexity regarding the number of nodes, rendering them impractical for larger graphs. Here, we propose implicitly rewired message-passing neural networks (IPR-MPNNs), a novel approach that integrates implicit probabilistic graph rewiring into MPNNs. By introducing a small number of virtual nodes, i.e., adding additional nodes to a given graph and connecting them to existing nodes, in a differentiable, end-to-end manner, IPR-MPNNs enable long-distance message propagation, circumventing quadratic complexity. Theoretically, we demonstrate that IPR-MPNNs surpass the expressiveness of traditional MPNNs. Empirically, we validate our approach by showcasing its ability to mitigate under-reaching and over-squashing effects, achieving state-of-the-art performance across multiple graph datasets. Notably, IPR-MPNNs outperform graph transformers while maintaining significantly faster computational efficiency. △ Less

Submitted 7 June, 2024; v1 submitted 27 May, 2024; originally announced May 2024.

Comments: arXiv admin note: text overlap with arXiv:2310.02156

kappa And b is a fast rotator from KPIC High Resolution Spectroscopy

Authors: Evan C. Morris, Jason J. Wang, Chih-Chun Hsu, Jean-Baptiste Ruffio, Jerry W. Xuan, Jacques-Robert Delorme, Callie Hood, Marta L. Bryan, Emily C. Martin, Jacklyn Pezzato, Dimitri Mawet, Andrew Skemer, Ashley Baker, Randall Bartos, Benjamin Calvin, Sylvain Cetre, Greg Doppmann, Daniel Echeverri, Luke Finnerty, Michael P. Fitzgerald, Nemanja Jovanovic, Joshua Liberman, Ronald Lopez, Ben Sappey, Tobias Schofield , et al. (2 additional authors not shown)

Abstract: We used the Keck Planet Imager and Characterizer (KPIC) to obtain high-resolution (R$\sim$35,000) K-band spectra of kappa Andromedae b, a planetary-mass companion orbiting the B9V star, kappa Andromedae A. We characterized its spin, radial velocity, and bulk atmospheric parameters through use of a forward modeling framework to jointly fit planetary spectra and residual starlight speckles, obtainin… ▽ More We used the Keck Planet Imager and Characterizer (KPIC) to obtain high-resolution (R$\sim$35,000) K-band spectra of kappa Andromedae b, a planetary-mass companion orbiting the B9V star, kappa Andromedae A. We characterized its spin, radial velocity, and bulk atmospheric parameters through use of a forward modeling framework to jointly fit planetary spectra and residual starlight speckles, obtaining likelihood-based posterior probabilities. We also detected H$_{2}$O and CO in its atmosphere via cross correlation. We measured a $v\sin(i)$ value for kappa And b of $38.42\pm{0.05}$ km/s, allowing us to extend our understanding of the population of close in bound companions at higher rotation rates. This rotation rate is one of the highest spins relative to breakup velocity measured to date, at close to $50\%$ of breakup velocity. We identify a radial velocity $-17.35_{-0.09}^{+0.05}$ km/s, which we use with existing astrometry and RV measurements to update the orbital fit. We also measure an effective temperature of $1700\pm{100}$ K and a $\log(g)$ of $4.7\pm{0.5}$ cgs dex. △ Less

Submitted 21 May, 2024; originally announced May 2024.

Comments: 14 pages, 7 figures, accepted for publication in AJ

YAP:Ce scintillator as an absolute ultracold neutron detector

Authors: M. Krivoš, Z. Tang, N. Floyd, C. L. Morris, M. Blatnik, C. Cude-Woods, S. M. Clayton, A. T. Holley, T. M. Ito, C. -Y. Liu, M. Makela, I. F. Martinez, A. S. C. Navazo, C. M. O'Shaughnessy, E. L. Renner, R. W. Pattie, A. R. Young

Abstract: The upcoming UCNProBe experiment at Los Alamos National Laboratory will measure the $β$-decay rate of free neutrons with different systematic uncertainties than previous beam-based neutron lifetime experiments. We have developed a new $^{10}$B-coated YAP:Ce scintillator whose properties are presented. The advantage of the YAP:Ce scintillator is its high Fermi potential, which reduces the probabili… ▽ More The upcoming UCNProBe experiment at Los Alamos National Laboratory will measure the $β$-decay rate of free neutrons with different systematic uncertainties than previous beam-based neutron lifetime experiments. We have developed a new $^{10}$B-coated YAP:Ce scintillator whose properties are presented. The advantage of the YAP:Ce scintillator is its high Fermi potential, which reduces the probability for upscattering of ultracold neutrons, and its short decay time, which is important at high counting rates. Birks' coefficient of YAP:Ce was measured to be ($5.56^{+0.05}_{-0.30})\times 10^{-4}$ cm/MeV and light losses due to 120 nm of $^{10}$B-coating to be about 60%. The loss of light from YAP:Ce due to transmission through deuterated polystyrene scintillator was about 50%. The efficiency for counting neutrons that are captured on the $^{10}$B coating is (86.82 $\pm$ 2.61)%. Measurement with ultracold neutrons showed that YAP:Ce crystal counted 8% to 28% more UCNs compared to ZnS screen. This may be due to an uneven coating of $^{10}$B on the rough surface. △ Less

Submitted 27 March, 2024; originally announced May 2024.

Development of Two-Dimensional Neutron Imager with a Sandwich Configuration

Authors: Y. Kamiya, R. Nishimura, S. Mitsui, Z. Wang, C. L. Morris, M. Makela, S. M. Clayton, J. K. Baldwin, T. M. Ito, S. Akamatsu, H. Iwase, Y. Arai, J. Murata, S. Asai

Abstract: We have developed a two-dimensional neutron imager based on a semiconductor pixelated sensor, especially designed for experiments measuring of a spatial and a temporal behavior of quantum bound states of ultra-cold neutrons. Through these measurements, we expect to measure the ratio between the inertial and gravitational masses of neutrons and to test the equivalence principle in the quantum regim… ▽ More We have developed a two-dimensional neutron imager based on a semiconductor pixelated sensor, especially designed for experiments measuring of a spatial and a temporal behavior of quantum bound states of ultra-cold neutrons. Through these measurements, we expect to measure the ratio between the inertial and gravitational masses of neutrons and to test the equivalence principle in the quantum regime. As one of the principal neutron imagers, we fabricated a sensor with a sandwich configuration, named 10B-INTPIX4-sw, and tested its response to ultra-cold neutrons at the Los Alamos Neutron Science Center (LANSCE). We observed simultaneous events on both sandwiching sensors without significant loss of detection efficiency. The efficiency was evaluated to be about 16%, relative to the 10B/ZnS reference detector. The coincidence condition reduces its efficiency by a factor of about 3. △ Less

Submitted 19 April, 2024; originally announced April 2024.

Keck Primary Mirror Closed-Loop Segment Control using a Vector-Zernike Wavefront Sensor

Authors: Maissa Salama, Charlotte Guthery, Vincent Chambouleyron, Rebecca Jensen-Clem, J. Kent Wallace, Jacques-Robert Delorme, Mitchell Troy, Tobias Wenger, Daniel Echeverri, Luke Finnerty, Nemanja Jovanovic, Joshua Liberman, Ronald A. Lopez, Dimitri Mawet, Evan C. Morris, Maaike van Kooten, Jason J. Wang, Peter Wizinowich, Yinzi Xin, Jerry Xuan

Abstract: We present the first on-sky segmented primary mirror closed-loop piston control using a Zernike wavefront sensor (ZWFS) installed on the Keck II telescope. Segment co-phasing errors are a primary contributor to contrast limits on Keck and will be necessary to correct for the next generation of space missions and ground-based extremely large telescopes (ELTs), which will all have segmented primary… ▽ More We present the first on-sky segmented primary mirror closed-loop piston control using a Zernike wavefront sensor (ZWFS) installed on the Keck II telescope. Segment co-phasing errors are a primary contributor to contrast limits on Keck and will be necessary to correct for the next generation of space missions and ground-based extremely large telescopes (ELTs), which will all have segmented primary mirrors. The goal of the ZWFS installed on Keck is to monitor and correct primary mirror co-phasing errors in parallel with science observations. The ZWFS is ideal for measuring phase discontinuities such as segment co-phasing errors and is one of the most sensitive WFS, but has limited dynamic range. The vector-ZWFS at Keck works on the adaptive optics (AO) corrected wavefront and consists of a metasurface focal plane mask which imposes two different phase shifts on the core of the point spread function (PSF) to two orthogonal light polarizations, producing two pupil images. This design extends the dynamic range compared with the scalar ZWFS. The primary mirror segment pistons were controlled in closed-loop using the ZWFS, improving the Strehl ratio on the NIRC2 science camera by up to 10 percentage points. We analyze the performance of the closed-loop tests, the impact on NIRC2 science data, and discuss the ZWFS measurements. △ Less

Submitted 12 April, 2024; originally announced April 2024.

Comments: Accepted for publication in the Astrophysical Journal (ApJ). 17 pages, 16 figures

LLM Guided Evolution -- The Automation of Models Advancing Models

Authors: Clint Morris, Michael Jurado, Jason Zutty

Abstract: In the realm of machine learning, traditional model development and automated approaches like AutoML typically rely on layers of abstraction, such as tree-based or Cartesian genetic programming. Our study introduces "Guided Evolution" (GE), a novel framework that diverges from these methods by utilizing Large Language Models (LLMs) to directly modify code. GE leverages LLMs for a more intelligent,… ▽ More In the realm of machine learning, traditional model development and automated approaches like AutoML typically rely on layers of abstraction, such as tree-based or Cartesian genetic programming. Our study introduces "Guided Evolution" (GE), a novel framework that diverges from these methods by utilizing Large Language Models (LLMs) to directly modify code. GE leverages LLMs for a more intelligent, supervised evolutionary process, guiding mutations and crossovers. Our unique "Evolution of Thought" (EoT) technique further enhances GE by enabling LLMs to reflect on and learn from the outcomes of previous mutations. This results in a self-sustaining feedback loop that augments decision-making in model evolution. GE maintains genetic diversity, crucial for evolutionary algorithms, by leveraging LLMs' capability to generate diverse responses from expertly crafted prompts and modulate model temperature. This not only accelerates the evolution process but also injects expert like creativity and insight into the process. Our application of GE in evolving the ExquisiteNetV2 model demonstrates its efficacy: the LLM-driven GE autonomously produced variants with improved accuracy, increasing from 92.52% to 93.34%, without compromising model compactness. This underscores the potential of LLMs to accelerate the traditional model design pipeline, enabling models to autonomously evolve and enhance their own designs. △ Less

Submitted 17 March, 2024; originally announced March 2024.

Performance of a modular ton-scale pixel-readout liquid argon time projection chamber

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, T. Alves, H. Amar, P. Amedo, J. Anderson, D. A. Andrade , et al. (1340 additional authors not shown)

Abstract: The Module-0 Demonstrator is a single-phase 600 kg liquid argon time projection chamber operated as a prototype for the DUNE liquid argon near detector. Based on the ArgonCube design concept, Module-0 features a novel 80k-channel pixelated charge readout and advanced high-coverage photon detection system. In this paper, we present an analysis of an eight-day data set consisting of 25 million cosmi… ▽ More The Module-0 Demonstrator is a single-phase 600 kg liquid argon time projection chamber operated as a prototype for the DUNE liquid argon near detector. Based on the ArgonCube design concept, Module-0 features a novel 80k-channel pixelated charge readout and advanced high-coverage photon detection system. In this paper, we present an analysis of an eight-day data set consisting of 25 million cosmic ray events collected in the spring of 2021. We use this sample to demonstrate the imaging performance of the charge and light readout systems as well as the signal correlations between the two. We also report argon purity and detector uniformity measurements, and provide comparisons to detector simulations. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Comments: 47 pages, 41 figures

Report number: FERMILAB-PUB-24-0073-LBNF

Weisfeiler-Leman at the margin: When more expressivity matters

Authors: Billy J. Franks, Christopher Morris, Ameya Velingker, Floris Geerts

Abstract: The Weisfeiler-Leman algorithm ($1$-WL) is a well-studied heuristic for the graph isomorphism problem. Recently, the algorithm has played a prominent role in understanding the expressive power of message-passing graph neural networks (MPNNs) and being effective as a graph kernel. Despite its success, $1$-WL faces challenges in distinguishing non-isomorphic graphs, leading to the development of mor… ▽ More The Weisfeiler-Leman algorithm ($1$-WL) is a well-studied heuristic for the graph isomorphism problem. Recently, the algorithm has played a prominent role in understanding the expressive power of message-passing graph neural networks (MPNNs) and being effective as a graph kernel. Despite its success, $1$-WL faces challenges in distinguishing non-isomorphic graphs, leading to the development of more expressive MPNN and kernel architectures. However, the relationship between enhanced expressivity and improved generalization performance remains unclear. Here, we show that an architecture's expressivity offers limited insights into its generalization performance when viewed through graph isomorphism. Moreover, we focus on augmenting $1$-WL and MPNNs with subgraph information and employ classical margin theory to investigate the conditions under which an architecture's increased expressivity aligns with improved generalization performance. In addition, we show that gradient flow pushes the MPNN's weights toward the maximum margin solution. Further, we introduce variations of expressive $1$-WL-based kernel and MPNN architectures with provable generalization properties. Our empirical study confirms the validity of our theoretical findings. △ Less

Submitted 28 May, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

Comments: Accepted at ICML 2024. arXiv admin note: text overlap with arXiv:2301.11039

Future Directions in the Theory of Graph Machine Learning

Authors: Christopher Morris, Fabrizio Frasca, Nadav Dym, Haggai Maron, İsmail İlkan Ceylan, Ron Levie, Derek Lim, Michael Bronstein, Martin Grohe, Stefanie Jegelka

Abstract: Machine learning on graphs, especially using graph neural networks (GNNs), has seen a surge in interest due to the wide availability of graph data across a broad spectrum of disciplines, from life to social and engineering sciences. Despite their practical success, our theoretical understanding of the properties of GNNs remains highly incomplete. Recent theoretical advancements primarily focus on… ▽ More Machine learning on graphs, especially using graph neural networks (GNNs), has seen a surge in interest due to the wide availability of graph data across a broad spectrum of disciplines, from life to social and engineering sciences. Despite their practical success, our theoretical understanding of the properties of GNNs remains highly incomplete. Recent theoretical advancements primarily focus on elucidating the coarse-grained expressive power of GNNs, predominantly employing combinatorial techniques. However, these studies do not perfectly align with practice, particularly in understanding the generalization behavior of GNNs when trained with stochastic first-order optimization techniques. In this position paper, we argue that the graph machine learning community needs to shift its attention to developing a balanced theory of graph machine learning, focusing on a more thorough understanding of the interplay of expressive power, generalization, and optimization. △ Less

Submitted 14 June, 2024; v1 submitted 3 February, 2024; originally announced February 2024.

Comments: ICML 2024

Doping Liquid Argon with Xenon in ProtoDUNE Single-Phase: Effects on Scintillation Light

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, H. Amar Es-sghir, P. Amedo, J. Anderson, D. A. Andrade, C. Andreopoulos , et al. (1297 additional authors not shown)

Abstract: Doping of liquid argon TPCs (LArTPCs) with a small concentration of xenon is a technique for light-shifting and facilitates the detection of the liquid argon scintillation light. In this paper, we present the results of the first doping test ever performed in a kiloton-scale LArTPC. From February to May 2020, we carried out this special run in the single-phase DUNE Far Detector prototype (ProtoDUN… ▽ More Doping of liquid argon TPCs (LArTPCs) with a small concentration of xenon is a technique for light-shifting and facilitates the detection of the liquid argon scintillation light. In this paper, we present the results of the first doping test ever performed in a kiloton-scale LArTPC. From February to May 2020, we carried out this special run in the single-phase DUNE Far Detector prototype (ProtoDUNE-SP) at CERN, featuring 720 t of total liquid argon mass with 410 t of fiducial mass. A 5.4 ppm nitrogen contamination was present during the xenon doping campaign. The goal of the run was to measure the light and charge response of the detector to the addition of xenon, up to a concentration of 18.8 ppm. The main purpose was to test the possibility for reduction of non-uniformities in light collection, caused by deployment of photon detectors only within the anode planes. Light collection was analysed as a function of the xenon concentration, by using the pre-existing photon detection system (PDS) of ProtoDUNE-SP and an additional smaller set-up installed specifically for this run. In this paper we first summarize our current understanding of the argon-xenon energy transfer process and the impact of the presence of nitrogen in argon with and without xenon dopant. We then describe the key elements of ProtoDUNE-SP and the injection method deployed. Two dedicated photon detectors were able to collect the light produced by xenon and the total light. The ratio of these components was measured to be about 0.65 as 18.8 ppm of xenon were injected. We performed studies of the collection efficiency as a function of the distance between tracks and light detectors, demonstrating enhanced uniformity of response for the anode-mounted PDS. We also show that xenon doping can substantially recover light losses due to contamination of the liquid argon by nitrogen. △ Less

Submitted 2 August, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

Comments: 36 pages, 20 figures. Corrected author list; corrected typos across paper and polished text

Report number: CERN-EP-2024-024; FERMILAB-PUB-23-0819-LBNF

The most variable VVV sources: eruptive protostars, dipping giants in the Nuclear Disc and others

Authors: P. W. Lucas, L. C. Smith, Z. Guo, C. Contreras Peña, D. Minniti, N. Miller, J. Alonso-García, M. Catelan, J. Borissova, R. K. Saito, R. Kurtev, M. G. Navarro, C. Morris, H. Muthu, D. Froebrich, V. D. Ivanov, A. Bayo, A. Caratti o Garatti, J. L. Sanders

Abstract: We have performed a comprehensive search of a VISTA Variables in the Via Lactea (VVV) database of 9.5 yr light curves for variable sources with $ΔK_s \ge 4$ mag, aiming to provide a large sample of high amplitude eruptive young stellar objects (YSOs) and detect unusual or new types of infrared variable source. We find 222 variable or transient sources in the Galactic bulge and disc, most of which… ▽ More We have performed a comprehensive search of a VISTA Variables in the Via Lactea (VVV) database of 9.5 yr light curves for variable sources with $ΔK_s \ge 4$ mag, aiming to provide a large sample of high amplitude eruptive young stellar objects (YSOs) and detect unusual or new types of infrared variable source. We find 222 variable or transient sources in the Galactic bulge and disc, most of which are new discoveries. The sample mainly comprises novae, YSOs, microlensing events, Long Period Variable stars (LPVs) and a few rare or unclassified sources. Additionally, we report the discovery of a significant population of aperiodic late-type giant stars suffering deep extinction events, strongly clustered in the Nuclear Disc of the Milky Way. We suggest that these are metal-rich stars in which radiatively driven mass loss has been enhanced by super-solar metallicity. Among the YSOs, 32/40 appear to be undergoing episodic accretion. Long-lasting YSO eruptions have a typical rise time of $\sim$2 yr, somewhat slower than the 6-12 month timescale seen in the few historical events observed on the rise. The outburst durations are usually at least 5 yr, somewhat longer than many lower amplitude VVV events detected previously. The light curves are diverse in nature, suggesting that multiple types of disc instability may occur. Eight long-duration extinction events are seen wherein the YSO dims for a year or more, attributable to inner disc structure. One binary YSO in NGC 6530 displays periodic extinction events (P=59 days) similar to KH 15D. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: Accepted by MNRAS. 38 pages. Full source lists and light curves are available in the Ancillary Files

Multi-wavelength detection of an ongoing FUOr-type outburst on a low-mass YSO

Authors: Zhen Guo, P. W. Lucas, R. G. Kurtev, J. Borissova, V. Elbakyan, C. Morris, A. Bayo, L. Smith, A. Caratti o Garatti, C. Contreras Peña, D. Minniti, J. Jose, M. Ashraf, J. Alonso-García, N. Miller, H. D. S. Muthu

Abstract: During the pre-main-sequence evolution, Young Stellar Objects (YSOs) assemble most of their mass during the episodic accretion process. The rarely seen FUOr-type events (FUOrs) are valuable laboratories to investigate the outbursting nature of YSOs. Here, we present multi-wavelength detection of a high-amplitude eruptive source in the young open cluster VdBH 221 with an ongoing outburst, including… ▽ More During the pre-main-sequence evolution, Young Stellar Objects (YSOs) assemble most of their mass during the episodic accretion process. The rarely seen FUOr-type events (FUOrs) are valuable laboratories to investigate the outbursting nature of YSOs. Here, we present multi-wavelength detection of a high-amplitude eruptive source in the young open cluster VdBH 221 with an ongoing outburst, including optical to mid-infrared time series and near-infrared spectra. The initial outburst has an exceptional amplitude of $>$6.3 mag in Gaia and 4.6 mag in $K_s$, with a peak luminosity up to 16 $L_{\odot}$ and a peak mass accretion rate of 1.4 $\times$ 10$^{-5}$ $M_\odot$ yr$^{-1}$. The optical to infrared spectral energy distribution (SED) of this object is consistent with a low-mass star (0.2$M_\odot$) with a modest extinction ($A_V < 2$ mag). A 100-d delay between optical and infrared rising stages is detected, suggesting an outside-in origin of the instability. The spectroscopic features of this object reveal a self-luminous accretion disc, very similar to FU Orionis, with a low line-of-sight extinction. Most recently, there has been a gradual increase in brightness throughout the wavelength range, possibly suggesting an enhancement of the mass accretion rate. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: 10 pages, 8 figures

Spectroscopic confirmation of high-amplitude eruptive YSOs and dipping giants from the VVV survey

Authors: Zhen Guo, P. W. Lucas, R. Kurtev, J. Borissova, C. Contreras Peña, S. N. Yurchenko, L. C. Smith, D. Minniti, R. K. Saito, A. Bayo, M. Catelan, J. Alonso-García, A. Caratti o Garatti, C. Morris, D. Froebrich, J. Tennyson, K. Maucó, A. Aguayo, N. Miller, H. D. S. Muthu

Abstract: During the pre-main-sequence (pre-MS) evolution stage of a star, significant amounts of stellar mass are accreted during episodic accretion events, such as multi-decade FUor-type outbursts. Here, we present a near-infrared spectroscopic follow-up study of 33 high-amplitude (most with $ΔK_s$ > 4 mag) variable sources discovered by the Vista Variables in the Via Lactea (VVV) survey. Based on the spe… ▽ More During the pre-main-sequence (pre-MS) evolution stage of a star, significant amounts of stellar mass are accreted during episodic accretion events, such as multi-decade FUor-type outbursts. Here, we present a near-infrared spectroscopic follow-up study of 33 high-amplitude (most with $ΔK_s$ > 4 mag) variable sources discovered by the Vista Variables in the Via Lactea (VVV) survey. Based on the spectral features, 25 sources are classified as eruptive young stellar objects (YSOs), including 15 newly identified FUors, six with long-lasting but EXor-like bursts of magnetospheric accretion and four displaying outflow-dominated spectra. By examining the photometric behaviours of eruptive YSOs, we found most FUor-type outbursts have higher amplitudes ($ΔK_s$ and $ΔW2$), faster eruptive timescales and bluer infrared colours than the other outburst types. In addition, we identified seven post-main sequence variables apparently associated with deep dipping events and an eruptive star with deep AlO absorption bands resembling those seen in the V838 Mon stellar merger. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: 20 pages, 16 figures

Towards Principled Graph Transformers

Authors: Luis Müller, Daniel Kusuma, Blai Bonet, Christopher Morris

Abstract: Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world tasks, limiting their practical impact. In contrast, global attention-based models such as graph transformers demonstrate strong performance in practice, but com… ▽ More Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world tasks, limiting their practical impact. In contrast, global attention-based models such as graph transformers demonstrate strong performance in practice, but comparing their expressive power with the k-WL hierarchy remains challenging, particularly since these architectures rely on positional or structural encodings for their expressivity and predictive performance. To address this, we show that the recently proposed Edge Transformer, a global attention model operating on node pairs instead of nodes, has at least 3-WL expressive power. Empirically, we demonstrate that the Edge Transformer surpasses other theoretically aligned architectures regarding predictive performance while not relying on positional or structural encodings. Our code is available at https://github.com/luis-mueller/towards-principled-gts △ Less

Submitted 24 May, 2024; v1 submitted 18 January, 2024; originally announced January 2024.

The DUNE Far Detector Vertical Drift Technology, Technical Design Report

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, H. Amar, P. Amedo, J. Anderson, D. A. Andrade, C. Andreopoulos , et al. (1304 additional authors not shown)

Abstract: DUNE is an international experiment dedicated to addressing some of the questions at the forefront of particle physics and astrophysics, including the mystifying preponderance of matter over antimatter in the early universe. The dual-site experiment will employ an intense neutrino beam focused on a near and a far detector as it aims to determine the neutrino mass hierarchy and to make high-precisi… ▽ More DUNE is an international experiment dedicated to addressing some of the questions at the forefront of particle physics and astrophysics, including the mystifying preponderance of matter over antimatter in the early universe. The dual-site experiment will employ an intense neutrino beam focused on a near and a far detector as it aims to determine the neutrino mass hierarchy and to make high-precision measurements of the PMNS matrix parameters, including the CP-violating phase. It will also stand ready to observe supernova neutrino bursts, and seeks to observe nucleon decay as a signature of a grand unified theory underlying the standard model. The DUNE far detector implements liquid argon time-projection chamber (LArTPC) technology, and combines the many tens-of-kiloton fiducial mass necessary for rare event searches with the sub-centimeter spatial resolution required to image those events with high precision. The addition of a photon detection system enhances physics capabilities for all DUNE physics drivers and opens prospects for further physics explorations. Given its size, the far detector will be implemented as a set of modules, with LArTPC designs that differ from one another as newer technologies arise. In the vertical drift LArTPC design, a horizontal cathode bisects the detector, creating two stacked drift volumes in which ionization charges drift towards anodes at either the top or bottom. The anodes are composed of perforated PCB layers with conductive strips, enabling reconstruction in 3D. Light-trap-style photon detection modules are placed both on the cryostat's side walls and on the central cathode where they are optically powered. This Technical Design Report describes in detail the technical implementations of each subsystem of this LArTPC that, together with the other far detector modules and the near detector, will enable DUNE to achieve its physics goals. △ Less

Submitted 5 December, 2023; originally announced December 2023.

Comments: 425 pages; 281 figures Central editing team: A. Heavey, S. Kettell, A. Marchionni, S. Palestini, S. Rajogopalan, R. J. Wilson

Report number: Fermilab Report no: TM-2813-LBNF

Neural Network Methods for Radiation Detectors and Imaging

Authors: S. Lin, S. Ning, H. Zhu, T. Zhou, C. L. Morris, S. Clayton, M. Cherukara, R. T. Chen, Z. Wang

Abstract: Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed artificial intelligence. We give an overview of data generation at photon sources, deep learning-based methods for image processing tasks, and hardware solutions… ▽ More Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed artificial intelligence. We give an overview of data generation at photon sources, deep learning-based methods for image processing tasks, and hardware solutions for deep learning acceleration. Most existing deep learning approaches are trained offline, typically using large amounts of computational resources. However, once trained, DNNs can achieve fast inference speeds and can be deployed to edge devices. A new trend is edge computing with less energy consumption (hundreds of watts or less) and real-time analysis potential. While popularly used for edge computing, electronic-based hardware accelerators ranging from general purpose processors such as central processing units (CPUs) to application-specific integrated circuits (ASICs) are constantly reaching performance limits in latency, energy consumption, and other physical constraints. These limits give rise to next-generation analog neuromorhpic hardware platforms, such as optical neural networks (ONNs), for high parallel, low latency, and low energy computing to boost deep learning acceleration. △ Less

Submitted 9 November, 2023; originally announced November 2023.

Report number: LA-UR-23-32395

VVV-WIT-12 and its fashionable nebula: a four year long period Young Stellar Object with a light echo?

Authors: Roberto K. Saito, Bringfried Stecklum, Dante Minniti, Philip W. Lucas, Zhen Guo, Leigh C. Smith, Luciano Fraga, Felipe Navarete, Juan Carlos Beamín, Calum Morris

Abstract: We report the serendipitous discovery of VVV-WIT-12, an unusual variable source that seems to induce variability in its surrounding nebula. The source belongs to the rare objects that we call WITs (short for What Is This?) discovered within the VISTA Variables in the Vía Láctea (VVV) survey. VVV-WIT-12 was discovered during a pilot search for light echoes from distant Supernovae (SNe) in the Milky… ▽ More We report the serendipitous discovery of VVV-WIT-12, an unusual variable source that seems to induce variability in its surrounding nebula. The source belongs to the rare objects that we call WITs (short for What Is This?) discovered within the VISTA Variables in the Vía Láctea (VVV) survey. VVV-WIT-12 was discovered during a pilot search for light echoes from distant Supernovae (SNe) in the Milky Way using the near-IR images of the VVV survey. This source has an extremely red spectral energy distribution, consistent with a very reddened ($A_V \sim 100$ mag) long period variable star ($P\sim1525$ days). Furthermore, it is enshrouded in a nebula that changes brightness and color with time, apparently in synch with the central source variations. The near-IR light curve and complementary follow-up spectroscopy observations are consistent with a variable Young Stellar Object (YSO) illuminating its surrounding nebula. In this case the source periodic variation along the cycles produces an unprecedented light echo in the different regions of the nebula. △ Less

Submitted 2 November, 2023; originally announced November 2023.

Comments: Accepted for publication in The Astrophysical Journal Letters

Exploring the Power of Graph Neural Networks in Solving Linear Optimization Problems

Authors: Chendi Qian, Didier Chételat, Christopher Morris

Abstract: Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating computational intensive heuristics like strong branching, which entails solving multiple linear optimization problems (LPs). Despite the empirical success, the rea… ▽ More Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating computational intensive heuristics like strong branching, which entails solving multiple linear optimization problems (LPs). Despite the empirical success, the reasons behind MPNNs' effectiveness in emulating linear optimization remain largely unclear. Here, we show that MPNNs can simulate standard interior-point methods for LPs, explaining their practical success. Furthermore, we highlight how MPNNs can serve as a lightweight proxy for solving LPs, adapting to a given problem instance distribution. Empirically, we show that MPNNs solve LP relaxations of standard combinatorial optimization problems close to optimality, often surpassing conventional solvers and competing approaches in solving time. △ Less

Submitted 16 October, 2023; originally announced October 2023.

Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasets

Authors: Dominique Beaini, Shenyang Huang, Joao Alex Cunha, Zhiyi Li, Gabriela Moisescu-Pareja, Oleksandr Dymov, Samuel Maddrell-Mander, Callum McLean, Frederik Wenkel, Luis Müller, Jama Hussein Mohamud, Ali Parviz, Michael Craig, Michał Koziarski, Jiarui Lu, Zhaocheng Zhu, Cristian Gabellini, Kerstin Klaser, Josef Dean, Cas Wognum, Maciej Sypetkowski, Guillaume Rabusseau, Reihaneh Rabbany, Jian Tang, Christopher Morris , et al. (10 additional authors not shown)

Abstract: Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by… ▽ More Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by size into three distinct categories: ToyMix, LargeMix and UltraLarge. These datasets push the boundaries in both the scale and the diversity of supervised labels for molecular learning. They cover nearly 100 million molecules and over 3000 sparsely defined tasks, totaling more than 13 billion individual labels of both quantum and biological nature. In comparison, our datasets contain 300 times more data points than the widely used OGB-LSC PCQM4Mv2 dataset, and 13 times more than the quantum-only QM1B dataset. In addition, to support the development of foundational models based on our proposed datasets, we present the Graphium graph machine learning library which simplifies the process of building and training molecular machine learning models for multi-task and multi-level molecular datasets. Finally, we present a range of baseline results as a starting point of multi-task and multi-level training on these datasets. Empirically, we observe that performance on low-resource biological datasets show improvement by also training on large amounts of quantum data. This indicates that there may be potential in multi-task and multi-level training of a foundation model and fine-tuning it to resource-constrained downstream tasks. △ Less

Submitted 18 October, 2023; v1 submitted 6 October, 2023; originally announced October 2023.

Probabilistically Rewired Message-Passing Neural Networks

Authors: Chendi Qian, Andrei Manolache, Kareem Ahmed, Zhe Zeng, Guy Van den Broeck, Mathias Niepert, Christopher Morris

Abstract: Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Furthermore, their local aggregation mechanism can lead to problems such as over-squashing and limited expressive power in capturing relevant graph structures. Existing solutions to t… ▽ More Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Furthermore, their local aggregation mechanism can lead to problems such as over-squashing and limited expressive power in capturing relevant graph structures. Existing solutions to these challenges have primarily relied on heuristic methods, often disregarding the underlying data distribution. Hence, devising principled approaches for learning to infer graph structures relevant to the given prediction task remains an open challenge. In this work, leveraging recent progress in exact and differentiable $k$-subset sampling, we devise probabilistically rewired MPNNs (PR-MPNNs), which learn to add relevant edges while omitting less beneficial ones. For the first time, our theoretical analysis explores how PR-MPNNs enhance expressive power, and we identify precise conditions under which they outperform purely randomized approaches. Empirically, we demonstrate that our approach effectively mitigates issues like over-squashing and under-reaching. In addition, on established real-world datasets, our method exhibits competitive or superior predictive performance compared to traditional MPNN models and recent graph transformer architectures. △ Less

Submitted 26 March, 2024; v1 submitted 3 October, 2023; originally announced October 2023.

Comments: ICLR 2024

Scintillation characteristics of the EJ-299-02H scintillator

Authors: N. Floyd, Md. T. Hassan, Z. Tang, M. Krivos, M. Blatnik, S. M. Clayton, C. Cude-Woods, A. T. Holley, T. M. Ito, B. A. Johnson, C. -Y. Liu, M. Makela, C. L. Morris, A. S. C. Navazo, C. M. O'Shaughnessy, E. L. Renner, R. W. Pattie, A. R. Young

Abstract: A study of the dead layer thickness and quenching factor of a plastic scintillator for use in ultracold neutron (UCN) experiments is described. Alpha spectroscopy was used to determine the thickness of a thin surface dead layer, and the relative light outputs from the decay of $^{241}$Am and Compton scattering of electrons were used to extract the quenching parameter. With these characteristics of… ▽ More A study of the dead layer thickness and quenching factor of a plastic scintillator for use in ultracold neutron (UCN) experiments is described. Alpha spectroscopy was used to determine the thickness of a thin surface dead layer, and the relative light outputs from the decay of $^{241}$Am and Compton scattering of electrons were used to extract the quenching parameter. With these characteristics of the material known, the light yield of the scintillator can be calculated. The ability to make these scintillators deuterated, accompanied by its relatively thin dead layer, make it ideal for use in UCN experiment, where the light yield of decay electrons and alphas from neutron capture are critical for counting events. △ Less

Submitted 27 March, 2024; v1 submitted 29 September, 2023; originally announced October 2023.

Fundamental Neutron Physics: a White Paper on Progress and Prospects in the US

Authors: R. Alarcon, A. Aleksandrova, S. Baeßler, D. H. Beck, T. Bhattacharya, M. Blatnik, T. J. Bowles, J. D. Bowman, J. Brewington, L. J. Broussard, A. Bryant, J. F. Burdine, J. Caylor, Y. Chen, J. H. Choi, L. Christie, T. E. Chupp, V. Cianciolo, V. Cirigliano, S. M. Clayton, B. Collett, C. Crawford, W. Dekens, M. Demarteau, D. DeMille , et al. (66 additional authors not shown)

Abstract: Fundamental neutron physics, combining precision measurements and theory, probes particle physics at short range with reach well beyond the highest energies probed by the LHC. Significant US efforts are underway that will probe BSM CP violation with orders of magnitude more sensitivity, provide new data on the Cabibbo anomaly, more precisely measure the neutron lifetime and decay, and explore hadr… ▽ More Fundamental neutron physics, combining precision measurements and theory, probes particle physics at short range with reach well beyond the highest energies probed by the LHC. Significant US efforts are underway that will probe BSM CP violation with orders of magnitude more sensitivity, provide new data on the Cabibbo anomaly, more precisely measure the neutron lifetime and decay, and explore hadronic parity violation. World-leading results from the US Fundamental Neutron Physics community since the last Long Range Plan, include the world's most precise measurement of the neutron lifetime from UCN$τ$, the final results on the beta-asymmetry from UCNA and new results on hadronic parity violation from the NPDGamma and n-${^3}$He runs at the FNPB (Fundamental Neutron Physics Beamline), precision measurement of the radiative neutron decay mode and n-${}^4$He at NIST. US leadership and discovery potential are ensured by the development of new high-impact experiments including BL3, Nab, LANL nEDM and nEDM@SNS. On the theory side, the last few years have seen results for the neutron EDM from the QCD $θ$ term, a factor of two reduction in the uncertainty for inner radiative corrections in beta-decay which impacts CKM unitarity, and progress on {\it ab initio} calculations of nuclear structure for medium-mass and heavy nuclei which can eventually improve the connection between nuclear and nucleon EDMs. In order to maintain this exciting program and capitalize on past investments while also pursuing new ideas and building US leadership in new areas, the Fundamental Neutron Physics community has identified a number of priorities and opportunities for our sub-field covering the time-frame of the last Long Range Plan (LRP) under development. This white paper elaborates on these priorities. △ Less

Submitted 17 August, 2023; originally announced August 2023.

Comments: arXiv admin note: text overlap with arXiv:2304.03451

Fine-grained Expressivity of Graph Neural Networks

Authors: Jan Böker, Ron Levie, Ningyuan Huang, Soledad Villar, Christopher Morris

Abstract: Numerous recent works have analyzed the expressive power of message-passing graph neural networks (MPNNs), primarily utilizing combinatorial techniques such as the $1$-dimensional Weisfeiler-Leman test ($1$-WL) for the graph isomorphism problem. However, the graph isomorphism objective is inherently binary, not giving insights into the degree of similarity between two given graphs. This work resol… ▽ More Numerous recent works have analyzed the expressive power of message-passing graph neural networks (MPNNs), primarily utilizing combinatorial techniques such as the $1$-dimensional Weisfeiler-Leman test ($1$-WL) for the graph isomorphism problem. However, the graph isomorphism objective is inherently binary, not giving insights into the degree of similarity between two given graphs. This work resolves this issue by considering continuous extensions of both $1$-WL and MPNNs to graphons. Concretely, we show that the continuous variant of $1$-WL delivers an accurate topological characterization of the expressive power of MPNNs on graphons, revealing which graphs these networks can distinguish and the level of difficulty in separating them. We identify the finest topology where MPNNs separate points and prove a universal approximation theorem. Consequently, we provide a theoretical framework for graph and graphon similarity combining various topological variants of classical characterizations of the $1$-WL. In particular, we characterize the expressive power of MPNNs in terms of the tree distance, which is a graph distance based on the concept of fractional isomorphisms, and substructure counts via tree homomorphisms, showing that these concepts have the same expressive power as the $1$-WL and MPNNs on graphons. Empirically, we validate our theoretical findings by showing that randomly initialized MPNNs, without training, exhibit competitive performance compared to their trained counterparts. Moreover, we evaluate different MPNN architectures based on their ability to preserve graph distances, highlighting the significance of our continuous $1$-WL test in understanding MPNNs' expressivity. △ Less

Submitted 2 November, 2023; v1 submitted 6 June, 2023; originally announced June 2023.

Comments: Accepted at NeurIPS 2023

Demonstration of Sub-micron UCN Position Resolution using Room-temperature CMOS Sensor

Authors: S. Lin, J. K. Baldwin, M. Blatnik, S. M. Clayton, C. Cude-Woods, S. A. Currie, B. Filippone, E. M. Fries, P. Geltenbort, A. T. Holley, W. Li, C. Y. Liu, M. Makela, C. L. Morris, R. Musedinovic, C. O'Shaughnessy, R. W. Pattie, D. J. Salvat, A. Saunders, E. I. Sharapov, M. Singh, X. Sun, Z. Tang, W. Uhrich, W. Wei , et al. (3 additional authors not shown)

Abstract: High spatial resolution of ultracold neutron (UCN) measurement is of growing interest to UCN experiments such as UCN spectrometers, UCN polarimeters, quantum physics of UCNs, and quantum gravity. Here we utilize physics-informed deep learning to enhance the experimental position resolution and to demonstrate sub-micron spatial resolutions for UCN position measurements obtained using a room-tempera… ▽ More High spatial resolution of ultracold neutron (UCN) measurement is of growing interest to UCN experiments such as UCN spectrometers, UCN polarimeters, quantum physics of UCNs, and quantum gravity. Here we utilize physics-informed deep learning to enhance the experimental position resolution and to demonstrate sub-micron spatial resolutions for UCN position measurements obtained using a room-temperature CMOS sensor, extending our previous work [1, 2] that demonstrated a position uncertainty of 1.5 microns. We explore the use of the open-source software Allpix Squared to generate experiment-like synthetic hit images with ground-truth position labels. We use physics-informed deep learning by training a fully-connected neural network (FCNN) to learn a mapping from input hit images to output hit position. The automated analysis for sub-micron position resolution in UCN detection combined with the fast data rates of current and next generation UCN sources will enable improved precision for future UCN research and applications. △ Less

Submitted 16 May, 2023; originally announced May 2023.

Impact of cross-section uncertainties on supernova neutrino spectral parameter fitting in the Deep Underground Neutrino Experiment

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, Z. Ahmad, J. Ahmed, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, A. Alton, R. Alvarez, P. Amedo, J. Anderson, D. A. Andrade , et al. (1294 additional authors not shown)

Abstract: A primary goal of the upcoming Deep Underground Neutrino Experiment (DUNE) is to measure the $\mathcal{O}(10)$ MeV neutrinos produced by a Galactic core-collapse supernova if one should occur during the lifetime of the experiment. The liquid-argon-based detectors planned for DUNE are expected to be uniquely sensitive to the $ν_e$ component of the supernova flux, enabling a wide variety of physics… ▽ More A primary goal of the upcoming Deep Underground Neutrino Experiment (DUNE) is to measure the $\mathcal{O}(10)$ MeV neutrinos produced by a Galactic core-collapse supernova if one should occur during the lifetime of the experiment. The liquid-argon-based detectors planned for DUNE are expected to be uniquely sensitive to the $ν_e$ component of the supernova flux, enabling a wide variety of physics and astrophysics measurements. A key requirement for a correct interpretation of these measurements is a good understanding of the energy-dependent total cross section $σ(E_ν)$ for charged-current $ν_e$ absorption on argon. In the context of a simulated extraction of supernova $ν_e$ spectral parameters from a toy analysis, we investigate the impact of $σ(E_ν)$ modeling uncertainties on DUNE's supernova neutrino physics sensitivity for the first time. We find that the currently large theoretical uncertainties on $σ(E_ν)$ must be substantially reduced before the $ν_e$ flux parameters can be extracted reliably: in the absence of external constraints, a measurement of the integrated neutrino luminosity with less than 10\% bias with DUNE requires $σ(E_ν)$ to be known to about 5%. The neutrino spectral shape parameters can be known to better than 10% for a 20% uncertainty on the cross-section scale, although they will be sensitive to uncertainties on the shape of $σ(E_ν)$. A direct measurement of low-energy $ν_e$-argon scattering would be invaluable for improving the theoretical precision to the needed level. △ Less

Submitted 7 July, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

Comments: 25 pages, 21 figures

Report number: FERMILAB-PUB-23-132-CSAID-LBNF-ND-T

Journal ref: Phys. Rev. D 107, 112012 (2023)

ST-MFNet Mini: Knowledge Distillation-Driven Frame Interpolation

Authors: Crispian Morris, Duolikun Danier, Fan Zhang, Nantheera Anantrasirichai, David R. Bull

Abstract: Currently, one of the major challenges in deep learning-based video frame interpolation (VFI) is the large model sizes and high computational complexity associated with many high performance VFI approaches. In this paper, we present a distillation-based two-stage workflow for obtaining compressed VFI models which perform competitively to the state of the arts, at a greatly reduced model size and c… ▽ More Currently, one of the major challenges in deep learning-based video frame interpolation (VFI) is the large model sizes and high computational complexity associated with many high performance VFI approaches. In this paper, we present a distillation-based two-stage workflow for obtaining compressed VFI models which perform competitively to the state of the arts, at a greatly reduced model size and complexity. Specifically, an optimisation-based network pruning method is first applied to a recently proposed frame interpolation model, ST-MFNet, which outperforms many other VFI methods but suffers from large model size. The resulting new network architecture achieves a 91% reduction in parameters and 35% increase in speed. Secondly, the performance of the new network is further enhanced through a teacher-student knowledge distillation training process using a Laplacian distillation loss. The final low complexity model, ST-MFNet Mini, achieves a comparable performance to most existing high-complex VFI methods, only outperformed by the original ST-MFNet. Our source code is available at https://github.com/crispianm/ST-MFNet-Mini △ Less

Submitted 23 February, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Attending to Graph Transformers

Authors: Luis Müller, Mikhail Galkin, Christopher Morris, Ladislav Rampášek

Abstract: Recently, transformer architectures for graphs emerged as an alternative to established techniques for machine learning with graphs, such as (message-passing) graph neural networks. So far, they have shown promising empirical results, e.g., on molecular prediction datasets, often attributed to their ability to circumvent graph neural networks' shortcomings, such as over-smoothing and over-squashin… ▽ More Recently, transformer architectures for graphs emerged as an alternative to established techniques for machine learning with graphs, such as (message-passing) graph neural networks. So far, they have shown promising empirical results, e.g., on molecular prediction datasets, often attributed to their ability to circumvent graph neural networks' shortcomings, such as over-smoothing and over-squashing. Here, we derive a taxonomy of graph transformer architectures, bringing some order to this emerging field. We overview their theoretical properties, survey structural and positional encodings, and discuss extensions for important graph classes, e.g., 3D molecular graphs. Empirically, we probe how well graph transformers can recover various graph properties, how well they can deal with heterophilic graphs, and to what extent they prevent over-squashing. Further, we outline open challenges and research direction to stimulate future work. Our code is available at https://github.com/luis-mueller/probing-graph-transformers. △ Less

Submitted 28 March, 2024; v1 submitted 8 February, 2023; originally announced February 2023.

Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography

Authors: Xin Yue, Shanny Lin, Wenting Li, Bradley T. Wolfe, Steven Clayton, Mark Makela, C. L. Morris, Simon Spannagel, Erik Ramberg, Juan Estrada, Hao Zhu, Jifeng Liu, Eric R. Fossum, Zhehui Wang

Abstract: We summarize recent progress in ultrafast Complementary Metal Oxide Semiconductor (CMOS) image sensor development and the application of neural networks for post-processing of CMOS and charge-coupled device (CCD) image data to achieve sub-pixel resolution (thus $super$-$resolution$). The combination of novel CMOS pixel designs and data-enabled image post-processing provides a promising path toward… ▽ More We summarize recent progress in ultrafast Complementary Metal Oxide Semiconductor (CMOS) image sensor development and the application of neural networks for post-processing of CMOS and charge-coupled device (CCD) image data to achieve sub-pixel resolution (thus $super$-$resolution$). The combination of novel CMOS pixel designs and data-enabled image post-processing provides a promising path towards ultrafast high-resolution multi-modal radiographic imaging and tomography applications. △ Less

Submitted 27 January, 2023; originally announced January 2023.

Comments: 12 pages, 10 figures

Report number: Los Alamos National Laboratory report number LA-UR-23-20744

Journal ref: Proceedings of Science ; Vol.420, p.041, 8 May 2023

WL meet VC

Authors: Christopher Morris, Floris Geerts, Jan Tönshoff, Martin Grohe

Abstract: Recently, many works studied the expressive power of graph neural networks (GNNs) by linking it to the $1$-dimensional Weisfeiler--Leman algorithm ($1\text{-}\mathsf{WL}$). Here, the $1\text{-}\mathsf{WL}$ is a well-studied heuristic for the graph isomorphism problem, which iteratively colors or partitions a graph's vertex set. While this connection has led to significant advances in understanding… ▽ More Recently, many works studied the expressive power of graph neural networks (GNNs) by linking it to the $1$-dimensional Weisfeiler--Leman algorithm ($1\text{-}\mathsf{WL}$). Here, the $1\text{-}\mathsf{WL}$ is a well-studied heuristic for the graph isomorphism problem, which iteratively colors or partitions a graph's vertex set. While this connection has led to significant advances in understanding and enhancing GNNs' expressive power, it does not provide insights into their generalization performance, i.e., their ability to make meaningful predictions beyond the training set. In this paper, we study GNNs' generalization ability through the lens of Vapnik--Chervonenkis (VC) dimension theory in two settings, focusing on graph-level predictions. First, when no upper bound on the graphs' order is known, we show that the bitlength of GNNs' weights tightly bounds their VC dimension. Further, we derive an upper bound for GNNs' VC dimension using the number of colors produced by the $1\text{-}\mathsf{WL}$. Secondly, when an upper bound on the graphs' order is known, we show a tight connection between the number of graphs distinguishable by the $1\text{-}\mathsf{WL}$ and GNNs' VC dimension. Our empirical study confirms the validity of our theoretical findings. △ Less

Submitted 30 May, 2023; v1 submitted 26 January, 2023; originally announced January 2023.

Comments: Accepted at ICML 2023. arXiv admin note: text overlap with arXiv:2206.11168

Gene-SGAN: a method for discovering disease subtypes with imaging and genetic signatures via multi-view weakly-supervised deep clustering

Authors: Zhijian Yang, Junhao Wen, Ahmed Abdulkadir, Yuhan Cui, Guray Erus, Elizabeth Mamourian, Randa Melhem, Dhivya Srinivasan, Sindhuja T. Govindarajan, Jiong Chen, Mohamad Habes, Colin L. Masters, Paul Maruff, Jurgen Fripp, Luigi Ferrucci, Marilyn S. Albert, Sterling C. Johnson, John C. Morris, Pamela LaMontagne, Daniel S. Marcus, Tammie L. S. Benzinger, David A. Wolk, Li Shen, Jingxuan Bao, Susan M. Resnick , et al. (3 additional authors not shown)

Abstract: Disease heterogeneity has been a critical challenge for precision diagnosis and treatment, especially in neurologic and neuropsychiatric diseases. Many diseases can display multiple distinct brain phenotypes across individuals, potentially reflecting disease subtypes that can be captured using MRI and machine learning methods. However, biological interpretability and treatment relevance are limite… ▽ More Disease heterogeneity has been a critical challenge for precision diagnosis and treatment, especially in neurologic and neuropsychiatric diseases. Many diseases can display multiple distinct brain phenotypes across individuals, potentially reflecting disease subtypes that can be captured using MRI and machine learning methods. However, biological interpretability and treatment relevance are limited if the derived subtypes are not associated with genetic drivers or susceptibility factors. Herein, we describe Gene-SGAN - a multi-view, weakly-supervised deep clustering method - which dissects disease heterogeneity by jointly considering phenotypic and genetic data, thereby conferring genetic correlations to the disease subtypes and associated endophenotypic signatures. We first validate the generalizability, interpretability, and robustness of Gene-SGAN in semi-synthetic experiments. We then demonstrate its application to real multi-site datasets from 28,858 individuals, deriving subtypes of Alzheimer's disease and brain endophenotypes associated with hypertension, from MRI and SNP data. Derived brain phenotypes displayed significant differences in neuroanatomical patterns, genetic determinants, biological and clinical biomarkers, indicating potentially distinct underlying neuropathologic processes, genetic drivers, and susceptibility factors. Overall, Gene-SGAN is broadly applicable to disease subtyping and endophenotype discovery, and is herein tested on disease-related, genetically-driven neuroimaging phenotypes. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Needs, trends, and advances in scintillators for radiographic imaging and tomography

Authors: Zhehui Wang, Christophe Dujardin, Matthew S. Freeman, Amanda E. Gehring, James F. Hunter, Paul Lecoq, Wei Liu, Charles L. Melcher, C. L. Morris, Martin Nikl, Ghanshyam Pilania, Reeju Pokharel, Daniel G. Robertson, Daniel J. Rutstrom, Sky K. Sjue, Anton S. Tremsin, S. A. Watson, Brenden W. Wiggins, Nicola M. Winch, Mariya Zhuravleva

Abstract: Scintillators are important materials for radiographic imaging and tomography (RadIT), when ionizing radiations are used to reveal internal structures of materials. Since its invention by Röntgen, RadIT now come in many modalities such as absorption-based X-ray radiography, phase contrast X-ray imaging, coherent X-ray diffractive imaging, high-energy X- and $γ-$ray radiography at above 1 MeV, X-ra… ▽ More Scintillators are important materials for radiographic imaging and tomography (RadIT), when ionizing radiations are used to reveal internal structures of materials. Since its invention by Röntgen, RadIT now come in many modalities such as absorption-based X-ray radiography, phase contrast X-ray imaging, coherent X-ray diffractive imaging, high-energy X- and $γ-$ray radiography at above 1 MeV, X-ray computed tomography (CT), proton imaging and tomography (IT), neutron IT, positron emission tomography (PET), high-energy electron radiography, muon tomography, etc. Spatial, temporal resolution, sensitivity, and radiation hardness, among others, are common metrics for RadIT performance, which are enabled by, in addition to scintillators, advances in high-luminosity accelerators and high-power lasers, photodetectors especially CMOS pixelated sensor arrays, and lately data science. Medical imaging, nondestructive testing, nuclear safety and safeguards are traditional RadIT applications. Examples of growing or emerging applications include space, additive manufacturing, machine vision, and virtual reality or `metaverse'. Scintillator metrics such as light yield and decay time are correlated to RadIT metrics. More than 160 kinds of scintillators and applications are presented during the SCINT22 conference. New trends include inorganic and organic scintillator heterostructures, liquid phase synthesis of perovskites and $μ$m-thick films, use of multiphysics models and data science to guide scintillator development, structural innovations such as photonic crystals, nanoscintillators enhanced by the Purcell effect, novel scintillator fibers, and multilayer configurations. Opportunities exist through optimization of RadIT with reduced radiation dose, data-driven measurements, photon/particle counting and tracking methods supplementing time-integrated measurements, and multimodal RadIT. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Comments: 45 pages, 43 Figures, SCINT22 conference overview

Report number: Los Alamos report number LA-UR-22-32994

Journal ref: IEEE Transactions on Nuclear Science ( Volume: 70, Issue: 7, July 2023), pp. 1244 - 1280

Highly-parallelized simulation of a pixelated LArTPC on a GPU

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, Z. Ahmad, J. Ahmed, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, C. Alt, A. Alton, R. Alvarez, P. Amedo, J. Anderson , et al. (1282 additional authors not shown)

Abstract: The rapid development of general-purpose computing on graphics processing units (GPGPU) is allowing the implementation of highly-parallelized Monte Carlo simulation chains for particle physics experiments. This technique is particularly suitable for the simulation of a pixelated charge readout for time projection chambers, given the large number of channels that this technology employs. Here we pr… ▽ More The rapid development of general-purpose computing on graphics processing units (GPGPU) is allowing the implementation of highly-parallelized Monte Carlo simulation chains for particle physics experiments. This technique is particularly suitable for the simulation of a pixelated charge readout for time projection chambers, given the large number of channels that this technology employs. Here we present the first implementation of a full microphysical simulator of a liquid argon time projection chamber (LArTPC) equipped with light readout and pixelated charge readout, developed for the DUNE Near Detector. The software is implemented with an end-to-end set of GPU-optimized algorithms. The algorithms have been written in Python and translated into CUDA kernels using Numba, a just-in-time compiler for a subset of Python and NumPy instructions. The GPU implementation achieves a speed up of four orders of magnitude compared with the equivalent CPU version. The simulation of the current induced on $10^3$ pixels takes around 1 ms on the GPU, compared with approximately 10 s on the CPU. The results of the simulation are compared against data from a pixel-readout LArTPC prototype. △ Less

Submitted 28 February, 2023; v1 submitted 19 December, 2022; originally announced December 2022.

Comments: 26 pages, 15 figures

Report number: FERMILAB-PUB-22-926-LBNF

Weisfeiler and Leman Go Relational

Authors: Pablo Barcelo, Mikhail Galkin, Christopher Morris, Miguel Romero Orth

Abstract: Knowledge graphs, modeling multi-relational data, improve numerous applications such as question answering or graph logical reasoning. Many graph neural networks for such data emerged recently, often outperforming shallow architectures. However, the design of such multi-relational graph neural networks is ad-hoc, driven mainly by intuition and empirical insights. Up to now, their expressivity, the… ▽ More Knowledge graphs, modeling multi-relational data, improve numerous applications such as question answering or graph logical reasoning. Many graph neural networks for such data emerged recently, often outperforming shallow architectures. However, the design of such multi-relational graph neural networks is ad-hoc, driven mainly by intuition and empirical insights. Up to now, their expressivity, their relation to each other, and their (practical) learning performance is poorly understood. Here, we initiate the study of deriving a more principled understanding of multi-relational graph neural networks. Namely, we investigate the limitations in the expressive power of the well-known Relational GCN and Compositional GCN architectures and shed some light on their practical learning performance. By aligning both architectures with a suitable version of the Weisfeiler-Leman test, we establish under which conditions both models have the same expressive power in distinguishing non-isomorphic (multi-relational) graphs or vertices with different structural roles. Further, by leveraging recent progress in designing expressive graph neural networks, we introduce the $k$-RN architecture that provably overcomes the expressiveness limitations of the above two architectures. Empirically, we confirm our theoretical findings in a vertex classification setting over small and large multi-relational graphs. △ Less

Submitted 30 November, 2022; originally announced November 2022.

Comments: Learning on Graphs Conference 2022. arXiv admin note: text overlap with arXiv:2206.11168

Identification and reconstruction of low-energy electrons in the ProtoDUNE-SP detector

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, Z. Ahmad, J. Ahmed, B. Aimard, F. Akbar, K. Allison, S. Alonso Monsalve, M. Alrashed, C. Alt, A. Alton, R. Alvarez, P. Amedo, J. Anderson , et al. (1235 additional authors not shown)

Abstract: Measurements of electrons from $ν_e$ interactions are crucial for the Deep Underground Neutrino Experiment (DUNE) neutrino oscillation program, as well as searches for physics beyond the standard model, supernova neutrino detection, and solar neutrino measurements. This article describes the selection and reconstruction of low-energy (Michel) electrons in the ProtoDUNE-SP detector. ProtoDUNE-SP is… ▽ More Measurements of electrons from $ν_e$ interactions are crucial for the Deep Underground Neutrino Experiment (DUNE) neutrino oscillation program, as well as searches for physics beyond the standard model, supernova neutrino detection, and solar neutrino measurements. This article describes the selection and reconstruction of low-energy (Michel) electrons in the ProtoDUNE-SP detector. ProtoDUNE-SP is one of the prototypes for the DUNE far detector, built and operated at CERN as a charged particle test beam experiment. A sample of low-energy electrons produced by the decay of cosmic muons is selected with a purity of 95%. This sample is used to calibrate the low-energy electron energy scale with two techniques. An electron energy calibration based on a cosmic ray muon sample uses calibration constants derived from measured and simulated cosmic ray muon events. Another calibration technique makes use of the theoretically well-understood Michel electron energy spectrum to convert reconstructed charge to electron energy. In addition, the effects of detector response to low-energy electron energy scale and its resolution including readout electronics threshold effects are quantified. Finally, the relation between the theoretical and reconstructed low-energy electron energy spectrum is derived and the energy resolution is characterized. The low-energy electron selection presented here accounts for about 75% of the total electron deposited energy. After the addition of lost energy using a Monte Carlo simulation, the energy resolution improves from about 40% to 25% at 50~MeV. These results are used to validate the expected capabilities of the DUNE far detector to reconstruct low-energy electrons. △ Less

Submitted 31 May, 2023; v1 submitted 2 November, 2022; originally announced November 2022.

Comments: 19 pages, 10 figures

Report number: FERMILAB-PUB-22-784, CERN-EP-DRAFT-MISC-2022-008

Journal ref: Phys. Rev. D 107, 092012 (2023)

Characterization of the new Ultracold Neutron beamline at the LANL UCN facility

Authors: D. K. -T. Wong, M. T. Hassan, J. F. Burdine, T. E. Chupp, S. M. Clayton, C. Cude-Woods, S. A. Currie, T. M. Ito, C. -Y. Liu, M. Makela, C. L. Morris, C. M. O'Shaughnessy, A. Reid, N. Sachdeva, W. Uhrich

Abstract: The neutron electric dipole moment (nEDM) experiment that is currently being developed at Los Alamos National Laboratory (LANL) will use ultracold neutrons (UCN) and Ramsey's method of separated oscillatory fields to search for a nEDM. In this paper, we present measurements of UCN storage and UCN transport performed during the commissioning of a new beamline at the LANL UCN source and demonstrate… ▽ More The neutron electric dipole moment (nEDM) experiment that is currently being developed at Los Alamos National Laboratory (LANL) will use ultracold neutrons (UCN) and Ramsey's method of separated oscillatory fields to search for a nEDM. In this paper, we present measurements of UCN storage and UCN transport performed during the commissioning of a new beamline at the LANL UCN source and demonstrate a sufficient number of stored polarized UCN to achieve a statistical uncertainty of $δd_n = 2\times 10^{-27}$~$e\cdot\text{cm}$ in 5 calendar years of running. We also present an analytical model describing data that provides a simple parameterization of the input UCN energy spectrum on the new beamline. △ Less

Submitted 17 January, 2023; v1 submitted 30 August, 2022; originally announced September 2022.

Comments: 12 pages, 13 figures

Report number: LA-UR-22-28534

Journal ref: Nucl. Instrum. Methods Phys. Res. A (2023) 168105

Characterization of electroless nickel-phosphorus plating for ultracold-neutron storage

Authors: H. Akatsuka, T. Andalib, B. Bell, J. Berean-Dutcher, N. Bernier, C. P. Bidinosti, C. Cude-Woods, S. A. Currie, C. A. Davis, B. Franke, R. Gaur, P. Giampa, S. Hansen-Romu, M. T. Hassan, K. Hatanaka, T. Higuchi, C. Gibson, G. Ichikawa, I. Ide, S. Imajo, T. M. Ito, B. Jamieson, S. Kawasaki, M. Kitaguchi, W. Klassen , et al. (29 additional authors not shown)

Abstract: Electroless nickel plating is an established industrial process that provides a robust and relatively low-cost coating suitable for transporting and storing ultracold neutrons (UCN). Using roughness measurements and UCN-storage experiments we characterized UCN guides made from polished aluminum or stainless-steel tubes plated by several vendors. All electroless nickel platings were similarly suite… ▽ More Electroless nickel plating is an established industrial process that provides a robust and relatively low-cost coating suitable for transporting and storing ultracold neutrons (UCN). Using roughness measurements and UCN-storage experiments we characterized UCN guides made from polished aluminum or stainless-steel tubes plated by several vendors. All electroless nickel platings were similarly suited for UCN storage with an average loss probability per wall bounce of $2.8\cdot10^{-4}$ to $4.1\cdot10^{-4}$ for energies between 90 neV and 190 neV, or a ratio of imaginary to real Fermi potential $η$ of $1.7\cdot10^{-4}$ to $3.3\cdot10^{-4}$. Measurements at different elevations indicate that the energy dependence of UCN losses is well described by the imaginary Fermi potential. Some special considerations are required to avoid an increase in surface roughness during the plating process and hence a reduction in UCN transmission. Increased roughness had only a minor impact on storage properties. Based on these findings we chose a vendor to plate the UCN-production vessel that will contain the superfluid-helium converter for the new TRIUMF UltraCold Advanced Neutron (TUCAN) source, achieving acceptable UCN-storage properties with ${η=3.5(5)\cdot10^{-4}}$. △ Less

Submitted 7 February, 2023; v1 submitted 10 August, 2022; originally announced August 2022.

Comments: 8 pages, 7 figures

Journal ref: Nucl. Instrum. Methods Phys. Res. A 1049 (2023) 168106

Reconstruction of interactions in the ProtoDUNE-SP detector with Pandora

Authors: DUNE Collaboration, A. Abed Abud, B. Abi, R. Acciarri, M. A. Acero, M. R. Adames, G. Adamov, M. Adamowski, D. Adams, M. Adinolfi, C. Adriano, A. Aduszkiewicz, J. Aguilar, Z. Ahmad, J. Ahmed, B. Aimard, F. Akbar, B. Ali-Mohammadzadeh, K. Allison, S. Alonso Monsalve, M. AlRashed, C. Alt, A. Alton, R. Alvarez, P. Amedo , et al. (1203 additional authors not shown)

Abstract: The Pandora Software Development Kit and algorithm libraries provide pattern-recognition logic essential to the reconstruction of particle interactions in liquid argon time projection chamber detectors. Pandora is the primary event reconstruction software used at ProtoDUNE-SP, a prototype for the Deep Underground Neutrino Experiment far detector. ProtoDUNE-SP, located at CERN, is exposed to a char… ▽ More The Pandora Software Development Kit and algorithm libraries provide pattern-recognition logic essential to the reconstruction of particle interactions in liquid argon time projection chamber detectors. Pandora is the primary event reconstruction software used at ProtoDUNE-SP, a prototype for the Deep Underground Neutrino Experiment far detector. ProtoDUNE-SP, located at CERN, is exposed to a charged-particle test beam. This paper gives an overview of the Pandora reconstruction algorithms and how they have been tailored for use at ProtoDUNE-SP. In complex events with numerous cosmic-ray and beam background particles, the simulated reconstruction and identification efficiency for triggered test-beam particles is above 80% for the majority of particle type and beam momentum combinations. Specifically, simulated 1 GeV/$c$ charged pions and protons are correctly reconstructed and identified with efficiencies of 86.1$\pm0.6$% and 84.1$\pm0.6$%, respectively. The efficiencies measured for test-beam data are shown to be within 5% of those predicted by the simulation. △ Less

Submitted 17 July, 2023; v1 submitted 29 June, 2022; originally announced June 2022.

Comments: 39 pages, 20 figures. Accepted version. Published version available in Eur. Phys. J. C 83, 618 (2023) https://doi.org/10.1140/epjc/s10052-023-11733-2

Report number: FERMILAB-PUB-22-488-AD-ESH-LBNF-ND-SCD, CERN-EP-DRAFT-MISC-2022-007

Journal ref: Eur. Phys. J. C 83, 618 (2023)

Ordered Subgraph Aggregation Networks

Authors: Chendi Qian, Gaurav Rattan, Floris Geerts, Christopher Morris, Mathias Niepert

Abstract: Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other and to the Weisfeiler-Leman hierarchy. Moreover, current approaches either use all subgraphs of a given size, sample them uniformly at random, or use hand-craf… ▽ More Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other and to the Weisfeiler-Leman hierarchy. Moreover, current approaches either use all subgraphs of a given size, sample them uniformly at random, or use hand-crafted heuristics instead of learning to select subgraphs in a data-driven manner. Here, we offer a unified way to study such architectures by introducing a theoretical framework and extending the known expressivity results of subgraph-enhanced GNNs. Concretely, we show that increasing subgraph size always increases the expressive power and develop a better understanding of their limitations by relating them to the established $k\text{-}\mathsf{WL}$ hierarchy. In addition, we explore different approaches for learning to sample subgraphs using recent methods for backpropagating through complex discrete probability distributions. Empirically, we study the predictive performance of different subgraph-enhanced GNNs, showing that our data-driven architectures increase prediction accuracy on standard benchmark datasets compared to non-data-driven subgraph-enhanced graph neural networks while reducing computation time. △ Less

Submitted 15 October, 2022; v1 submitted 22 June, 2022; originally announced June 2022.

Comments: Accepted at NeurIPS 2022. Fixed link to code repository