-
The Blending ToolKit: A simulation framework for evaluation of galaxy detection and deblending
Authors:
Ismael Mendoza,
Andrii Torchylo,
Thomas Sainrat,
Axel Guinot,
Alexandre Boucaud,
Maxime Paillassa,
Camille Avestruz,
Prakruth Adari,
Eric Aubourg,
Biswajit Biswas,
James Buchanan,
Patricia Burchat,
Cyrille Doux,
Remy Joseph,
Sowmya Kamath,
Alex I. Malz,
Grant Merz,
Hironao Miyatake,
Cécile Roucelle,
Tianqing Zhang,
the LSST Dark Energy Science Collaboration
Abstract:
We present an open source Python library for simulating overlapping (i.e., blended) images of galaxies and performing self-consistent comparisons of detection and deblending algorithms based on a suite of metrics. The package, named Blending Toolkit (BTK), serves as a modular, flexible, easy-to-install, and simple-to-use interface for exploring and analyzing systematic effects related to blended g…
▽ More
We present an open source Python library for simulating overlapping (i.e., blended) images of galaxies and performing self-consistent comparisons of detection and deblending algorithms based on a suite of metrics. The package, named Blending Toolkit (BTK), serves as a modular, flexible, easy-to-install, and simple-to-use interface for exploring and analyzing systematic effects related to blended galaxies in cosmological surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time (LSST). BTK has three main components: (1) a set of modules that perform fast image simulations of blended galaxies, using the open source image simulation package GalSim; (2) a module that standardizes the inputs and outputs of existing deblending algorithms; (3) a library of deblending metrics commonly defined in the galaxy deblending literature. In combination, these modules allow researchers to explore the impacts of galaxy blending in cosmological surveys. Additionally, BTK provides researchers who are developing a new deblending algorithm a framework to evaluate algorithm performance and make principled comparisons with existing deblenders. BTK includes a suite of tutorials and comprehensive documentation. The source code is publicly available on GitHub at https://github.com/LSSTDESC/BlendingToolKit.
△ Less
Submitted 26 September, 2024; v1 submitted 10 September, 2024;
originally announced September 2024.
-
MADNESS Deblender: Maximum A posteriori with Deep NEural networks for Source Separation
Authors:
Biswajit Biswas,
Eric Aubourg,
Alexandre Boucaud,
Axel Guinot,
Junpeng Lao,
Cécile Roucelle,
the LSST Dark Energy Science Collaboration
Abstract:
Due to the unprecedented depth of the upcoming ground-based Legacy Survey of Space and Time (LSST) at the Vera C. Rubin Observatory, approximately two-thirds of the galaxies are likely to be affected by blending - the overlap of physically separated galaxies in images. Thus, extracting reliable shapes and photometry from individual objects will be limited by our ability to correct blending and con…
▽ More
Due to the unprecedented depth of the upcoming ground-based Legacy Survey of Space and Time (LSST) at the Vera C. Rubin Observatory, approximately two-thirds of the galaxies are likely to be affected by blending - the overlap of physically separated galaxies in images. Thus, extracting reliable shapes and photometry from individual objects will be limited by our ability to correct blending and control any residual systematic effect. Deblending algorithms tackle this issue by reconstructing the isolated components from a blended scene, but the most commonly used algorithms often fail to model complex realistic galaxy morphologies.
As part of an effort to address this major challenge, we present MADNESS, which takes a data-driven approach and combines pixel-level multi-band information to learn complex priors for obtaining the maximum a posteriori solution of deblending. MADNESS is based on deep neural network architectures such as variational auto-encoders and normalizing flows. The variational auto-encoder reduces the high-dimensional pixel space into a lower-dimensional space, while the normalizing flow models a data-driven prior in this latent space.
Using a simulated test dataset with galaxy models for a 10-year LSST survey and a galaxy density ranging from 48 to 80 galaxies per arcmin2 we characterize the aperture-photometry g-r color, structural similarity index, and pixel cosine similarity of the galaxies reconstructed by MADNESS. We compare our results against state-of-the-art deblenders including scarlet. With the r-band of LSST as an example, we show that MADNESS performs better than in all the metrics. For instance, the average absolute value of relative flux residual in the r-band for MADNESS is approximately 29% lower than that of scarlet. The code is publicly available on GitHub.
△ Less
Submitted 27 August, 2024;
originally announced August 2024.
-
Black-Hole-to-Halo Mass Relation From UNIONS Weak Lensing
Authors:
Qinxun Li,
Martin Kilbinger,
Wentao Luo,
Kai Wang,
Huiyuan Wang,
Anna Wittje,
Hendrik Hildebrandt,
Ludovic van Waerbeke,
Michael J. Hudson,
Samuel Farrens,
Tobias I. Liaudat,
Huiling Liu,
Ziwen Zhang,
Qingqing Wang,
Elisa Russier,
Axel Guinot,
Lucie Baumont,
Fabian Hervas Peters,
Thomas de Boer,
Jiaqi Wang
Abstract:
This letter presents, for the first time, direct constraints on the black-hole-to-halo-mass relation using weak gravitational lensing measurements. We construct type I and type II Active Galactic Nuclei (AGNs) samples from the Sloan Digital Sky Survey (SDSS), with a mean redshift of 0.4 0.1 for type I (type II) AGNs. This sample is cross-correlated with weak lensing shear from the Ultraviolet Near…
▽ More
This letter presents, for the first time, direct constraints on the black-hole-to-halo-mass relation using weak gravitational lensing measurements. We construct type I and type II Active Galactic Nuclei (AGNs) samples from the Sloan Digital Sky Survey (SDSS), with a mean redshift of 0.4 0.1 for type I (type II) AGNs. This sample is cross-correlated with weak lensing shear from the Ultraviolet Near Infrared Northern Survey (UNIONS). We compute the excess surface mass density of the halos associated with $36,181$ AGNs from $94,308,561$ lensed galaxies and fit the halo mass in bins of black-hole mass. We find that more massive AGNs reside in more massive halos. We see no evidence of dependence on AGN type or redshift in the black-hole-to-halo-mass relationship when systematic errors in the measured black-hole masses are included. Our results are consistent with previous measurements for non-AGN galaxies. At a fixed black-hole mass, our weak-lensing halo masses are consistent with galaxy rotation curves, but significantly lower than galaxy clustering measurements. Finally, our results are broadly consistent with state-of-the-art hydro-dynamical cosmological simulations, providing a new constraint for black-hole masses in simulations.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
Bayesian multi-band fitting of alerts for kilonovae detection
Authors:
Biswajit Biswas,
Junpeng Lao,
Eric Aubourg,
Alexandre Boucaud,
Axel Guinot,
Emille E. O. Ishida,
Cécile Roucelle
Abstract:
In the era of multi-messenger astronomy, early classification of photometric alerts from wide-field and high-cadence surveys is a necessity to trigger spectroscopic follow-ups. These classifications are expected to play a key role in identifying potential candidates that might have a corresponding gravitational wave (GW) signature. Machine learning classifiers using features from parametric fittin…
▽ More
In the era of multi-messenger astronomy, early classification of photometric alerts from wide-field and high-cadence surveys is a necessity to trigger spectroscopic follow-ups. These classifications are expected to play a key role in identifying potential candidates that might have a corresponding gravitational wave (GW) signature. Machine learning classifiers using features from parametric fitting of light curves are widely deployed by broker software to analyze millions of alerts, but most of these algorithms require as many points in the filter as the number of parameters to produce the fit, which increases the chances of missing a short transient. Moreover, the classifiers are not able to account for the uncertainty in the fits when producing the final score. In this context, we present a novel classification strategy that incorporates data-driven priors for extracting a joint posterior distribution of fit parameters and hence obtaining a distribution of classification scores. We train and test a classifier to identify kilonovae events which originate from binary neutron star mergers or neutron star black hole mergers, among simulations for the Zwicky Transient Facility observations with 19 other non-kilonovae-type events. We demonstrate that our method can estimate the uncertainty of misclassification, and the mean of the distribution of classification scores as point estimate obtains an AUC score of 0.96 on simulated data. We further show that using this method we can process the entire alert steam in real-time and bring down the sample of probable events to a scale where they can be analyzed by domain experts.
△ Less
Submitted 8 November, 2023;
originally announced November 2023.
-
The shape of dark matter haloes: results from weak lensing in the Ultraviolet Near-Infrared Optical Northern Survey (UNIONS)
Authors:
Bailey Robison,
Michael J. Hudson,
Jean-Charles Cuillandre,
Thomas Erben,
Sébastien Fabbro,
Raphaël Gavazzi,
Axel Guinot,
Stephen Gwyn,
Hendrik Hildebrandt,
Martin Kilbinger,
Alan McConnachie,
Lance Miller,
Isaac Spitzer,
Ludovic van Waerbeke
Abstract:
Cold dark matter haloes are expected to be triaxial, and so appear elliptical in projection. We use weak gravitational lensing from the Canada-France Imaging Survey (CFIS) component of the Ultraviolet-Near Infrared Optical Northern Survey (UNIONS) to measure the ellipticity of the dark matter haloes around Luminous Red Galaxies (LRGs) from the Sloan Digital Sky Survey Data Release 7 (DR7) and from…
▽ More
Cold dark matter haloes are expected to be triaxial, and so appear elliptical in projection. We use weak gravitational lensing from the Canada-France Imaging Survey (CFIS) component of the Ultraviolet-Near Infrared Optical Northern Survey (UNIONS) to measure the ellipticity of the dark matter haloes around Luminous Red Galaxies (LRGs) from the Sloan Digital Sky Survey Data Release 7 (DR7) and from the CMASS and LOWZ samples of the Baryon Oscillation Spectroscopic Survey (BOSS), assuming their major axes are aligned with the stellar light. We find that DR7 LRGs with masses $M \sim 2.7\times10^{13} \mathrm{M}_{\odot}/h$ have halo ellipticities $e=0.46\pm0.10$. Expressed as a fraction of the galaxy ellipticity, we find $f_h = 2.2\pm0.6$. For BOSS LRGs, the detection is of marginal significance: $e = 0.20\pm0.10$ and $f_h=0.7\pm0.7$. These results are in agreement with other measurements of halo ellipticity from weak lensing and, taken together with previous results, suggest an increase of halo ellipticity of $0.10\pm0.06$ per decade in halo mass. This trend agrees with the predictions from hydrodynamical simulations, which find that at higher halo masses, not only do dark matter haloes become more elliptical, but that the misalignment between major axis of the stellar light in the central galaxy and that of the dark matter decreases.
△ Less
Submitted 19 May, 2023; v1 submitted 19 September, 2022;
originally announced September 2022.
-
ShapePipe: A modular weak-lensing processing and analysis pipeline
Authors:
S. Farrens,
A. Guinot,
M. Kilbinger,
T. Liaudat,
L. Baumont,
X. Jimenez,
A. Peel,
A. Pujol,
M. Schmitz,
J. -L. Starck,
A. Z. Vitorelli
Abstract:
We present the first public release of ShapePipe, an open-source and modular weak-lensing measurement, analysis, and validation pipeline written in Python. We describe the design of the software and justify the choices made. We provide a brief description of all the modules currently available and summarise how the pipeline has been applied to real Ultraviolet Near-Infrared Optical Northern Survey…
▽ More
We present the first public release of ShapePipe, an open-source and modular weak-lensing measurement, analysis, and validation pipeline written in Python. We describe the design of the software and justify the choices made. We provide a brief description of all the modules currently available and summarise how the pipeline has been applied to real Ultraviolet Near-Infrared Optical Northern Survey data. Finally, we mention plans for future applications and development. The code and accompanying documentation are publicly available on GitHub.
△ Less
Submitted 29 June, 2022;
originally announced June 2022.
-
Impact of Point Spread Function Higher Moments Error on Weak Gravitational Lensing II: A Comprehensive Study
Authors:
Tianqing Zhang,
Husni Almoubayyed,
Rachel Mandelbaum,
Joshua E. Meyers,
Mike Jarvis,
Arun Kannawadi,
Morgan A. Schmitz,
Axel Guinot,
The LSST Dark Energy Science Collaboration
Abstract:
Weak gravitational lensing, or weak lensing, is one of the most powerful probes for dark matter and dark energy science, although it faces increasing challenges in controlling systematic uncertainties as \edit{the statistical errors become smaller}. The Point Spread Function (PSF) needs to be precisely modeled to avoid systematic error on the weak lensing measurements. The weak lensing biases indu…
▽ More
Weak gravitational lensing, or weak lensing, is one of the most powerful probes for dark matter and dark energy science, although it faces increasing challenges in controlling systematic uncertainties as \edit{the statistical errors become smaller}. The Point Spread Function (PSF) needs to be precisely modeled to avoid systematic error on the weak lensing measurements. The weak lensing biases induced by errors in the PSF model second moments, i.e., its size and shape, are well-studied. However, Zhang et al. (2021) showed that errors in the higher moments of the PSF may also be a significant source of systematics for upcoming weak lensing surveys. Therefore, the goal of this work is to comprehensively investigate the modeling quality of PSF moments from the $3^{\text{rd}}$ to $6^{\text{th}}$ order, and estimate their impact on cosmological parameter inference. We propagate the \textsc{PSFEx} higher moments modeling error in the HSC survey dataset to the weak lensing \edit{shear-shear correlation functions} and their cosmological analyses. We find that the overall multiplicative shear bias associated with errors in PSF higher moments can cause a $\sim 0.1 σ$ shift on the cosmological parameters for LSST Y10. PSF higher moment errors also cause additive biases in the weak lensing shear, which, if not accounted for in the cosmological parameter analysis, can induce cosmological parameter biases comparable to their $1σ$ uncertainties for LSST Y10. We compare the \textsc{PSFEx} model with PSF in Full FOV (\textsc{Piff}), and find similar performance in modeling the PSF higher moments. We conclude that PSF higher moment errors of the future PSF models should be reduced from those in current methods to avoid a need to explicitly model these effects in the weak lensing analysis.
△ Less
Submitted 18 April, 2023; v1 submitted 16 May, 2022;
originally announced May 2022.
-
UNIONS: The impact of systematic errors on weak-lensing peak counts
Authors:
Emma Ayçoberry,
Virginia Ajani,
Axel Guinot,
Martin Kilbinger,
Valeria Pettorino,
Samuel Farrens,
Jean-Luc Starck,
Raphaël Gavazzi,
Michael J. Hudson
Abstract:
UNIONS is an ongoing deep photometric multi-band survey of the Northern sky. As part of UNIONS, CFIS provides r-band data which we use to study weak-lensing peak counts for cosmological inference. We assess systematic effects for weak-lensing peak counts and their impact on cosmological parameters for the UNIONS survey. In particular, we present results on local calibration, metacalibration shear…
▽ More
UNIONS is an ongoing deep photometric multi-band survey of the Northern sky. As part of UNIONS, CFIS provides r-band data which we use to study weak-lensing peak counts for cosmological inference. We assess systematic effects for weak-lensing peak counts and their impact on cosmological parameters for the UNIONS survey. In particular, we present results on local calibration, metacalibration shear bias, baryonic feedback, the source galaxy redshift estimate, intrinsic alignment, and the cluster member dilution. For each uncertainty and systematic effect, we describe our mitigation scheme and the impact on cosmological parameter constraints. We obtain constraints on cosmological parameters from MCMC using CFIS data and MassiveNuS N-body simulations as a model for peak counts statistics. Depending on the calibration (local versus global, and the inclusion of the residual multiplicative shear bias), the mean matter density parameter $Ω_m$ can shift up to $-0.024$ ($-0.5σ$). We also see that including baryonic corrections can shift $Ω_m$ by $+0.027$ ($+0.5 σ$) with respect to the DM-only simulations. Reducing the impact of the intrinsic alignment and cluster member dilution through signal-to-noise cuts can lead to a shift in $Ω_m$ of $+0.027$ ($+0.5 σ$). Finally, with a mean redshift uncertainty of $Δ\bar{z} = 0.03$, we see that the shift of $Ω_m$ ($+0.001$ which corresponds to $+0.02 σ$) is not significant. This paper investigates for the first time with UNIONS weak-lensing data and peak counts the impact of systematic effects. The value of $Ω_m$ is the most impacted and can shift up to $\sim 0.03$ which corresponds to $0.5σ$ depending on the choices for each systematics. We expect constraints to become more reliable with future (larger) data catalogues, for which the current pipeline will provide a starting point.
△ Less
Submitted 22 March, 2023; v1 submitted 13 April, 2022;
originally announced April 2022.
-
ShapePipe: a new shape measurement pipeline and weak-lensing application to UNIONS/CFIS data
Authors:
Axel Guinot,
Martin Kilbinger,
Samuel Farrens,
Austin Peel,
Arnau Pujol,
Morgan Schmitz,
Jean-Luc Starck,
Thomas Erben,
Raphael Gavazzi,
Stephen Gwyn,
Michael J. Hudson,
Hendrik Hiledebrandt,
Tobias Liaudat,
Lance Miller,
Isaac Spitzer,
Ludovic Van Waerbeke,
Jean-Charles Cuillandre,
Sébastien Fabbro,
Alan McConnachie
Abstract:
UNIONS is an ongoing collaboration that will provide the largest deep photometric survey of the Northern sky in four optical bands to date. As part of this collaboration, CFIS is taking $r$-band data with an average seeing of 0.65 arcsec, which is complete to magnitude 24.5 and thus ideal for weak-lensing studies. We perform the first weak-lensing analysis of CFIS $r$-band data over an area spanni…
▽ More
UNIONS is an ongoing collaboration that will provide the largest deep photometric survey of the Northern sky in four optical bands to date. As part of this collaboration, CFIS is taking $r$-band data with an average seeing of 0.65 arcsec, which is complete to magnitude 24.5 and thus ideal for weak-lensing studies. We perform the first weak-lensing analysis of CFIS $r$-band data over an area spanning 1700 deg$^2$ of the sky. We create a catalogue with measured shapes for 40 million galaxies, corresponding to an effective density of 6.8 galaxies per square arcminute, and demonstrate a low level of systematic biases. This work serves as the basis for further cosmological studies using the full UNIONS survey of 4800 deg$^2$ when completed. Here we present ShapePipe, a newly developed weak-lensing pipeline. This pipeline makes use of state-of-the-art methods such as Ngmix for accurate galaxy shape measurement. Shear calibration is performed with metacalibration. We carry out extensive validation tests on the Point Spread Function (PSF), and on the galaxy shapes. In addition, we create realistic image simulations to validate the estimated shear. We quantify the PSF model accuracy and show that the level of systematics is low as measured by the PSF residuals. Their effect on the shear two-point correlation function is sub-dominant compared to the cosmological contribution on angular scales <100 arcmin. The additive shear bias is below 5x$10^{-4}$, and the residual multiplicative shear bias is at most $10^{-3}$ as measured on image simulations. Using COSEBIs we show that there are no significant B-modes present in second-order shear statistics. We present convergence maps and see clear correlations of the E-mode with known cluster positions. We measure the stacked tangential shear profile around Planck clusters at a significance higher than $4σ$.
△ Less
Submitted 10 April, 2022;
originally announced April 2022.
-
Deep Transfer Learning for Blended Source Identification in Galaxy Survey Data
Authors:
S. Farrens,
A. Lacan,
A. Guinot,
A. Z. Vitorelli
Abstract:
We present BlendHunter, a proof-of-concept for a deep transfer learning based approach for the automated and robust identification of blended sources in galaxy survey data. We take the VGG-16 network with pre-trained convolutional layers and train the fully connected layers on parametric models of COSMOS images. We test the efficacy of the transfer learning by taking the weights learned on the par…
▽ More
We present BlendHunter, a proof-of-concept for a deep transfer learning based approach for the automated and robust identification of blended sources in galaxy survey data. We take the VGG-16 network with pre-trained convolutional layers and train the fully connected layers on parametric models of COSMOS images. We test the efficacy of the transfer learning by taking the weights learned on the parametric models and using them to identify blends in more realistic CFIS-like images. We compare the performance of this method to SEP (a Python implementation of SExtractor) as function of noise level and the separation between sources. We find that BlendHunter outperforms SEP by $\sim 15\%$ in terms of classification accuracy for close blends ($<10$ pixel separation between sources) regardless of the noise level used for training. Additionally, the method provides consistent results to SEP for distant blends ($\geq10$ pixel separation between sources) provided the network is trained on data with a relatively close noise standard deviation to the target images. The code and data have been made publicly available to ensure the reproducibility of the results.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
Multi-CCD Point Spread Function Modelling
Authors:
T. Liaudat,
J. Bonnin,
J. -L. Starck,
M. A. Schmitz,
A. Guinot,
M. Kilbinger,
S. D. J. Gwyn
Abstract:
Galaxy imaging surveys observe a vast number of objects that are affected by the instrument's Point Spread Function (PSF). Weak lensing missions, in particular, aim at measuring the shape of galaxies, and PSF effects represent an important source of systematic errors which must be handled appropriately. This demands a high accuracy in the modelling as well as the estimation of the PSF at galaxy po…
▽ More
Galaxy imaging surveys observe a vast number of objects that are affected by the instrument's Point Spread Function (PSF). Weak lensing missions, in particular, aim at measuring the shape of galaxies, and PSF effects represent an important source of systematic errors which must be handled appropriately. This demands a high accuracy in the modelling as well as the estimation of the PSF at galaxy positions. Sometimes referred to as non-parametric PSF estimation, the goal of this paper is to estimate a PSF at galaxy positions, starting from a set of noisy star image observations distributed over the focal plane. To accomplish this, we need our model to first of all, precisely capture the PSF field variations over the Field of View (FoV), and then to recover the PSF at the selected positions. This paper proposes a new method, coined MCCD (Multi-CCD PSF modelling), that creates, simultaneously, a PSF field model over all of the instrument's focal plane. This allows to capture global as well as local PSF features through the use of two complementary models which enforce different spatial constraints. Most existing non-parametric models build one model per Charge Coupled Device (CCD), which can lead to difficulties in capturing global ellipticity patterns. We first test our method on a realistic simulated dataset comparing it with two state-of-the-art PSF modelling methods (PSFEx and RCA). We outperform both of them with our proposed method. Then we contrast our approach with PSFEx on real data from CFIS (Canada France Imaging Survey) that uses the CFHT (Canada-France-Hawaii Telescope). We show that our PSF model is less noisy and achieves a 22% gain on pixel Root Mean Squared Error (RMSE) with respect to PSFEx. We present, and share the code of, a new PSF modelling algorithm that models the PSF field on all the focal plane that is mature enough to handle real data.
△ Less
Submitted 19 November, 2020;
originally announced November 2020.
-
Shear measurement bias II: a fast machine learning calibration method
Authors:
Arnau Pujol,
Jerome Bobin,
Florent Sureau,
Axel Guinot,
Martin Kilbinger
Abstract:
We present a new shear calibration method based on machine learning. The method estimates the individual shear responses of the objects from the combination of several measured properties on the images using supervised learning. The supervised learning uses the true individual shear responses obtained from copies of the image simulations with different shear values. On simulated GREAT3data, we obt…
▽ More
We present a new shear calibration method based on machine learning. The method estimates the individual shear responses of the objects from the combination of several measured properties on the images using supervised learning. The supervised learning uses the true individual shear responses obtained from copies of the image simulations with different shear values. On simulated GREAT3data, we obtain a residual bias after the calibration compatible with 0 and beyond Euclid requirements for a signal-to-noise ratio > 20 within ~15 CPU hours of training using only ~10^5 objects. This efficient machine-learning approach can use a smaller data set because the method avoids the contribution from shape noise. The low dimensionality of the input data also leads to simple neural network architectures. We compare it to the recently described method Metacalibration, which shows similar performances. The different methods and systematics suggest that the two methods are very good complementary methods. Our method can therefore be applied without much effort to any survey such as Euclid or the Vera C. Rubin Observatory, with fewer than a million images to simulate to learn the calibration function.
△ Less
Submitted 13 October, 2020; v1 submitted 12 June, 2020;
originally announced June 2020.