-
Towards a Modular Architecture for Science Factories
Authors:
Rafael Vescovi,
Tobias Ginsburg,
Kyle Hippe,
Doga Ozgulbas,
Casey Stone,
Abraham Stroka,
Rory Butler,
Ben Blaiszik,
Tom Brettin,
Kyle Chard,
Mark Hereld,
Arvind Ramanathan,
Rick Stevens,
Aikaterini Vriza,
Jie Xu,
Qingteng Zhang,
Ian Foster
Abstract:
Advances in robotic automation, high-performance computing (HPC), and artificial intelligence (AI) encourage us to conceive of science factories: large, general-purpose computation- and AI-enabled self-driving laboratories (SDLs) with the generality and scale needed both to tackle large discovery problems and to support thousands of scientists. Science factories require modular hardware and softwa…
▽ More
Advances in robotic automation, high-performance computing (HPC), and artificial intelligence (AI) encourage us to conceive of science factories: large, general-purpose computation- and AI-enabled self-driving laboratories (SDLs) with the generality and scale needed both to tackle large discovery problems and to support thousands of scientists. Science factories require modular hardware and software that can be replicated for scale and (re)configured to support many applications. To this end, we propose a prototype modular science factory architecture in which reconfigurable modules encapsulating scientific instruments are linked with manipulators to form workcells, that can themselves be combined to form larger assemblages, and linked with distributed computing for simulation, AI model training and inference, and related tasks. Workflows that perform sets of actions on modules can be specified, and various applications, comprising workflows plus associated computational and data manipulation steps, can be run concurrently. We report on our experiences prototyping this architecture and applying it in experiments involving 15 different robotic apparatus, five applications (one in education, two in biology, two in materials), and a variety of workflows, across four laboratories. We describe the reuse of modules, workcells, and workflows in different applications, the migration of applications between workcells, and the use of digital twins, and suggest directions for future work aimed at yet more generality and scalability. Code and data are available at https://ad-sdl.github.io/wei2023 and in the Supplementary Information
△ Less
Submitted 17 October, 2023; v1 submitted 18 August, 2023;
originally announced August 2023.
-
What is missing in autonomous discovery: Open challenges for the community
Authors:
Phillip M. Maffettone,
Pascal Friederich,
Sterling G. Baird,
Ben Blaiszik,
Keith A. Brown,
Stuart I. Campbell,
Orion A. Cohen,
Tantum Collins,
Rebecca L. Davis,
Ian T. Foster,
Navid Haghmoradi,
Mark Hereld,
Nicole Jung,
Ha-Kyung Kwon,
Gabriella Pizzuto,
Jacob Rintamaki,
Casper Steinmann,
Luca Torresi,
Shijing Sun
Abstract:
Self-driving labs (SDLs) leverage combinations of artificial intelligence, automation, and advanced computing to accelerate scientific discovery. The promise of this field has given rise to a rich community of passionate scientists, engineers, and social scientists, as evidenced by the development of the Acceleration Consortium and recent Accelerate Conference. Despite its strengths, this rapidly…
▽ More
Self-driving labs (SDLs) leverage combinations of artificial intelligence, automation, and advanced computing to accelerate scientific discovery. The promise of this field has given rise to a rich community of passionate scientists, engineers, and social scientists, as evidenced by the development of the Acceleration Consortium and recent Accelerate Conference. Despite its strengths, this rapidly developing field presents numerous opportunities for growth, challenges to overcome, and potential risks of which to remain aware. This community perspective builds on a discourse instantiated during the first Accelerate Conference, and looks to the future of self-driving labs with a tempered optimism. Incorporating input from academia, government, and industry, we briefly describe the current status of self-driving labs, then turn our attention to barriers, opportunities, and a vision for what is possible. Our field is delivering solutions in technology and infrastructure, artificial intelligence and knowledge generation, and education and workforce development. In the spirit of community, we intend for this work to foster discussion and drive best practices as our field grows.
△ Less
Submitted 2 May, 2023; v1 submitted 21 April, 2023;
originally announced April 2023.
-
Computational multifocal microscopy
Authors:
Kuan He,
Zihao Wang,
Xiang Huang,
Xiaolei Wang,
Seunghwan Yoo,
Pablo Ruiz,
Itay Gdor,
Alan Selewa,
Nicola J. Ferrier,
Norbert Scherer,
Mark Hereld,
Aggelos K. Katsaggelos,
Oliver Cossairt
Abstract:
Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from mu…
▽ More
Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from multiple sources of degradation, which prevents MFM from further applications. We propose a unifying computational framework which simplifies the imaging system and achieves 3D reconstruction via computation. Our optical configuration omits chromatic correction grating and redesigns the multifocal grating to enlarge the tracking area. Our proposed setup features only one single grating in addition to a regular microscope. The aberration correction, along with Poisson and background denoising, are incorporated in our deconvolution-based fully-automated algorithm, which requires no empirical parameter-tuning. In experiments, we achieve the spatial resolutions of $0.35$um (lateral) and $0.5$um (axial), which are comparable to the resolution that can be achieved with confocal deconvolution microscopy. We demonstrate a 3D video of moving bacteria recorded at $25$ frames per second using our proposed computational multifocal microscopy technique.
△ Less
Submitted 4 September, 2018;
originally announced September 2018.
-
Particle Tracking and Extended Object Imaging by Interferometric Super Resolution Microscopy
Authors:
Itay Gdor,
Seunghwan Yoo,
Xiaolei Wang,
Matthew Daddysman,
Rosemarie Wilton,
Nicola Ferrier,
Mark Hereld,
Oliver,
Cossairt,
Aggelos Katsaggelos,
Norbert F. Scherer
Abstract:
An interferometric fluorescent microscope and a novel theoretic image reconstruction approach were developed and used to obtain super-resolution images of live biological samples and to enable dynamic real time tracking. The tracking utilizes the information stored in the interference pattern of both the illuminating incoherent light and the emitted light. By periodically shifting the interferomet…
▽ More
An interferometric fluorescent microscope and a novel theoretic image reconstruction approach were developed and used to obtain super-resolution images of live biological samples and to enable dynamic real time tracking. The tracking utilizes the information stored in the interference pattern of both the illuminating incoherent light and the emitted light. By periodically shifting the interferometer phase and a phase retrieval algorithm we obtain information that allow localization with sub-2 nm axial resolution at 5 Hz.
△ Less
Submitted 14 February, 2018;
originally announced February 2018.
-
3D Snapshot Microscopy of Extended Objects
Authors:
Xiang Huang,
Alan Selewa,
Xiaolei Wang,
Matthew K. Daddysman,
Itay Gdor,
Rosemarie Wilton,
Kenneth M. Kemner,
Seunghwan Yoo,
Aggelos K. Katsaggelos,
Kuan He,
Oliver Cossairt,
Nicola J. Ferrier,
Mark Hereld,
Norbert F. Scherer
Abstract:
Volumetric biological imaging often involves compromising high temporal resolution at the expense of high spatial resolution when popular scanning methods are used to capture 3D information. We introduce an integrated experimental and image reconstruction method for capturing dynamic 3D fluorescent extended objects as a series of synchronously measured 3D snapshots taken at the frame rate of the i…
▽ More
Volumetric biological imaging often involves compromising high temporal resolution at the expense of high spatial resolution when popular scanning methods are used to capture 3D information. We introduce an integrated experimental and image reconstruction method for capturing dynamic 3D fluorescent extended objects as a series of synchronously measured 3D snapshots taken at the frame rate of the imaging camera. We employ multifocal microscopy (MFM) to simultaneously image at 25 focal planes and process this depth-encoded image to recover the 3D structure of extended objects, such as bacteria, using a sparsity-based reconstruction approach. The combined experimental and computational method produces image quality similar to confocal microscopy in a fraction of the acquisition time. In addition, our computational image reconstruction approach allows a simplified MFM optical design by correcting aberrations using the measured response to point sources. This "compressive" MFM acquisition and reconstruction method, where an image volume with roughly 8 million voxels is recovered from a single 1-megapixel captured image, enables straightforward study of dynamic processes in 3D, and as a simultaneous snapshot advances the state of the art in dynamic 3D microscopy.
△ Less
Submitted 22 May, 2018; v1 submitted 5 February, 2018;
originally announced February 2018.
-
The star formation histories of low surface brightness galaxies
Authors:
Eric F. Bell,
David Barnaby,
Richard G. Bower,
Roelof S. de Jong,
Doyal A. Harper,
Mark Hereld,
Robert F. Loewenstein,
Bernard J. Rauscher
Abstract:
We have performed deep imaging of a diverse sample of 26 low surface brightness galaxies (LSBGs) in the optical and the near-infrared. Using stellar population synthesis models, we find that it is possible to place constraints on the ratio of young to old stars (which we parameterise in terms of the average age of the galaxy), as well as the metallicity of the galaxy, using optical and near-infr…
▽ More
We have performed deep imaging of a diverse sample of 26 low surface brightness galaxies (LSBGs) in the optical and the near-infrared. Using stellar population synthesis models, we find that it is possible to place constraints on the ratio of young to old stars (which we parameterise in terms of the average age of the galaxy), as well as the metallicity of the galaxy, using optical and near-infrared colours. LSBGs have a wide range of morphologies and stellar populations, ranging from older, high metallicity earlier types to much younger and lower metallicity late type galaxies. Despite this wide range of star formation histories, we find that colour gradients are common in LSBGs. These are most naturally interpreted as gradients in mean stellar age, with the outer regions of LSBGs having younger ages than their inner regions. In an attempt to understand what drives the differences in LSBG stellar populations, we compare LSBG average ages and metallicities with their physical parameters. Strong correlations are seen between a LSBG's star formation history and its K band surface brightness, K band absolute magnitude and gas fraction. These correlations are consistent with a scenario in which the star formation history of a LSBG primarily correlates with its surface density and its metallicity correlates both with its mass and surface density.
△ Less
Submitted 23 September, 1999;
originally announced September 1999.
-
The Stellar Populations of Low Surface Brightness Galaxies
Authors:
E. F. Bell,
R. G. Bower,
R. S. de Jong,
M. Hereld,
B. J. Rauscher
Abstract:
Near-infrared (NIR) K' images of a sample of five low surface brightness disc galaxies (LSBGs) were combined with optical data, with the aim of constraining their star formation histories. Both red and blue LSBGs were imaged to enable comparison of their stellar populations. For both types of galaxy strong colour gradients were found, consistent with mean stellar age gradients. Very low stellar…
▽ More
Near-infrared (NIR) K' images of a sample of five low surface brightness disc galaxies (LSBGs) were combined with optical data, with the aim of constraining their star formation histories. Both red and blue LSBGs were imaged to enable comparison of their stellar populations. For both types of galaxy strong colour gradients were found, consistent with mean stellar age gradients. Very low stellar metallicities were ruled out on the basis of metallicity-sensitive optical-NIR colours. These five galaxies suggest that red and blue LSBGs have very different star formation histories and represent two independent routes to low B band surface brightness. Blue LSBGs are well described by models with low, roughly constant star formation rates, whereas red LSBGs are better described by a `faded disc' scenario.
△ Less
Submitted 13 November, 1998;
originally announced November 1998.
