-
In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection
Authors:
H. Fabelo,
S. Ortega,
A. Szolna,
D. Bulters,
J. F. Pineiro,
S. Kabwama,
A. Shanahan,
H. Bulstrode,
S. Bisshopp,
B. R. Kiran,
D. Ravi,
R. Lazcano,
D. Madronal,
C. Sosa,
C. Espino,
M. Marquez,
M. De la Luz Plaza,
R. Camacho,
D. Carrera,
M. Hernandez,
G. M. Callico,
J. Morera,
B. Stanciulescu,
G. Z. Yang,
R. Salvador
, et al. (3 additional authors not shown)
Abstract:
The use of hyperspectral imaging for medical applications is becoming more common in recent years. One of the main obstacles that researchers find when developing hyperspectral algorithms for medical applications is the lack of specific, publicly available, and hyperspectral medical data. The work described in this paper was developed within the framework of the European project HELICoiD (HypErspe…
▽ More
The use of hyperspectral imaging for medical applications is becoming more common in recent years. One of the main obstacles that researchers find when developing hyperspectral algorithms for medical applications is the lack of specific, publicly available, and hyperspectral medical data. The work described in this paper was developed within the framework of the European project HELICoiD (HypErspectraL Imaging Cancer Detection), which had as a main goal the application of hyperspectral imaging to the delineation of brain tumors in real-time during neurosurgical operations. In this paper, the methodology followed to generate the first hyperspectral database of in-vivo human brain tissues is presented. Data was acquired employing a customized hyperspectral acquisition system capable of capturing information in the Visual and Near InfraRed (VNIR) range from 400 to 1000 nm. Repeatability was assessed for the cases where two images of the same scene were captured consecutively. The analysis reveals that the system works more efficiently in the spectral range between 450 and 900 nm. A total of 36 hyperspectral images from 22 different patients were obtained. From these data, more than 300 000 spectral signatures were labeled employing a semi-automatic methodology based on the spectral angle mapper algorithm. Four different classes were defined: normal tissue, tumor tissue, blood vessel, and background elements. All the hyperspectral data has been made available in a public repository.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
Sapaki: Galactic O3If* star possibly born in isolation
Authors:
M. S. Zarricueta Plaza,
A. Roman-Lopes,
D. Sanmartim
Abstract:
Context: The study of high-mass stars found to be isolated in the field of the Milky Way may help to probe the feasibility of the core-accretion mechanism in the case of massive star formation. The existence of truly isolated stars may efficiently probe the possibility that individual massive stars can be born in isolation. Aims: We observed WR67a (hereafter Sapaki), an O3If* star that appears to…
▽ More
Context: The study of high-mass stars found to be isolated in the field of the Milky Way may help to probe the feasibility of the core-accretion mechanism in the case of massive star formation. The existence of truly isolated stars may efficiently probe the possibility that individual massive stars can be born in isolation. Aims: We observed WR67a (hereafter Sapaki), an O3If* star that appears to be isolated close to the center of a well-developed giant cavity that is aptly traced by 8.0 $μ$m hot dust emission. Methods: We acquired medium-resolution ($R=4100$) and moderate signal-to-noise ($S/N = 95$ at 4500 Å) spectra for Sapaki in the range of 3800-10500 Å with the Magellan Echellette (MagE) at Las Campanas Observatory. We computed the line-of-sight total extinctions. Additionally, we restricted its heliocentric distance by using a range of different estimators. Moreover, we measured its radial velocity from several lines in its spectrum. Finally, we analyzed its proper motions from Gaia to examine its possible runaway status. Results: The star has been classified as having the spectral type O3If* given its resemblance to standard examples of the class. In addition, we found that Sapaki is highly obscured, reaching a line-of-sight extinction value of $A_{V} = 7.87$. We estimated the heliocentric distance to be in the range of $d = 4-7$ kpc. We also estimated its radial velocity to be $V_{r} = -34.2 \pm 15.6$ km/s. We may also discard its runaway status solely based on its 2D kinematics. Furthermore, by analyzing proper motions and parallaxes provided by Gaia, we found only one other star with compatible measurements. Conclusions: Given its apparent non-runaway status and the absence of clustering, Sapaki appears to be a solid candidate for isolated high-mass star formation in the Milky Way.
△ Less
Submitted 19 May, 2023;
originally announced May 2023.
-
The Athena X-ray Integral Field Unit: a consolidated design for the system requirement review of the preliminary definition phase
Authors:
Didier Barret,
Vincent Albouys,
Jan-Willem den Herder,
Luigi Piro,
Massimo Cappi,
Juhani Huovelin,
Richard Kelley,
J. Miguel Mas-Hesse,
Stéphane Paltani,
Gregor Rauw,
Agata Rozanska,
Jiri Svoboda,
Joern Wilms,
Noriko Yamasaki,
Marc Audard,
Simon Bandler,
Marco Barbera,
Xavier Barcons,
Enrico Bozzo,
Maria Teresa Ceballos,
Ivan Charles,
Elisa Costantini,
Thomas Dauser,
Anne Decourchelle,
Lionel Duband
, et al. (274 additional authors not shown)
Abstract:
The Athena X-ray Integral Unit (X-IFU) is the high resolution X-ray spectrometer, studied since 2015 for flying in the mid-30s on the Athena space X-ray Observatory, a versatile observatory designed to address the Hot and Energetic Universe science theme, selected in November 2013 by the Survey Science Committee. Based on a large format array of Transition Edge Sensors (TES), it aims to provide sp…
▽ More
The Athena X-ray Integral Unit (X-IFU) is the high resolution X-ray spectrometer, studied since 2015 for flying in the mid-30s on the Athena space X-ray Observatory, a versatile observatory designed to address the Hot and Energetic Universe science theme, selected in November 2013 by the Survey Science Committee. Based on a large format array of Transition Edge Sensors (TES), it aims to provide spatially resolved X-ray spectroscopy, with a spectral resolution of 2.5 eV (up to 7 keV) over an hexagonal field of view of 5 arc minutes (equivalent diameter). The X-IFU entered its System Requirement Review (SRR) in June 2022, at about the same time when ESA called for an overall X-IFU redesign (including the X-IFU cryostat and the cooling chain), due to an unanticipated cost overrun of Athena. In this paper, after illustrating the breakthrough capabilities of the X-IFU, we describe the instrument as presented at its SRR, browsing through all the subsystems and associated requirements. We then show the instrument budgets, with a particular emphasis on the anticipated budgets of some of its key performance parameters. Finally we briefly discuss on the ongoing key technology demonstration activities, the calibration and the activities foreseen in the X-IFU Instrument Science Center, and touch on communication and outreach activities, the consortium organisation, and finally on the life cycle assessment of X-IFU aiming at minimising the environmental footprint, associated with the development of the instrument. Thanks to the studies conducted so far on X-IFU, it is expected that along the design-to-cost exercise requested by ESA, the X-IFU will maintain flagship capabilities in spatially resolved high resolution X-ray spectroscopy, enabling most of the original X-IFU related scientific objectives of the Athena mission to be retained. (abridged).
△ Less
Submitted 28 November, 2022; v1 submitted 30 August, 2022;
originally announced August 2022.
-
Latent Feature Representation via Unsupervised Learning for Pattern Discovery in Massive Electron Microscopy Image Volumes
Authors:
Gary B Huang,
Huei-Fang Yang,
Shin-ya Takemura,
Pat Rivlin,
Stephen M Plaza
Abstract:
We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core idea is to use data augmentations that preserve semantic meaning to generate synthetic examples of elements whose feature representations should be close to on…
▽ More
We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core idea is to use data augmentations that preserve semantic meaning to generate synthetic examples of elements whose feature representations should be close to one another.
We demonstrate the utility of our method applied to nano-scale electron microscopy data, where even relatively small portions of animal brains can require terabytes of image data. Although supervised methods can be used to predict and identify known patterns of interest, the scale of the data makes it difficult to mine and analyze patterns that are not known a priori. We show the ability of our learned representation to enable query by example, so that if a scientist notices an interesting pattern in the data, they can be presented with other locations with matching patterns. We also demonstrate that clustering of data in the learned space correlates with biologically-meaningful distinctions. Finally, we introduce a visualization tool and software ecosystem to facilitate user-friendly interactive analysis and uncover interesting biological patterns. In short, our work opens possible new avenues in understanding of and discovery in large data sets, arising in domains such as EM analysis.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
Fully-Automatic Synapse Prediction and Validation on a Large Data Set
Authors:
Gary B. Huang,
Louis K. Scheffer,
Stephen M. Plaza
Abstract:
Extracting a connectome from an electron microscopy (EM) data set requires identification of neurons and determination of synapses between neurons. As manual extraction of this information is very time-consuming, there has been extensive research effort to automatically segment the neurons to help guide and eventually replace manual tracing. Until recently, there has been comparatively less resear…
▽ More
Extracting a connectome from an electron microscopy (EM) data set requires identification of neurons and determination of synapses between neurons. As manual extraction of this information is very time-consuming, there has been extensive research effort to automatically segment the neurons to help guide and eventually replace manual tracing. Until recently, there has been comparatively less research on automatically detecting the actual synapses between neurons. This discrepancy can, in part, be attributed to several factors: obtaining neuronal shapes is a prerequisite first step in extracting a connectome, manual tracing is much more time-consuming than annotating synapses, and neuronal contact area can be used as a proxy for synapses in determining connections.
However, recent research has demonstrated that contact area alone is not a sufficient predictor of synaptic connection. Moreover, as segmentation has improved, we have observed that synapse annotation is consuming a more significant fraction of overall reconstruction time. This ratio will only get worse as segmentation improves, gating overall possible speed-up. Therefore, we address this problem by developing algorithms that automatically detect pre-synaptic neurons and their post-synaptic partners. In particular, pre-synaptic structures are detected using a Deep and Wide Multiscale Recursive Network, and post-synaptic partners are detected using a MLP with features conditioned on the local segmentation.
This work is novel because it requires minimal amount of training, leverages advances in image segmentation directly, and provides a complete solution for polyadic synapse detection. We further introduce novel metrics to evaluate our algorithm on connectomes of meaningful size. These metrics demonstrate that complete automatic prediction can be used to effectively characterize most connectivity correctly.
△ Less
Submitted 11 April, 2016;
originally announced April 2016.
-
Large-Scale Electron Microscopy Image Segmentation in Spark
Authors:
Stephen M. Plaza,
Stuart E. Berg
Abstract:
The emerging field of connectomics aims to unlock the mysteries of the brain by understanding the connectivity between neurons. To map this connectivity, we acquire thousands of electron microscopy (EM) images with nanometer-scale resolution. After aligning these images, the resulting dataset has the potential to reveal the shapes of neurons and the synaptic connections between them. However, imag…
▽ More
The emerging field of connectomics aims to unlock the mysteries of the brain by understanding the connectivity between neurons. To map this connectivity, we acquire thousands of electron microscopy (EM) images with nanometer-scale resolution. After aligning these images, the resulting dataset has the potential to reveal the shapes of neurons and the synaptic connections between them. However, imaging the brain of even a tiny organism like the fruit fly yields terabytes of data. It can take years of manual effort to examine such image volumes and trace their neuronal connections. One solution is to apply image segmentation algorithms to help automate the tracing tasks. In this paper, we propose a novel strategy to apply such segmentation on very large datasets that exceed the capacity of a single machine. Our solution is robust to potential segmentation errors which could otherwise severely compromise the quality of the overall segmentation, for example those due to poor classifier generalizability or anomalies in the image dataset. We implement our algorithms in a Spark application which minimizes disk I/O, and apply them to a few large EM datasets, revealing both their effectiveness and scalability. We hope this work will encourage external contributions to EM segmentation by providing 1) a flexible plugin architecture that deploys easily on different cluster environments and 2) an in-memory representation of segmentation that could be conducive to new advances.
△ Less
Submitted 1 April, 2016;
originally announced April 2016.
-
Large-scale EM Analysis of the Drosophila Antennal Lobe with Automatically Computed Synapse Point Clouds
Authors:
Ting Zhao,
Shin-ya Takemura,
Gary B. Huang,
Jane Anne Horne,
William T. Katz,
Kazunori Shinomiya,
Louis K. Scheffer,
Ian A. Meinertzhagen,
Patricia K. Rivlin,
Stephen M. Plaza
Abstract:
The promise of extracting connectomes and performing useful analysis on large electron microscopy (EM) datasets has been an elusive dream for many years. Tracing in even the smallest portions of neuropil requires copious human annotation, the rate-limiting step for generating a connectome. While a combination of improved imaging and automatic segmentation will lead to the analysis of increasingly…
▽ More
The promise of extracting connectomes and performing useful analysis on large electron microscopy (EM) datasets has been an elusive dream for many years. Tracing in even the smallest portions of neuropil requires copious human annotation, the rate-limiting step for generating a connectome. While a combination of improved imaging and automatic segmentation will lead to the analysis of increasingly large volumes, machines still fail to reach the quality of human tracers. Unfortunately, small errors in image segmentation can lead to catastrophic distortions of the connectome.
In this paper, to analyze very large datasets, we explore different mechanisms that are less sensitive to errors in automation. Namely, we advocate and deploy extensive synapse detection on the entire antennal lobe (AL) neuropil in the brain of the fruit fly Drosophila, a region much larger than any densely annotated to date. The resulting synapse point cloud produced is invaluable for determining compartment boundaries in the AL and choosing specific regions for subsequent analysis. We introduce our methodology in this paper for region selection and show both manual and automatic synapse annotation results. Finally, we note the correspondence between image datasets obtained using the synaptic marker, antibody nc82, and our datasets enabling registration between light and EM image modalities.
△ Less
Submitted 25 August, 2015;
originally announced August 2015.
-
Structure of the photo-catalytically active surface of SrTiO3
Authors:
Manuel Plaza,
Xin Huang,
J. Y. Peter Ko,
Joel D. Brock,
Mei Shen,
Burton H. Simpson,
Joaquín Rodríguez-López,
Nicole L. Ritzert,
Héctor D. Abruña,
Kendra Letchworth-Weaver,
Deniz Gunceler,
T. A. Arias,
Darrell G. Schlom
Abstract:
A major goal of energy research is to use visible light to cleave water directly, without an applied voltage, into hydrogen and oxygen. Since the initial reports of the ultraviolet (UV) activity of TiO2 and SrTiO3 in the 1970s, researchers have pursued a fundamental understanding of the mechanistic and molecular-level phenomena involved in photo-catalysis. Although it requires UV light, after four…
▽ More
A major goal of energy research is to use visible light to cleave water directly, without an applied voltage, into hydrogen and oxygen. Since the initial reports of the ultraviolet (UV) activity of TiO2 and SrTiO3 in the 1970s, researchers have pursued a fundamental understanding of the mechanistic and molecular-level phenomena involved in photo-catalysis. Although it requires UV light, after four decades SrTiO3 is still the gold standard for splitting water. It is chemically stable and catalyzes both the hydrogen and the oxygen reactions without applied bias. While ultrahigh vacuum (UHV) surface science techniques have provided useful insights, we still know relatively little about the structure of electrodes in contact with electrolytes under operating conditions. Here, we report the surface structure evolution of a SrTiO3 electrode during water splitting, before and after training with a positive bias. Operando high-energy X-ray reflectivity measurements demonstrate that training the electrode irreversibly reorders the surface. Scanning electrochemical microscopy (SECM) at open circuit correlates this training with a tripling of the activity toward photo-induced water splitting. A novel first-principles joint density-functional theory (JDFT) simulation constrained to the X-ray data via a generalized penalty function identifies an anatase-like structure for the more active, trained surface.
△ Less
Submitted 5 August, 2015;
originally announced August 2015.
-
Automatic Neuron Type Identification by Neurite Localization in the Drosophila Medulla
Authors:
Ting Zhao,
Stephen M Plaza
Abstract:
Mapping the connectivity of neurons in the brain (i.e., connectomics) is a challenging problem due to both the number of connections in even the smallest organisms and the nanometer resolution required to resolve them. Because of this, previous connectomes contain only hundreds of neurons, such as in the C.elegans connectome. Recent technological advances will unlock the mysteries of increasingly…
▽ More
Mapping the connectivity of neurons in the brain (i.e., connectomics) is a challenging problem due to both the number of connections in even the smallest organisms and the nanometer resolution required to resolve them. Because of this, previous connectomes contain only hundreds of neurons, such as in the C.elegans connectome. Recent technological advances will unlock the mysteries of increasingly large connectomes (or partial connectomes). However, the value of these maps is limited by our ability to reason with this data and understand any underlying motifs. To aid connectome analysis, we introduce algorithms to cluster similarly-shaped neurons, where 3D neuronal shapes are represented as skeletons. In particular, we propose a novel location-sensitive clustering algorithm. We show clustering results on neurons reconstructed from the Drosophila medulla that show high-accuracy.
△ Less
Submitted 5 September, 2014;
originally announced September 2014.
-
Annotating Synapses in Large EM Datasets
Authors:
Stephen M. Plaza,
Toufiq Parag,
Gary B. Huang,
Donald J. Olbris,
Mathew A. Saunders,
Patricia K. Rivlin
Abstract:
Reconstructing neuronal circuits at the level of synapses is a central problem in neuroscience and becoming a focus of the emerging field of connectomics. To date, electron microscopy (EM) is the most proven technique for identifying and quantifying synaptic connections. As advances in EM make acquiring larger datasets possible, subsequent manual synapse identification ({\em i.e.}, proofreading) f…
▽ More
Reconstructing neuronal circuits at the level of synapses is a central problem in neuroscience and becoming a focus of the emerging field of connectomics. To date, electron microscopy (EM) is the most proven technique for identifying and quantifying synaptic connections. As advances in EM make acquiring larger datasets possible, subsequent manual synapse identification ({\em i.e.}, proofreading) for deciphering a connectome becomes a major time bottleneck. Here we introduce a large-scale, high-throughput, and semi-automated methodology to efficiently identify synapses. We successfully applied our methodology to the Drosophila medulla optic lobe, annotating many more synapses than previous connectome efforts. Our approaches are extensible and will make the often complicated process of synapse identification accessible to a wider-community of potential proofreaders.
△ Less
Submitted 4 December, 2014; v1 submitted 5 September, 2014;
originally announced September 2014.
-
Focused Proofreading: Efficiently Extracting Connectomes from Segmented EM Images
Authors:
Stephen M. Plaza
Abstract:
Identifying complex neural circuitry from electron microscopic (EM) images may help unlock the mysteries of the brain. However, identifying this circuitry requires time-consuming, manual tracing (proofreading) due to the size and intricacy of these image datasets, thus limiting state-of-the-art analysis to very small brain regions. Potential avenues to improve scalability include automatic image s…
▽ More
Identifying complex neural circuitry from electron microscopic (EM) images may help unlock the mysteries of the brain. However, identifying this circuitry requires time-consuming, manual tracing (proofreading) due to the size and intricacy of these image datasets, thus limiting state-of-the-art analysis to very small brain regions. Potential avenues to improve scalability include automatic image segmentation and crowd sourcing, but current efforts have had limited success. In this paper, we propose a new strategy, focused proofreading, that works with automatic segmentation and aims to limit proofreading to the regions of a dataset that are most impactful to the resulting circuit. We then introduce a novel workflow, which exploits biological information such as synapses, and apply it to a large dataset in the fly optic lobe. With our techniques, we achieve significant tracing speedups of 3-5x without sacrificing the quality of the resulting circuit. Furthermore, our methodology makes the task of proofreading much more accessible and hence potentially enhances the effectiveness of crowd sourcing.
△ Less
Submitted 3 September, 2014;
originally announced September 2014.
-
Room-temperature ferromagnetism in the mixtures of the TiO2 and Co3O4 powders
Authors:
A. Serrano,
E. Fernandez Pinel,
A. Quesada,
I. Lorite,
M. Plaza,
L. Perez,
F. Jimenez-Villacorta,
J. de la Venta,
M. S. Martin-Gonzalez,
J. L. Costa-Kramer,
J. F. Fernandez,
J. Llopis,
M. A. Garcia
Abstract:
We report here the observation of ferromagnetism (FM) at 300 K in mixtures of TiO2 and Co3O4 powders despite the antiferromagnetic and diamagnetic character of both oxides respectively. The ferromagnetic behavior is found in the early stages of reaction and only for TiO2 in anatase structure; no FM is found for identical samples prepared with rutile-TiO2. Optical spectroscopy and X-ray absorptio…
▽ More
We report here the observation of ferromagnetism (FM) at 300 K in mixtures of TiO2 and Co3O4 powders despite the antiferromagnetic and diamagnetic character of both oxides respectively. The ferromagnetic behavior is found in the early stages of reaction and only for TiO2 in anatase structure; no FM is found for identical samples prepared with rutile-TiO2. Optical spectroscopy and X-ray absorption spectra confirm a surface reduction of octahedral Co+3->Co+2 in the mixtures which is in the origin of the observed magnetism
△ Less
Submitted 30 March, 2009;
originally announced March 2009.