-
Dynamic MRI reconstruction using low-rank plus sparse decomposition with smoothness regularization
Authors:
Chee-Ming Ting,
Fuad Noman,
Raphaël C. -W. Phan,
Hernando Ombao
Abstract:
The low-rank plus sparse (L+S) decomposition model has enabled better reconstruction of dynamic magnetic resonance imaging (dMRI) with separation into background (L) and dynamic (S) component. However, use of low-rank prior alone may not fully explain the slow variations or smoothness of the background part at the local scale. In this paper, we propose a smoothness-regularized L+S (SR-L+S) model f…
▽ More
The low-rank plus sparse (L+S) decomposition model has enabled better reconstruction of dynamic magnetic resonance imaging (dMRI) with separation into background (L) and dynamic (S) component. However, use of low-rank prior alone may not fully explain the slow variations or smoothness of the background part at the local scale. In this paper, we propose a smoothness-regularized L+S (SR-L+S) model for dMRI reconstruction from highly undersampled k-t-space data. We exploit joint low-rank and smooth priors on the background component of dMRI to better capture both its global and local temporal correlated structures. Extending the L+S formulation, the low-rank property is encoded by the nuclear norm, while the smoothness by a general \ell_{p}-norm penalty on the local differences of the columns of L. The additional smoothness regularizer can promote piecewise local consistency between neighboring frames. By smoothing out the noise and dynamic activities, it allows accurate recovery of the background part, and subsequently more robust dMRI reconstruction. Extensive experiments on multi-coil cardiac and synthetic data shows that the SR-L+S model outp
△ Less
Submitted 30 January, 2024;
originally announced January 2024.
-
A Deep Probabilistic Spatiotemporal Framework for Dynamic Graph Representation Learning with Application to Brain Disorder Identification
Authors:
Sin-Yee Yap,
Junn Yong Loo,
Chee-Ming Ting,
Fuad Noman,
Raphael C. -W. Phan,
Adeel Razi,
David L. Dowe
Abstract:
Recent applications of pattern recognition techniques on brain connectome classification using functional connectivity (FC) are shifting towards acknowledging the non-Euclidean topology and causal dynamics of brain connectivity across time. In this paper, a deep spatiotemporal variational Bayes (DSVB) framework is proposed to learn time-varying topological structures in dynamic FC networks for ide…
▽ More
Recent applications of pattern recognition techniques on brain connectome classification using functional connectivity (FC) are shifting towards acknowledging the non-Euclidean topology and causal dynamics of brain connectivity across time. In this paper, a deep spatiotemporal variational Bayes (DSVB) framework is proposed to learn time-varying topological structures in dynamic FC networks for identifying autism spectrum disorder (ASD) in human participants. The framework incorporates a spatial-aware recurrent neural network with an attention-based message passing scheme to capture rich spatiotemporal patterns across dynamic FC networks. To overcome model overfitting on limited training datasets, an adversarial training strategy is introduced to learn graph embedding models that generalize well to unseen brain networks. Evaluation on the ABIDE resting-state functional magnetic resonance imaging dataset shows that our proposed framework substantially outperforms state-of-the-art methods in identifying patients with ASD. Dynamic FC analyses with DSVB-learned embeddings reveal apparent group differences between ASD and healthy controls in brain network connectivity patterns and switching dynamics of brain states.
△ Less
Submitted 13 May, 2024; v1 submitted 14 February, 2023;
originally announced February 2023.
-
Graph-Regularized Manifold-Aware Conditional Wasserstein GAN for Brain Functional Connectivity Generation
Authors:
Yee-Fan Tan,
Chee-Ming Ting,
Fuad Noman,
Raphaël C. -W. Phan,
Hernando Ombao
Abstract:
Common measures of brain functional connectivity (FC) including covariance and correlation matrices are semi-positive definite (SPD) matrices residing on a cone-shape Riemannian manifold. Despite its remarkable success for Euclidean-valued data generation, use of standard generative adversarial networks (GANs) to generate manifold-valued FC data neglects its inherent SPD structure and hence the in…
▽ More
Common measures of brain functional connectivity (FC) including covariance and correlation matrices are semi-positive definite (SPD) matrices residing on a cone-shape Riemannian manifold. Despite its remarkable success for Euclidean-valued data generation, use of standard generative adversarial networks (GANs) to generate manifold-valued FC data neglects its inherent SPD structure and hence the inter-relatedness of edges in real FC. We propose a novel graph-regularized manifold-aware conditional Wasserstein GAN (GR-SPD-GAN) for FC data generation on the SPD manifold that can preserve the global FC structure. Specifically, we optimize a generalized Wasserstein distance between the real and generated SPD data under an adversarial training, conditioned on the class labels. The resulting generator can synthesize new SPD-valued FC matrices associated with different classes of brain networks, e.g., brain disorder or healthy control. Furthermore, we introduce additional population graph-based regularization terms on both the SPD manifold and its tangent space to encourage the generator to respect the inter-subject similarity of FC patterns in the real data. This also helps in avoiding mode collapse and produces more stable GAN training. Evaluated on resting-state functional magnetic resonance imaging (fMRI) data of major depressive disorder (MDD), qualitative and quantitative results show that the proposed GR-SPD-GAN clearly outperforms several state-of-the-art GANs in generating more realistic fMRI-based FC samples. When applied to FC data augmentation for MDD identification, classification models trained on augmented data generated by our approach achieved the largest margin of improvement in classification accuracy among the competing GANs over baselines without data augmentation.
△ Less
Submitted 10 December, 2022;
originally announced December 2022.
-
Graph Autoencoders for Embedding Learning in Brain Networks and Major Depressive Disorder Identification
Authors:
Fuad Noman,
Chee-Ming Ting,
Hakmook Kang,
Raphael C. -W. Phan,
Brian D. Boyd,
Warren D. Taylor,
Hernando Ombao
Abstract:
Brain functional connectivity (FC) reveals biomarkers for identification of various neuropsychiatric disorders. Recent application of deep neural networks (DNNs) to connectome-based classification mostly relies on traditional convolutional neural networks using input connectivity matrices on a regular Euclidean grid. We propose a graph deep learning framework to incorporate the non-Euclidean infor…
▽ More
Brain functional connectivity (FC) reveals biomarkers for identification of various neuropsychiatric disorders. Recent application of deep neural networks (DNNs) to connectome-based classification mostly relies on traditional convolutional neural networks using input connectivity matrices on a regular Euclidean grid. We propose a graph deep learning framework to incorporate the non-Euclidean information about graph structure for classifying functional magnetic resonance imaging (fMRI)-derived brain networks in major depressive disorder (MDD). We design a novel graph autoencoder (GAE) architecture based on the graph convolutional networks (GCNs) to embed the topological structure and node content of large-sized fMRI networks into low-dimensional latent representations. In network construction, we employ the Ledoit-Wolf (LDW) shrinkage method to estimate the high-dimensional FC metrics efficiently from fMRI data. We consider both supervised and unsupervised approaches for the graph embedding learning. The learned embeddings are then used as feature inputs for a deep fully-connected neural network (FCNN) to discriminate MDD from healthy controls. Evaluated on two resting-state fMRI (rs-fMRI) MDD datasets, results show that the proposed GAE-FCNN model significantly outperforms several state-of-the-art methods for brain connectome classification, achieving the best accuracy using the LDW-FC edges as node features. The graph embeddings of fMRI FC networks learned by the GAE also reveal apparent group differences between MDD and HC. Our new framework demonstrates feasibility of learning graph embeddings on brain networks to provide discriminative information for diagnosis of brain disorders.
△ Less
Submitted 2 June, 2022; v1 submitted 27 July, 2021;
originally announced July 2021.
-
Lightning Mapping: Techniques, Challenges, and Opportunities
Authors:
Ammar Alammari,
Ammar Ahmed Alkahtani,
Mohd Riduan Ahmad,
Fuad M. Noman,
Mona Riza Mohd Esa,
Zen Kawasaki,
Sieh Kiong Tiong
Abstract:
Despite the significant progress made in studying the lightning phenomenon, precise location and mapping of its occurrence remain a challenge. Lightning mapping can be determined by studying the electromagnetic radiation accompanying the lightning discharges. It can contribute substantially to efforts made to protect lives and valuable assets. There are three main methods used to locate lightning,…
▽ More
Despite the significant progress made in studying the lightning phenomenon, precise location and mapping of its occurrence remain a challenge. Lightning mapping can be determined by studying the electromagnetic radiation accompanying the lightning discharges. It can contribute substantially to efforts made to protect lives and valuable assets. There are three main methods used to locate lightning, which are Magnetic Direction Finder (MDF), Time of Arrival (TOA), and Interferometer (ITF). A thorough study of these methods provides researchers with a guide to better understand and progress in this field. This paper reviews existing approaches used to locate and map lightning within these three methods. We study the implemented techniques, analyze their merits and demerits, and sort them in a way that facilitates extracting opportunities for further improvements. We conclude that for better development in determining the location and map of lightning, improving the processing of lightning signals and filtering the associated noise with it is essential. This includes introducing new processing methods such as wavelet transformation instead of the traditional cross-correlation. The use of artificial intelligence may also contribute a lot, particularly deep learning, to determining the type of lightning, which enables better mapping for the lightning and its occurrence. We also could conclude that unlike MDF and TOA, which can locate the lightning strike points, ITF can produce lightning discharge propagation images that can unveil the mechanism of lightning discharges. Finally, this paper serves as a reference for researchers focusing on lightning mapping to give them insight into the field.
△ Less
Submitted 31 May, 2020;
originally announced June 2020.
-
Kalman Filter and Wavelet Cross-correlation for VHF Broadband Interferometer Lightning Mapping
Authors:
Ammar Alammari,
Ammar Alkahtani,
Mohd Riduan,
Fuad Noman,
Mona Riza Mohd Esa,
Muhammad Haziq Mohamad Sabri,
Sulaiman Ali Mohammad,
Ahmed Salih Al-Khaleefa,
Zen Kawasaki,
Vassilios Agelidis
Abstract:
A lightning mapping system based on perpendicular crossed baseline interferometer (ITF) technology has been developed rapidly in recent years. Several processing methods have been proposed to estimate the temporal location and spatial map of lightning strikes. In this paper, a single very high frequency (VHF) interferometer is used to simulate and augment the lightning maps. We perform a comparati…
▽ More
A lightning mapping system based on perpendicular crossed baseline interferometer (ITF) technology has been developed rapidly in recent years. Several processing methods have been proposed to estimate the temporal location and spatial map of lightning strikes. In this paper, a single very high frequency (VHF) interferometer is used to simulate and augment the lightning maps. We perform a comparative study of using different processing techniques and procedures to enhance the localization and mapping of lightning VHF radiation. The benchmark environment involves the use of different noise reduction and cross-correlation methods. Moreover, interpolation techniques are introduced to smoothen the correlation peaks for more accurate lightning localization. A positive narrow bipolar event (NBE) lightning discharge is analyzed and the mapping procedure is confirmed using both simulated and measured lightning signals. The results indicate that a good estimation of lightning radiation sources is achieved when using wavelet denoising and cross-correlations in wavelet-domain (CCWD) with a minimal error of 3.46 (degrees). The investigations carried out in this study confirm that the ITF mapping system could effectively map the lightning VHF radiation source.
△ Less
Submitted 25 June, 2020; v1 submitted 25 April, 2020;
originally announced April 2020.
-
Wind Data Analysis for Assessing the Potential of Off-Grid Direct EV Charging Stations
Authors:
Fuad Noman,
Ammar Al-Kahtani,
Vassilios Agelidis,
Sieh Kiong Tiong
Abstract:
The integration of large-scale wind farms and large-scale charging stations for electric vehicles with the electricity grids necessitate energy storage support for both technologies. Matching the energy variability of the wind farms with the demand variability of the electric vehicles (EVs) off-grid could potentially eliminate the need for expensive energy storage technologies required to stabiliz…
▽ More
The integration of large-scale wind farms and large-scale charging stations for electric vehicles with the electricity grids necessitate energy storage support for both technologies. Matching the energy variability of the wind farms with the demand variability of the electric vehicles (EVs) off-grid could potentially eliminate the need for expensive energy storage technologies required to stabilize the grid. The objective of this paper is to investigate the feasibility of using wind generation as direct energy source to power the EV charging stations. An interval-based approach corresponding to the time slot of EV charging is introduced for wind energy conversion and analyzed using different constrains and criteria including, wind speed averaging time interval, various turbines manufacturers, and standard high-resolution wind speed data sets. We performed a piecewise recursive of wind turbines' output energy to measure the EV charging efficiency. Wind averaging results show that the three minutes intervals have increased the total number of EVs by more than 80% compared to one-- and two -minute intervals. The potential cost reduction due to decoupling of both technologies from the utility grid, energy storage systems, and the associated energy conversion power electronics has merit and research in this direction is worth pursuing
△ Less
Submitted 25 April, 2020;
originally announced April 2020.
-
A Comprehensive Review of Wind Energy in Malaysia: Past, Present and Future Research Trends
Authors:
Fuad Noman,
Gamal Alkawsi,
Dallatu Abbas,
Ammar Alkahtani,
Seih Kiong Tiong,
Janaka Ekanyake
Abstract:
Wind energy has gained a huge interest in the recent years in various countries due to the high demand of energy and the shortage of traditional electricity sources. This is because it is cost effective and environmentally friendly source that could contribute significantly to the reduction of the ever-increasing carbon emissions. Wind energy is one of the fastest growing green technology worldwid…
▽ More
Wind energy has gained a huge interest in the recent years in various countries due to the high demand of energy and the shortage of traditional electricity sources. This is because it is cost effective and environmentally friendly source that could contribute significantly to the reduction of the ever-increasing carbon emissions. Wind energy is one of the fastest growing green technology worldwide with a total generation share of 564 GW as the end of 2018. In Malaysia, wind energy has been a topic of interest in both academia and green energy industry. In this paper, the current status of wind energy research in Malaysia is reviewed. Different contributing factors such as potentiality and assessments, wind speed and direction modelling, wind prediction and spatial mapping, and optimal sizing of wind farms are extensively discussed. This paper discusses the progress of all wind studies and presents conclusions and recommendations to improve wind research in Malaysia.
△ Less
Submitted 24 April, 2020;
originally announced April 2020.
-
Classification of EEG-Based Brain Connectivity Networks in Schizophrenia Using a Multi-Domain Connectome Convolutional Neural Network
Authors:
Chun-Ren Phang,
Chee-Ming Ting,
Fuad Noman,
Hernando Ombao
Abstract:
We exploit altered patterns in brain functional connectivity as features for automatic discriminative analysis of neuropsychiatric patients. Deep learning methods have been introduced to functional network classification only very recently for fMRI, and the proposed architectures essentially focused on a single type of connectivity measure. We propose a deep convolutional neural network (CNN) fram…
▽ More
We exploit altered patterns in brain functional connectivity as features for automatic discriminative analysis of neuropsychiatric patients. Deep learning methods have been introduced to functional network classification only very recently for fMRI, and the proposed architectures essentially focused on a single type of connectivity measure. We propose a deep convolutional neural network (CNN) framework for classification of electroencephalogram (EEG)-derived brain connectome in schizophrenia (SZ). To capture complementary aspects of disrupted connectivity in SZ, we explore combination of various connectivity features consisting of time and frequency-domain metrics of effective connectivity based on vector autoregressive model and partial directed coherence, and complex network measures of network topology. We design a novel multi-domain connectome CNN (MDC-CNN) based on a parallel ensemble of 1D and 2D CNNs to integrate the features from various domains and dimensions using different fusion strategies. Hierarchical latent representations learned by the multiple convolutional layers from EEG connectivity reveal apparent group differences between SZ and healthy controls (HC). Results on a large resting-state EEG dataset show that the proposed CNNs significantly outperform traditional support vector machine classifiers. The MDC-CNN with combined connectivity features further improves performance over single-domain CNNs using individual features, achieving remarkable accuracy of $93.06\%$ with a decision-level fusion. The proposed MDC-CNN by integrating information from diverse brain connectivity descriptors is able to accurately discriminate SZ from HC. The new framework is potentially useful for developing diagnostic tools for SZ and other disorders.
△ Less
Submitted 21 March, 2019;
originally announced March 2019.
-
Short-segment heart sound classification using an ensemble of deep convolutional neural networks
Authors:
Fuad Noman,
Chee-Ming Ting,
Sh-Hussain Salleh,
Hernando Ombao
Abstract:
This paper proposes a framework based on deep convolutional neural networks (CNNs) for automatic heart sound classification using short-segments of individual heart beats. We design a 1D-CNN that directly learns features from raw heart-sound signals, and a 2D-CNN that takes inputs of two- dimensional time-frequency feature maps based on Mel-frequency cepstral coefficients (MFCC). We further develo…
▽ More
This paper proposes a framework based on deep convolutional neural networks (CNNs) for automatic heart sound classification using short-segments of individual heart beats. We design a 1D-CNN that directly learns features from raw heart-sound signals, and a 2D-CNN that takes inputs of two- dimensional time-frequency feature maps based on Mel-frequency cepstral coefficients (MFCC). We further develop a time-frequency CNN ensemble (TF-ECNN) combining the 1D-CNN and 2D-CNN based on score-level fusion of the class probabilities. On the large PhysioNet CinC challenge 2016 database, the proposed CNN models outperformed traditional classifiers based on support vector machine and hidden Markov models with various hand-crafted time- and frequency-domain features. Best classification scores with 89.22% accuracy and 89.94% sensitivity were achieved by the ECNN, and 91.55% specificity and 88.82% modified accuracy by the 2D-CNN alone on the test set.
△ Less
Submitted 26 October, 2018;
originally announced October 2018.
-
A Markov-Switching Model Approach to Heart Sound Segmentation and Classification
Authors:
Fuad Noman,
Sh-Hussain Salleh,
Chee-Ming Ting,
S. Balqis Samdin,
Hernando Ombao,
Hadri Hussain
Abstract:
Objective: This paper considers challenges in developing algorithms for accurate segmentation and classification of heart sound (HS) signals. Methods: We propose an approach based on Markov switching autoregressive model (MSAR) to segmenting the HS into four fundamental components each with distinct second-order structure. The identified boundaries are then utilized for automated classification of…
▽ More
Objective: This paper considers challenges in developing algorithms for accurate segmentation and classification of heart sound (HS) signals. Methods: We propose an approach based on Markov switching autoregressive model (MSAR) to segmenting the HS into four fundamental components each with distinct second-order structure. The identified boundaries are then utilized for automated classification of pathological HS using the continuous density hidden Markov model (CD-HMM). The MSAR formulated in a state-space form is able to capture simultaneously both the continuous hidden dynamics in HS, and the regime switching in the dynamics using a discrete Markov chain. This overcomes the limitation of HMM which uses a single-layer of discrete states. We introduce three schemes for model estimation: (1.) switching Kalman filter (SKF); (2.) refined SKF; (3.) fusion of SKF and the duration-dependent Viterbi algorithm (SKF-Viterbi). Results: The proposed methods are evaluated on Physionet/CinC Challenge 2016 database. The SKF-Viterbi significantly outperforms SKF by improvement of segmentation accuracy from 71% to 84.2%. The use of CD-HMM as a classifier and Mel-frequency cepstral coefficients (MFCCs) as features can characterize not only the normal and abnormal morphologies of HS signals but also morphologies considered as unclassifiable (denoted as X-Factor). It gives classification rates with best gross F1 score of 90.19 (without X-Factor) and 82.7 (with X-Factor) for abnormal beats. Conclusion: The proposed MSAR approach for automatic localization and detection of pathological HS shows a noticeable performance on large HS dataset. Significance: It has potential applications in heart monitoring systems to assist cardiologists for pre-screening of heart pathologies.
△ Less
Submitted 10 September, 2018;
originally announced September 2018.