-
DRG-Net: Interactive Joint Learning of Multi-lesion Segmentation and Classification for Diabetic Retinopathy Grading
Authors:
Hasan Md Tusfiqur,
Duy M. H. Nguyen,
Mai T. N. Truong,
Triet A. Nguyen,
Binh T. Nguyen,
Michael Barz,
Hans-Juergen Profitlich,
Ngoc T. T. Than,
Ngan Le,
Pengtao Xie,
Daniel Sonntag
Abstract:
Diabetic Retinopathy (DR) is a leading cause of vision loss in the world, and early DR detection is necessary to prevent vision loss and support an appropriate treatment. In this work, we leverage interactive machine learning and introduce a joint learning framework, termed DRG-Net, to effectively learn both disease grading and multi-lesion segmentation. Our DRG-Net consists of two modules: (i) DR…
▽ More
Diabetic Retinopathy (DR) is a leading cause of vision loss in the world, and early DR detection is necessary to prevent vision loss and support an appropriate treatment. In this work, we leverage interactive machine learning and introduce a joint learning framework, termed DRG-Net, to effectively learn both disease grading and multi-lesion segmentation. Our DRG-Net consists of two modules: (i) DRG-AI-System to classify DR Grading, localize lesion areas, and provide visual explanations; (ii) DRG-Expert-Interaction to receive feedback from user-expert and improve the DRG-AI-System. To deal with sparse data, we utilize transfer learning mechanisms to extract invariant feature representations by using Wasserstein distance and adversarial learning-based entropy minimization. Besides, we propose a novel attention strategy at both low- and high-level features to automatically select the most significant lesion information and provide explainable properties. In terms of human interaction, we further develop DRG-Net as a tool that enables expert users to correct the system's predictions, which may then be used to update the system as a whole. Moreover, thanks to the attention mechanism and loss functions constraint between lesion features and classification features, our approach can be robust given a certain level of noise in the feedback of users. We have benchmarked DRG-Net on the two largest DR datasets, i.e., IDRID and FGADR, and compared it to various state-of-the-art deep learning networks. In addition to outperforming other SOTA approaches, DRG-Net is effectively updated using user feedback, even in a weakly-supervised manner.
△ Less
Submitted 30 December, 2022;
originally announced December 2022.
-
Joint Self-Supervised Image-Volume Representation Learning with Intra-Inter Contrastive Clustering
Authors:
Duy M. H. Nguyen,
Hoang Nguyen,
Mai T. N. Truong,
Tri Cao,
Binh T. Nguyen,
Nhat Ho,
Paul Swoboda,
Shadi Albarqouni,
Pengtao Xie,
Daniel Sonntag
Abstract:
Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to overcome the lack of labeled training samples by learning feature representations from unlabeled data. However, most current SSL techniques in the medical field have…
▽ More
Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to overcome the lack of labeled training samples by learning feature representations from unlabeled data. However, most current SSL techniques in the medical field have been designed for either 2D images or 3D volumes. In practice, this restricts the capability to fully leverage unlabeled data from numerous sources, which may include both 2D and 3D data. Additionally, the use of these pre-trained networks is constrained to downstream tasks with compatible data dimensions. In this paper, we propose a novel framework for unsupervised joint learning on 2D and 3D data modalities. Given a set of 2D images or 2D slices extracted from 3D volumes, we construct an SSL task based on a 2D contrastive clustering problem for distinct classes. The 3D volumes are exploited by computing vectored embedding at each slice and then assembling a holistic feature through deformable self-attention mechanisms in Transformer, allowing incorporating long-range dependencies between slices inside 3D volumes. These holistic features are further utilized to define a novel 3D clustering agreement-based SSL task and masking embedding prediction inspired by pre-trained language models. Experiments on downstream tasks, such as 3D brain segmentation, lung nodule detection, 3D heart structures segmentation, and abnormal chest X-ray detection, demonstrate the effectiveness of our joint 2D and 3D SSL approach. We improve plain 2D Deep-ClusterV2 and SwAV by a significant margin and also surpass various modern 2D and 3D SSL approaches.
△ Less
Submitted 4 December, 2022;
originally announced December 2022.
-
Initial state reconstruction on graphs
Authors:
Vo Anh Khoa,
Mai Thanh Nhat Truong,
Imhotep Hogan,
Roselyn Williams
Abstract:
The presence of noise is an intrinsic problem in acquisition processes for digital images. One way to enhance images is to combine the forward and backward diffusion equations. However, the latter problem is well known to be exponentially unstable with respect to any small perturbations on the final data. In this scenario, the final data can be regarded as a blurred image obtained from the forward…
▽ More
The presence of noise is an intrinsic problem in acquisition processes for digital images. One way to enhance images is to combine the forward and backward diffusion equations. However, the latter problem is well known to be exponentially unstable with respect to any small perturbations on the final data. In this scenario, the final data can be regarded as a blurred image obtained from the forward process, and that image can be pixelated as a network. Therefore, we study in this work a regularization framework for the backward diffusion equation on graphs. Our aim is to construct a spectral graph-based solution based upon a cut-off projection. Stability and convergence results are provided together with some numerical experiments.
△ Less
Submitted 6 May, 2022; v1 submitted 17 April, 2022;
originally announced April 2022.
-
ASMCNN: An Efficient Brain Extraction Using Active Shape Model and Convolutional Neural Networks
Authors:
Duy H. M. Nguyen,
Duy M. Nguyen,
Mai T. N. Truong,
Thu Nguyen,
Khanh T. Tran,
Nguyen A. Triet,
Pham T. Bao,
Binh T. Nguyen
Abstract:
Brain extraction (skull stripping) is a challenging problem in neuroimaging. It is due to the variability in conditions from data acquisition or abnormalities in images, making brain morphology and intensity characteristics changeable and complicated. In this paper, we propose an algorithm for skull stripping in Magnetic Resonance Imaging (MRI) scans, namely ASMCNN, by combining the Active Shape M…
▽ More
Brain extraction (skull stripping) is a challenging problem in neuroimaging. It is due to the variability in conditions from data acquisition or abnormalities in images, making brain morphology and intensity characteristics changeable and complicated. In this paper, we propose an algorithm for skull stripping in Magnetic Resonance Imaging (MRI) scans, namely ASMCNN, by combining the Active Shape Model (ASM) and Convolutional Neural Network (CNN) for taking full of their advantages to achieve remarkable results. Instead of working with 3D structures, we process 2D image sequences in the sagittal plane. First, we divide images into different groups such that, in each group, shapes and structures of brain boundaries have similar appearances. Second, a modified version of ASM is used to detect brain boundaries by utilizing prior knowledge of each group. Finally, CNN and post-processing methods, including Conditional Random Field (CRF), Gaussian processes, and several special rules are applied to refine the segmentation contours. Experimental results show that our proposed method outperforms current state-of-the-art algorithms by a significant margin in all experiments.
△ Less
Submitted 27 January, 2022; v1 submitted 5 February, 2018;
originally announced February 2018.
-
Application of the cut-off projection to solve a backward heat conduction problem in a two-slab composite system
Authors:
Nguyen Huy Tuan,
Vo Anh Khoa,
Mai Thanh Nhat Truong,
Tran The Hung,
Mach Nguyet Minh
Abstract:
The main goal of this paper is applying the cut-off projection for solving one-dimensional backward heat conduction problem in a two-slab system with a perfect contact. In a constructive manner, we commence by demonstrating the Fourier-based solution that contains the drastic growth due to the high-frequency nature of the Fourier series. Such instability leads to the need of studying the projectio…
▽ More
The main goal of this paper is applying the cut-off projection for solving one-dimensional backward heat conduction problem in a two-slab system with a perfect contact. In a constructive manner, we commence by demonstrating the Fourier-based solution that contains the drastic growth due to the high-frequency nature of the Fourier series. Such instability leads to the need of studying the projection method where the cut-off approach is derived consistently. In the theoretical framework, the first two objectives are to construct the regularized problem and prove its stability for each noise level. Our second interest is estimating the error in $L^2$-norm. Another supplementary objective is computing the eigen-elements. All in all, this paper can be considered as a preliminary attempt to solve the heating/cooling of a two-slab composite system backward in time. Several numerical tests are provided to corroborate the qualitative analysis.
△ Less
Submitted 30 March, 2018; v1 submitted 19 October, 2017;
originally announced October 2017.
-
The Cauchy problem of coupled elliptic sine-Gordon equations with noise: Analysis of a general kernel-based regularization and reliable tools of computing
Authors:
Vo Anh Khoa,
Mai Thanh Nhat Truong,
Nguyen Ho Minh Duy,
Nguyen Huy Tuan
Abstract:
Developments in numerical methods for problems governed by nonlinear partial differential equations underpin simulations with sound arguments in diverse areas of science and engineering. In this paper, we explore the regularization method for the coupled elliptic sine-Gordon equations along with Cauchy data. The system of equations originates from the static case of the coupled hyperbolic sine-Gor…
▽ More
Developments in numerical methods for problems governed by nonlinear partial differential equations underpin simulations with sound arguments in diverse areas of science and engineering. In this paper, we explore the regularization method for the coupled elliptic sine-Gordon equations along with Cauchy data. The system of equations originates from the static case of the coupled hyperbolic sine-Gordon equations modeling the coupled Josephson junctions in superconductivity, and so far it addresses the Josephson $π$-junctions. In general, the Cauchy problem is not well-posed, and herein the Hadamard-instability occurs drastically. Generalizing the kernel-based regularization method, we propose a stable approximate solution. Confirmed by the error estimate, this solution strongly converges to the exact solution in $L^2$-norm. The main concern of this paper is also with the way to compute the regularized solution formed by an alike integral equation. We employ the proposed techniques that successfully approximated the highly oscillatory integral, and apply the Picard-like iteration to organize an efficient and reliable tool of computations. The results are viewed as the improvement as well as the generalization of many previous works. The paper is also accompanied by a numerical example that demonstrates the potential of this idea.
△ Less
Submitted 22 October, 2017; v1 submitted 21 August, 2015;
originally announced August 2015.
