×

Automatic extraction of cell nuclei using dilated convolutional network. (English) Zbl 1466.62413

Summary: Pathological examination has been done manually by visual inspection of hematoxylin and eosin (H&E)-stained images. However, this process is labor intensive, prone to large variations, and lacking reproducibility in the diagnosis of a tumor. We aim to develop an automatic workflow to extract different cell nuclei found in cancerous tumors portrayed in digital renderings of the H&E-stained images. For a given image, we propose a semantic pixel-wise segmentation technique using dilated convolutions. The architecture of our dilated convolutional network (DCN) is based on SegNet, a deep convolutional encoder-decoder architecture. For the encoder, all the max pooling layers in the SegNet are removed and the convolutional layers are replaced by dilated convolution layers with increased dilation factors to preserve image resolution. For the decoder, all max unpooling layers are removed and the convolutional layers are replaced by dilated convolution layers with decreased dilation factors to remove gridding artifacts. We show that dilated convolutions are superior in extracting information from textured images. We test our DCN network on both synthetic data sets and a public available data set of H&E-stained images and achieve better results than the state of the art.

MSC:

62P10 Applications of statistics to biology and medical sciences; meta analysis
62H30 Classification and discrimination; cluster analysis (statistical aspects)
62H35 Image analysis in multivariate analysis
68T10 Pattern recognition, speech recognition
Full Text: DOI

References:

[1] V. Badrinarayanan, A. Kendall and R. Cipolla, Segnet: A deep convolutional encoder-decoder architecture for image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 39 (2017), 2481-2495.
[2] L. Chen, G. Papandreou, I. Kokkinos, K. Murphy and A. L. Yuille, Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs,, IEEE Trans. Pattern Anal. Mach. Intell., 40 (2018), 834-848.
[3] R. Hamaguchi, A. Fujita, K. Nemoto, T. Imaizumi and S. Hikosaka, Effective use of dilated convolutions for segmenting small object instances in remote sensing imagery, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 2018, URL http://arxiv.org/abs/1709.00179.
[4] N. Japkowicz; S. Stephen, The class imbalance problem: A systematic study, Intelligent Data Analysis, 6, 429-449 (2002) · Zbl 1085.68628 · doi:10.3233/IDA-2002-6504
[5] M. Jung; M. Kang, Efficient nonsmooth nonconvex optimization for image restoration and segmentation, Journal of Scientific Computing, 62, 336-370 (2015) · Zbl 1320.65035 · doi:10.1007/s10915-014-9860-y
[6] A. Khan; N. Rajpoot; D. Treanor; D. Magee, A non-linear mapping approach to stain normalisation in digital histopathology images using image-specific colour deconvolution, IEEE Trans. Biomedical Engineering, 61, 1729-1738 (2014)
[7] D. P. Kingma and J. L. Ba, Adam: A method for stochastic optimization, in 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015, URL http://arxiv.org/abs/1412.6980.
[8] A. Krizhevsky, I. Sutskever and G. E. Hinton, Imagenet classification with deep convolutional neural networks,, in Communications of the ACM, 2017, 1-9, URL http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf.
[9] N. Kumar; R. Verma; S. Sharma; S. Bhargava; A. Vahadane; A. Sethi, A dataset and technique for generalized nuclear segmentation for computational pathology, IEEE Trans. Med. Imag., 36, 1550-1560 (2017) · doi:10.1109/TMI.2017.2677499
[10] Y. Lecun; L. Bottou; Y. Bengio; P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE, 86, 2278-2324 (1998) · doi:10.1109/5.726791
[11] C. Liu; M. Ng; T. Zeng, Weighted variational model for selective image segmentation with application to medical images, Pattern Recognition, 76, 367-379 (2018) · doi:10.1016/j.patcog.2017.11.019
[12] MATLAB, version 9.5 (R2018b), The MathWorks Inc., Natick, Massachusetts, 2018.
[13] H. Noh, S. Hong and B. Han, Learning deconvolution network for semantic segmentation,, in Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), ICCV ’15, IEEE Computer Society, Washington, DC, USA, 2015, 1520-1528.
[14] N. Qian, On the momentum term in gradient descent learning algorithms, Neural Networks: The Official Journal of the International Neural Network Society, 12, 145-151 (1999) · doi:10.1016/S0893-6080(98)00116-6
[15] E. Reinhard; M. Adhikhmin; B. Gooch; P. Shirley, Color transfer between images, IEEE Comput. Graph. Appl., 21, 34-41 (2001)
[16] O. Ronneberger, P. Fischer and T. Brox, U-net: Convolutional networks for biomedical image segmentation,, in Medical Image Computing and Computer-Assisted Intervention (MICCAI), vol. 9351 of LNCS, Springer, 2015,234-241, URL http://lmb.informatik.uni-freiburg.de/Publications/2015/RFB15a, (available on arXiv: 1505.04597 [cs.CV]).
[17] E. Shelhamer, J. Long and T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 39 (2017), 640-651.
[18] K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, in 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015, URL http://arxiv.org/abs/1409.1556.
[19] F. Yu and V. Koltun, Multi-scale context aggregation by dilated convolutions, CoRR, abs/1511.07122.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.