×

Total variation based pure quaternion dictionary learning method for color image denoising. (English) Zbl 1524.94036

Summary: As an important pre-processing step for many related computer vision tasks, color image denoising has attracted considerable attention in image processing. However, traditional methods often regard the red, green, and blue channels of color images independently without considering the correlations among the three channels. In order to overcome this deficiency, this paper proposes a novel dictionary method for color image denoising based on pure quaternion representation, which efficiently deals with both single-channel and cross-channel information. The pure quaternion constraint is firstly used to force the sparse representations of color images to contain only red, green, and blue color information. Moreover, a total variation regularization is proposed in the quaternion domain and embedded into the pure quaternion-based representation model, which is effective to recover the sharp edges of color images. To solve the proposed model, a new numerical scheme is also developed based on the alternating minimization method (AMM). Experimental results demonstrate that the proposed model has better denoising results than the state-of-the-art methods, including a deep learning approach DnCNN, in terms of PSNR, SSIM, and visual quality.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
90C47 Minimax problems in mathematical programming
65K10 Numerical optimization and variational techniques

Software:

DnCNN; FTVd

References:

[1] Michal Aharon, Michael Elad, and Alfred Bruckstein. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 54(11):4311-4322, 2006. · Zbl 1375.94040
[2] Marino Badiale and Enrico Serra. Semilinear elliptic equations for beginners: existence results via the variational approach. Springer Science & Business Media, 2010. · Zbl 1214.35025
[3] Antoni Buades, Bartomeu Coll, and JeanMichel Morel. Image and movie denoising by non-local means. International Journal of Computer Vision, 76(2):1-25, 2006. · Zbl 1151.94310
[4] Shuting Cai, Zhao Kang, Ming Yang, Xiaoming Xiong, Chong Peng, and Mingqing Xiao. Image denoising via improved dictionary learning with global structure and local similarity preservations. Symmetry, 10(50):167-187, 2018.
[5] Antonin Chambolle and Thomas Pock. A first-order primal-dual algorithm for convex prob-lems with applications to imaging. Journal of Mathematical Imaging and Vision, 40:120-145, 2011. · Zbl 1255.68217
[6] Yongyong Chen, Xiaolin Xiao, and Yicong Zhou. Low-rank quaternion approximation for color image processing. IEEE Transactions on Image Processing, 29:1426-1439, 2020. · Zbl 07585964
[7] Mujibur Rahman Chowdhury, Jun Zhang, Jing Qin, and Yifei Lou. Poisson image denoising based on fractional-order total variation. Inverse Problems and Imaging, 14(1):77-96, 2020. · Zbl 1455.94013
[8] Bartomeu Coll, Joan Duran, and Catalina Sbert. Half-linear regularization for nonconvex image restoration models. Inverse Problems and Imaging, 9(2):337-370, 2015. · Zbl 1359.94029
[9] Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen O. Egiazarian. Color im-age denoising via sparse 3D collaborative filtering with grouping constraint in luminance-chrominance space. 2007 IEEE International Conference on Image Processing, 1:I313-I316, 2007.
[10] Cássio Fraga Dantas, Jeremy E. J. Cohen, and Rémi Gribonval. Hyperspectral image de-noising using dictionary learning. 2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), pages 1-5, 2019.
[11] Weisheng Dong, Lei Zhang, Guangming Shi, and Xin Li. Nonlocally centralized sparse rep-resentation for image restoration. IEEE Transactions on Image Processing, 22:1620-1630, 2013. · Zbl 1373.94104
[12] Weisheng Dong, Lei Zhang, Guangming Shi, and Xiaolin Wu. Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Transac-tions on Image Processing, 20(7):1838-1857, 2011. · Zbl 1372.94072
[13] Michael Elad and Michal Aharon. Image denoising via sparse and redundant representations over learned dictionaries. IEEE Transactions on Image Processing, 15(12):3736-3745, 2006.
[14] Kjersti Engan, Sven Ole Aase, and John Håkon Husøy. Multi-frame compression: theory and design. Signal Processing, 80:2121-2140, 2000. · Zbl 1098.94538
[15] Faming Fang, Juncheng Li, Yiting Yuan, Tieyong Zeng, and Guixu Zhang. Multilevel edge features guided network for image denoising. IEEE Transactions on Neural Networks and Learning Systems, 32(9):3956-3970, 2020.
[16] Bhawna Goyal, Ayush Dogra, Sunil Agrawal, Balwinder Singh Sohi, and Apoorav Maulik Sharma. Image denoising review: From classical to state-of-the-art approaches. Information Fusion, 55:220-244, 2020.
[17] William Rowan Hamilton. Elements of quaternions. Longmans, Green, & Company, 1866.
[18] Chaoyan Huang, Zhi Li, Yubing Liu, Tingting Wu, and Tieyong Zeng. Quaternion-based weighted nuclear norm minimization for color image restoration. Pattern Recognition, 128:108665, 2022.
[19] Chaoyan Huang, Michael K. Ng, Tingting Wu, and Tieyong Zeng. Quaternion-based dictio-nary learning and saturation-value total variation regularization for color image restoration. IEEE Transactions on Multimedia, pages 1-13, 2021.
[20] Zhigang Jia, Michael K Ng, and Wei Wang. Color image restoration by saturation-value total variation. SIAM Journal on Imaging Sciences, 12(2):972-1000, 2019. · Zbl 1524.94019
[21] Le Jiang, Jun Huang, XiaoGuang Lv, and Jun Liu. Alternating direction method for the high-order total variation-based poisson noise removal problem. Numerical Algorithms, 69:495-516, 2014. · Zbl 1320.65034
[22] Kenneth Kreutz-Delgado, Joseph F. Murray, Bhaskar D. Rao, Kjersti Engan, Te-Won Lee, and Terrence J. Sejnowski. Dictionary learning algorithms for sparse representation. Neural Computation, 15:349-396, 2003. · Zbl 1047.68101
[23] Juncheng Li, Hanhui Yang, Qiaosi Yi, Faming Fang, Guangwei Gao, Tieyong Zeng, and Guixu Zhang. Multiple degradation and reconstruction network for single image denoising via knowledge distillation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 558-567, 2022.
[24] Xiaoyao Li, Yicong Zhou, and Jing Zhang. Quaternion non-local total variation for color image denoising. 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), pages 1602-1607, 2019.
[25] Chaoyu Liu, Zhonghua Qiao, and Qian Zhang. An active contour model with local variance force term and its efficient minimization solver for multi-phase image segmentation. arXiv preprint arXiv:2203.09036, 2022. · Zbl 07471649
[26] Chaoyu Liu, Zhonghua Qiao, and Qian Zhang. Two-phase segmentation for intensity inho-mogeneous images by the Allen-Cahn local binary fitting model. SIAM Journal on Scientific Computing, 44(1):B177-B196, 2022. · Zbl 07471649
[27] Hao Liu, Xue-Cheng Tai, Ron Kimmel, and Roland Glowinski. A color Elastica model for vector-valued image regularization. SIAM Journal on Imaging Sciences, 14(2):717-748, 2021. · Zbl 1538.94011
[28] Zexin Liu and Wanggen Wan. Image inpainting algorithm based on ksvd and improved cdd. 2018 International Conference on Audio, Language and Image Processing (ICALIP), pages 413-417, 2018.
[29] Shousheng Luo, Qian Lv, Heshan Chen, and Jinping Song. Second-order total variation and primal-dual algorithm for CT image reconstruction. International Journal of Numerical Analysis and Modeling, 14(1):76-87, 2017. · Zbl 1367.92063
[30] Liyan Ma, Lionel Moisan, Jian Yu, and Tieyong Zeng. A stable method solving the total variation dictionary model with l ∞ constraints. Inverse Problems and Imaging, 8(2):507-535, 2014. · Zbl 1305.65098
[31] Julien Mairal, Francis R. Bach, Jean Ponce, and Guillermo Sapiro. Online dictionary learning for sparse coding. Proceedings of the 26th Annual International Conference on Machine Learning, pages 689-696, 2009.
[32] Julien Mairal, Michael Elad, and Guillermo Sapiro. Sparse representation for color image restoration. IEEE Transactions on Image Processing, 17:53-69, 2008. · Zbl 1194.49041
[33] Michael K. Ng, Xiaoming Yuan, and Wenxing Zhang. Coupled variational image decomposi-tion and restoration model for blurred cartoon-plus-texture images with missing pixels. IEEE Transactions on Image Processing, 22:2233-2246, 2013. · Zbl 1373.94301
[34] ZhiFeng Pang, YaMei Zhou, Tingting Wu, and DingJie Li. Image denoising via a new anisotropic total-variation-based model. Signal Processing: Image Communication, 74:140-152, 2019.
[35] Yagyensh Chandra Pati, Ramin Rezaiifar, and Perinkulam Sambamurthy Krishnaprasad. Or-thogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. Proceedings of 27th Asilomar Conference on Signals, Systems and Comput-ers, pages 40-44, 1993.
[36] SooChang Pei and ChingMin Cheng. A novel block truncation coding of color images by using quaternion-moment-preserving principle. IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96, 2:684-687, 1996.
[37] Zhonghua Qiao and Qian Zhang. Two-phase image segmentation by the Allen-Cahn equation and a nonlocal edge detection operator. arXiv preprint arXiv:2104.08992, 2021.
[38] Leonid I. Rudin, Stanley Osher, and Emad Fatemi. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena, 60(1-4):259-268, 1992. · Zbl 0780.49028
[39] Anis Theljani. Non-standard fourth-order PDE related to the image denoising multi-scale non-standard fourth-order PDE in image denoising and its fixed point algorithm. International Journal of Numerical Analysis and Modeling, 18:38-61, 2021. · Zbl 1471.65126
[40] Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1):267-288, 1996. · Zbl 0850.62538
[41] Ivana Tosic and Pascal Frossard. Dictionary learning. IEEE Signal Processing Magazine, 28:27-38, 2011. · Zbl 1372.94246
[42] Xiangyang Wang, Qian Wang, Xuebin Wang, HongYing Yang, Zhifang Wu, and PanPan Niu. Color image segmentation using proximal classifier and quaternion radial harmonic fourier moments. Pattern Analysis and Applications, pages 1-20, 2019.
[43] Yilun Wang, Junfeng Yang, Wotao Yin, and Yin Zhang. A new alternating minimization algo-rithm for total variation image reconstruction. SIAM Journal on Imaging Sciences, 1(3):248-272, 2008. · Zbl 1187.68665
[44] Zhengjiang Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13:600-612, 2004.
[45] Tingting Wu, Zhi-Feng Pang, Youguo Wang, and Yu-Fei Yang. CS-MRI reconstruction based on the constrained TGV-shearlet scheme. International Journal of Numerical Analysis and Modeling, 17(3), 2020. · Zbl 1471.92193
[46] Tingting Wu and Jinbo Shao. Non-convex and convex coupling image segmentation via TGpV regularization and thresholding. Advances in Applied Mathematics and Mechanics, 12(3):849-878, 2020. · Zbl 1488.94042
[47] Tingting Wu, Yichen Zhao, Zhihui Mao, Li Shi, Zhi Li, and Yonghua Zeng. Image segmen-tation via Fischer-Burmeister total variation and thresholding. Advances in Applied Mathe-matics and Mechanics, 14(4):960-988, 2022. · Zbl 1499.94015
[48] Jun Xu, Lei Zhang, Wangmeng Zuo, David Zhang, and Xiangchu Feng. Patch group based nonlocal self-similarity prior learning for image denoising. 2015 IEEE International Confer-ence on Computer Vision (ICCV), pages 244-252, 2015.
[49] Yangyang Xu and Wotao Yin. A fast patch-dictionary method for whole image recovery. Inverse Problems & Imaging, 10(2):563, 2016. · Zbl 1395.94071
[50] Yi Xu, Licheng Yu, Hongteng Xu, Hao Zhang, and Truong Nguyen. Vector sparse repre-sentation of color image using quaternion matrix analysis. IEEE Transactions on Image Processing, 24(4):1315-1329, 2015. · Zbl 1408.94741
[51] Fenlin Yang, Ke Chen, and Bo Yu. Efficient homotopy solution and a convex combination of ROF and LLT models for image restoration. International Journal of Numerical Analysis and Modeling, 9(4):907927, 2012. · Zbl 1264.35288
[52] Junfeng Yang, Yin Zhang, and Wotao Yin. An efficient TVL1 algorithm for deblurring multichannel images corrupted by impulsive noise. SIAM Journal on Scientific Computing, 31:2842-2865, 2009. · Zbl 1195.68110
[53] Xue Yang and Yu-Mei Huang. A modulus iteration method for SPSD linear complementarity problem arising in image retinex. Advances in Applied Mathematics and Mechanics, 12:579-598, 2020. · Zbl 1488.65147
[54] Yibin Yu, Yulan Zhang, and Shifang Yuan. Quaternion-based weighted nuclear norm mini-mization for color image denoising. Neurocomputing, 332:283-297, 2019.
[55] Fuzhen Zhang. Quaternions and matrices of quaternions. Linear Algebra and Its Applications, 251:21-57, 1997. · Zbl 0873.15008
[56] Kai Zhang, Wangmeng Zuo, Yunjin Chen, Deyu Meng, and Lei Zhang. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing, 26(7):3142-3155, 2017. School of Science, Nanjing University of Posts and Telecommunications, Nanjing E-mail: wutt@njupt.edu.cn, 1019081805@njupt.edu.cn, jinzhm@njupt.edu.cn · Zbl 1409.94754
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.