×
Wu, Xiaodi; Ye, Xiaomin; Han, Daolan

A family of accelerated hybrid conjugate gradient method for unconstrained optimization and image restoration. (English) Zbl 07895349

J. Appl. Math. Comput. 70, No. 4, 2677-2699 (2024).

MSC:

90Cxx Mathematical programming
65Kxx Numerical methods for mathematical programming, optimization and variational techniques
49Mxx Numerical methods in optimal control

Keywords:

unconstrained optimization; accelerated hybrid conjugate gradient method; restart procedure; global convergence; image restoration

Software:

CUTEr; SCALCG; minpack; SifDec
Cite Review PDF
Full Text: DOI

References:

[1] Hestenes, MR; Stiefel, E., Methods of conjugate gradients for solving linear systems, J. Res. Natl. Bur. Stand., 49, 6, 409-436, 1952 · Zbl 0048.09901
[2] Fletcher, R.; Reeves, CM, Function minimization by conjugate gradients, Comput. J., 7, 2, 149-154, 1964 · Zbl 0132.11701
[3] Polak, E.; Ribière, G., Note surla convergence de directions conjugèes, Rev Fr Informat Rech Operationelle 3e Anneè, 16, 3, 35-43, 1969 · Zbl 0174.48001
[4] Polyak, BT, The conjugate gradient method in extremal problems, USSR Comput. Math. Math. Phys., 9, 4, 94-112, 1969 · Zbl 0229.49023
[5] Dai, YH; Yuan, YX, A nonlinear conjugate gradient method with a strong global convergence property, SIAM J. Optim., 10, 1, 177-182, 1999 · Zbl 0957.65061
[6] Wei, ZX; Yao, SW; Liu, LY, The convergence properties of some new conjugate gradient methods, Appl. Math. Comput., 183, 2, 1341-1350, 2006 · Zbl 1116.65073
[7] Jiang, XZ; Jian, JB, A sufficient descent Dai-Yuan type nonlinear conjugate gradient method for unconstrained optimization problems, Nonlinear Dyn., 72, 101-112, 2013 · Zbl 1268.65066
[8] Zhu, ZB; Zhang, DD; Wang, S., Two modified DY conjugate gradient methods for unconstrained optimization problems, Appl. Math. Comput., 373, 15, 125004, 2020 · Zbl 1433.90190
[9] Touati-Ahmed, D.; Storey, C., Efficient hybrid conjugate gradient techniques, J. Optim. Theory Appl., 64, 2, 379-397, 1990 · Zbl 0666.90063
[10] Dai, YH; Yuan, YX, An efficient hybrid conjugate gradient method for unconstrained optimization, Ann. Oper. Res., 103, 1, 33-47, 2001 · Zbl 1007.90065
[11] Andrei, N., Another hybrid conjugate gradient algorithm for unconstrained optimization, Numer. Algor., 47, 2, 143-156, 2008 · Zbl 1141.65041
[12] Andrei, N., Hybrid conjugate gradient algorithm for unconstrained optimization, J. Optim. Theory Appl., 141, 2, 249-264, 2009 · Zbl 1168.90017
[13] Jian, JB; Han, L.; Jiang, XZ, A hybrid conjugate gradient method with descent property for unconstrained optimization, Appl. Math. Model., 39, 3-4, 1281-1290, 2015 · Zbl 1432.90145
[14] Jiang, XZ; Yang, HH; Jian, JB, Two families of hybrid conjugate gradient methods with restart procedures and their applications, Optim. Methods Softw., 38, 5, 947-974, 2023 · Zbl 1523.90308
[15] Dai, YH; Liao, LZ, New conjugacy conditions and related nonlinear conjugate gradient methods, Appl. Math. Optim., 43, 87-101, 2001 · Zbl 0973.65050
[16] Yabe, H.; Takano, M., Global convergence properties of nonlinear conjugate gradient methods with modified secant condition, Comput. Optim. Appl., 28, 203-225, 2004 · Zbl 1056.90130
[17] Li, G.; Tang, C.; Wei, Z., New conjugacy condition and related new conjugate gradient methods for unconstrained optimization, J. Comput. Appl. Math., 202, 523-539, 2007 · Zbl 1116.65069
[18] Babaie-Kafaki, S.; Ghanbari, R., The Dai-Liao nonlinear conjugate gradient method with optimal parameter choices, Eur. J. Oper. Res., 234, 625-630, 2014 · Zbl 1304.90216
[19] Shao, H.; Guo, H.; Wu, XY, Two families of self-adjusting spectral hybrid DL conjugate gradient methods and applications in image denoising, Appl. Math. Model., 118, 393-411, 2023 · Zbl 1510.90215
[20] Zhang, L.; Zhou, W.; Li, DH, Some descent three-term conjugate gradient methods and their global convergence, Optim. Methods Softw., 22, 4, 697-711, 2007 · Zbl 1220.90094
[21] Jiang, XZ; Liao, W.; Yin, JH, A new family of hybrid three-term conjugate gradient methods with applications in image restoration, Numer. Algor., 91, 161-191, 2022 · Zbl 1496.65076
[22] Jiang, XZ; Yang, HH; Yin, JH, A three-term conjugate gradient algorithm with restart procedure to solve image restoration problems, J. Comput. Appl. Math., 424, 115020, 2023 · Zbl 1519.90226
[23] Babaie-Kafaki, S., Two modified scaled nonlinear conjugate gradient methods, J. Comput. Appl. Math., 261, 172-182, 2014 · Zbl 1278.65086
[24] Andrei, N., Scaled conjugate gradient algorithms for unconstrained optimization, Comput. Optim. Appl., 38, 3, 401-416, 2007 · Zbl 1168.90608
[25] Jian, JB; Chen, Q.; Jiang, XZ, A new spectral conjugate gradient method for large-scale unconstrained optimization, Optim. Methods Softw., 32, 3, 503-515, 2017 · Zbl 1365.90201
[26] Crowder, H.; Wolfe, P., Linear convergence of the conjugate gradient method, IBM J. Res. Dev., 16, 4, 431-433, 1972 · Zbl 0263.65068
[27] Powell, MJD, Some convergence properties of the conjugate gradient method, Math. Program., 11, 1, 42-49, 1976 · Zbl 0356.65056
[28] Andrei, N., Open problems in nonlinear conjugate gradient algorithms for unconstrained optimization, Bull. Malays. Math. Sci. Soc., 34, 2, 319-330, 2011 · Zbl 1225.49030
[29] Jiang, XZ; Zhu, YH; Jian, JB, Two efficient nonlinear conjugate gradient methods with restart procedures and their applications in image restoration, Nonlinear Dyn., 111, 6, 5469-5498, 2023
[30] Yin, JH; Jian, JB; Jiang, XZ, A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications, Numer. Algor., 88, 1, 389-418, 2022 · Zbl 1484.65131
[31] Liu, PJ; Wu, XY; Shao, H., Three adaptive hybrid derivative-free projection methods for constrained monotone nonlinear equations and their applications, Numer. Linear Algebra Appl., 30, 2, 2471, 2022 · Zbl 07675620
[32] Liu, YF; Zhu, ZB; Zhang, BX, Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing, J. Appl. Math. Comput., 68, 3, 1787-1816, 2022 · Zbl 1493.90190
[33] Kou, CX; Yang, H., A mini-batch stochastic conjugate gradient algorithm with variance reduction, J. Glob. Optim., 87, 1-17, 2022
[34] Yang, Z., Adaptive stochastic conjugate gradient for machine learning, Expert Syst. Appl., 206, 117719, 2022
[35] Shi, ZJ; Guo, J., A new family of conjugate gradient methods, J. Comput. Appl. Math., 224, 1, 444-457, 2009 · Zbl 1155.65049
[36] Nazareth, JL; Floudas, C.; Pardalos, P., Conjugate-gradient methods, Encyclopedia of Optimization, 1999, Boston: Kluwer Academic Publishers, Boston
[37] Jiang, XZ; Ye, XM; Huang, ZF, A family of hybrid conjugate gradient method with restart procedure for unconstrained optimizations and image restorations, Comput. Oper. Res., 159, 106-341, 2023 · Zbl 1543.90281
[38] Zoutendijk, G.; Abadie, J., Nonlinear programming computational methods, Integer and Nonlinear Programming, 37-86, 1970, Amsterdam: North-Holland, Amsterdam · Zbl 0336.90057
[39] Andrei, N., Acceleration of conjugate gradient algorithms for unconstrained optimization, Appl. Math. Comput., 213, 2, 361-369, 2009 · Zbl 1172.65027
[40] Kou, CX; Dai, YH, A modified self-scaling memoryless Broyden-Fletcher-Goldfarb-Shanno method for unconstrained optimization, J. Optim. Theory Appl., 165, 1, 209-224, 2015 · Zbl 1319.49042
[41] Dai, YH; Kou, CX, A nonlinear conjugate gradient algorithm with an optimal property and an improved Wolfe line search, SIAM J. Optim., 23, 1, 296-320, 2013 · Zbl 1266.49065
[42] Andrei, N., Hybrid conjugate gradient algorithm for unconstrained optimization, J. Optim. Theory Appl., 141, 2, 249-264, 2009 · Zbl 1168.90017
[43] Gould, NIM; Orban, D.; Toint, PL, CUTEr and SifDec: a constrained and unconstrained testing environment, ACM Trans. Math. Softw., 29, 4, 373-394, 2003 · Zbl 1068.90526
[44] Moré, JJ; Garbow, BS; Hillstrome, KE, Testing unconstrained optimization software, ACM Trans. Math. Softw., 7, 1, 17-41, 1981 · Zbl 0454.65049
[45] Andrei, N., An unconstrained optimization test functions collection, Adv. Model. Optim., 10, 1, 147-161, 2008 · Zbl 1161.90486
[46] Dolan, ED; Moré, JJ, Benchmarking optimization software with performance profiles, Math. program., 91, 2, 201-213, 2002 · Zbl 1049.90004
[47] Chan, RH; Ho, CW; Nikolova, M., Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization, IEEE Trans. Image Process., 14, 10, 1479-1485, 2005
[48] Charbonnier, P.; Blanc-Féraud, L.; Aubert, G., Deterministic edge-preserving regularization in computed imaging, IEEE T. Image Process., 6, 2, 298-311, 1997
[49] Cai, J.F., Chan, R., Morini, B.: Minimization of an edge-preserving regularization functional by conjugate gradient type methods. Image Processing Based on Partial Differential Equations. Springer, Berlin, Heidelberg. pp. 109-122 (2007)
[50] Bovik, AC, Handbook of Image and Video Processing, 2010, San Diego: Academic Press, San Diego
[51] Hwang, H.; Haddad, RA, Adaptive median filters: New algorithms and results, IEEE Trans. Image Process., 4, 4, 499-502, 1995
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.