A five-parameter class of derivative-free spectral conjugate gradient methods for systems of large-scale nonlinear monotone equations. (English) Zbl 07714912
Summary: In this paper, we consider a system of large-scale nonlinear monotone equations and propose a class of derivative-free spectral conjugate gradient methods to solve it efficiently. We demonstrate the appropriate analytical features of this class and prove the global convergence theorems under a backtracking line search technique. In order to illustrate the numerical effectiveness of our class, we organize a competition in which 405 test problems will be solved by some members of the new class and four other similar derivative-free conjugate gradient methods. All the analytical and numerical results indicate that the presented class is promising.
MSC:
| 65H10 | Numerical computation of solutions to systems of equations |
| 90C06 | Large-scale problems in mathematical programming |
| 49M37 | Numerical methods based on nonlinear programming |
Keywords:
large-scale optimization; system of nonlinear equations; monotonicity; derivative-free conjugate gradient method; derivative-free line search techniqueSoftware:
SCALCGReferences:
| [1] | Abubakar, A. B. and Kumam, P. [2019] “ A descent Dai-Liao conjugate gradient method for nonlinear equations,” Numer. Algorithms81(1), 197-210. · Zbl 1412.65042 |
| [2] | Ahookhosh, M., Amini, K. and Bahrami, S. [2013] “ Two derivative-free projection approaches for systems of large-scale nonlinear monotone equations,” Numer. Algorithms64(1), 21-42. · Zbl 1290.65046 |
| [3] | Al-Baali, M., Narushima, Y. and Yabe, H. A. [2015] “ A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization,” Comput. Optim. Appl.60(1), 89-110. · Zbl 1315.90051 |
| [4] | Andrei, N. [2010] “ Accelerated scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization,” Eur. J. Oper. Res.204(3), 410-420. · Zbl 1189.90151 |
| [5] | Andrei, N. [2011] “ Open problems in nonlinear conjugate gradient algorithms for unconstrained optimization,” Bull. Malaysian Math. Sci. Soc.34(2), 319-330. · Zbl 1225.49030 |
| [6] | Andrei, N. [2018] “ A Dai-Liao conjugate gradient algorithm with clustering of eigenvalues,” Numer. Algorithms77(1), 1273-1282. · Zbl 06860411 |
| [7] | Babaie-Kafaki, S. [2014] “ An adaptive conjugacy condition and related nonlinear conjugate gradient methods,” Int. J. Comput. Methods11(4), 1350092. · Zbl 1359.65097 |
| [8] | Bojari, S. and Eslahchi, M. R. [2020] “ Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization,” Numer. Algorithms83(1), 901-933. · Zbl 1436.90109 |
| [9] | Cheng, W. [2009] “ A PRP type method for systems of monotone equations,” Math. Comput. Model.50(1-2), 15-20. · Zbl 1185.65088 |
| [10] | Dai, Z. and Kang, J. [2021] “ Some new efficient mean-variance portfolio selection models,” Int. J. Finance Econ., https://doi.org/10.1002/ijfe.2400. |
| [11] | Dai, Z. and Zhu, H. [2020] “ A modified Hestenes-Stiefel-type derivative-free method for large-scale nonlinear monotone equations,” Mathematics8(2), 168. |
| [12] | Dai, Z., Chen, X. and Wen, F. [2015] “ A modified Perry’s conjugate gradient method-based derivative-free method for solving large-scale nonlinear monotone equations,” Appl. Math. Comput.270, 378-386. · Zbl 1410.90248 |
| [13] | Dai, Z., Dong, X., Kang, J. and Hong, L. [2020] “ Forecasting stock market returns: New technical indicators and two-step economic constraint method,” North Am. J. Econ. Finance53(1), 1-12. |
| [14] | Deng, Y. and Liu, Z. [2008] “ Two derivative-free algorithms for nonlinear equations,” Optim. Method Softw.23(3), 395-410. · Zbl 1153.65049 |
| [15] | Dennis, J. E. [1971] “ On the convergence of Broyden’s method for nonlinear systems of equations,” Math. Comput.25(115), 559-567. · Zbl 0277.65030 |
| [16] | Dolan, E. D. and Moré, J. J. [2002] “ Benchmarking optimization software with performance profiles,” Math. Program.91(2), 201-213. · Zbl 1049.90004 |
| [17] | Eslahchi, M. R. and Bojari, S. [2020] “ Global convergence of a new sufficient descent spectral three-term conjugate gradient class for large-scale optimization,” Optim. Method Softw., https://doi.org/10.1080/10556788.2020.1843167. · Zbl 1502.90170 |
| [18] | Gao, P. and He, C. [2018] “ An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints,” Calcolo, https://doi.org/10.1007/s10092-018-0291-2. · Zbl 1405.65043 |
| [19] | Griewank, A. [1986] “ The “global” convergence of Broyden-like methods with suitable line search,” J. Aust. Math. Soc.28(1), 75-92. · Zbl 0596.65034 |
| [20] | Grippo, L. and Sciandrone, M. [2007] “ Nonmonotone derivative-free methods for nonlinear equations,” Comput. Optim. Appl.37(1), 297-328. · Zbl 1180.90310 |
| [21] | Iusem, A. N. and Solodov, M. V. [1997] “ Newton-type methods with generalized distance for constrained optimization,” Optimization41(3), 257-278. · Zbl 0905.49015 |
| [22] | La-Cruz, W. and Raydan, M. [2003] “ Nonmonotone spectral methods for large-scale nonlinear systems,” Optim. Methods Softw.18(5), 583-599. · Zbl 1069.65056 |
| [23] | La-Cruz, W., Martínez, J. M. and Raydan, M. [2006] “ Spectral residual method without gradient information for solving large-scale nonlinear systems of equations,” Math. Comput.75(255), 1429-1448. · Zbl 1122.65049 |
| [24] | La-Cruz, W. [2017] “ A spectral algorithm for large-scale systems of nonlinear monotone equations,” Numer. Algorithms76(1), 1109-1130. · Zbl 1382.65143 |
| [25] | Li, D. and Fukushima, M. [1999] “ A globally and superlinearly convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations,” SIAM J. Numer. Anal.37(1), 152-172. · Zbl 0946.65031 |
| [26] | Li, Q. and Li, D. H. [2011] “ A class of derivative-free methods for large-scale nonlinear monotone equations,” IMA J. Numer. Anal.31(4), 1625-1635. · Zbl 1241.65047 |
| [27] | Li, M. [2013] “ A derivative-free PRP method for solving large-scale nonlinear systems of equations and its global convergence,” Optim. Methods Softw.29(3), 503-514. · Zbl 1282.90180 |
| [28] | Liu, J. K. and Li, S. J. [2017] “ Comments on a three-term derivative-free projection method for nonlinear monotone system of equations,” Calcolo54(4), 1213-1215. · Zbl 1383.65049 |
| [29] | Liu, Z., Liu, H. and Dai, Y. [2020] “ An improved Dai-Kou conjugate gradient algorithm for unconstrained optimization,” Comput. Optim. Appl.75(1), 145-167. · Zbl 1433.90126 |
| [30] | Narushima, Y., Yabe, H. and Ford, J. A. [2011] “ A three-term conjugate gradient method with sufficient descent property for unconstrained optimization,” SIAM J. Optim.21(1), 212-230. · Zbl 1250.90087 |
| [31] | Ortega, J. M. and Rheinboldt, W. C. [1970] Iterative Solution of Nonlinear Equations in Several Variables (Academic Press, New York). · Zbl 0241.65046 |
| [32] | Sabi’u, J., Shah, A., Waziri, M. Y. and Ahmed, K. [2021] “ Modified Hager-Zhang conjugate gradient methods via singular value analysis for solving monotone nonlinear equations with convex constraint,” Int. J. Comput. Methods18(4), 2050043. · Zbl 07446889 |
| [33] | Solodov, M. V. and Svaiter, B. F. [1998] “ A globally convergent in exact newton method for system of monotone equations,” in Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, , Vol. 22, eds. Fukushima, M. and Qi, L. (Springer, Boston, MA), pp. 355-369. · Zbl 0928.65059 |
| [34] | Sun, W. and Yuan, Y. X. [2006] Optimization Theory and Methods: Nonlinear Programming, (Springer, US). · Zbl 1129.90002 |
| [35] | Tarzanagh, D. A., Nazari, P. and Peyghami, M. R. [2017] “ A nonmonotone PRP conjugate gradient method for solving square and under-determined systems of equations,” Comput. Math. Appl. B73(2), 339-354. · Zbl 1368.65047 |
| [36] | Wang, C. W. and Wang, Y. J. [2009] “ A superlinearly convergent projection method for constrained systems of nonlinear equations,” J. Glob. Optim.44(2), 283-296. · Zbl 1191.90072 |
| [37] | Wang, X. Y., Li, S. J. and Kou, X. P. [2016] “ A self-adaptive three-term conjugate gradient method for monotone nonlinear equations with convex constraints,” Calcolo53(2), 133-145. · Zbl 1338.90459 |
| [38] | Xiao, Y., Wu, C. and Wu, S. Y. [2015] “ Norm descent conjugate gradient methods for solving symmetric nonlinear equations,” J. Glob. Optim.62(4), 751-762. · Zbl 1326.65063 |
| [39] | Xiao, Y. and Li, Z. [2020] “ Preconditioned conjugate gradient methods for the refined FEM discretizations of nearly incompressible elasticity problems in three dimensions,” Int. J. Comput. Methods17(3), 1850136. · Zbl 07136606 |
| [40] | Yan, Q. R., Peng, X. Z. and Li, D. H. [2010] “ A globally convergent derivative-free method for solving large-scale nonlinear monotone equations,” J. Comput. Appl. Math.234(3), 649-657. · Zbl 1189.65102 |
| [41] | Yu, Z., Lin, J., Sun, J., Xiao, Y., Liu, L. and Li, Z. [2009] “ Spectral gradient projection method for monotone nonlinear equations with convex constraints,” Appl. Numer. Math.59(10), 2416-2423. · Zbl 1183.65056 |
| [42] | Yu, G. H., Niu, S. Z. and Ma, J. H. [2013] “ Multivariate spectral gradient projection method for nonlinear monotone equations with convex constraints,” J. Ind. Manag. Optim.9(1), 117-129. · Zbl 1264.49037 |
| [43] | Zhang, L. and Zhou, W. J. [2006] “ Spectral gradient projection method for solving nonlinear monotone equations,” J. Comput. Appl. Math.196(2), 478-484. · Zbl 1128.65034 |
| [44] | Zhang, Y., Mei, L. and Lin, Y. [2021] “ A novel method for nonlinear boundary value problems based on multiscale orthogonal base,” Int. J. Comput. Methods18(9), 2150036. · Zbl 07446703 |
| [45] | Zhang, L. [2020] “ A derivative-free conjugate residual method using secant condition for general large-scale nonlinear equations,” Numer. Algorithms83(1), 1277-1293. · Zbl 1441.90160 |
| [46] | Zhao, Y. B. and Li, D. [2001] “ Monotonicity of fixed point and normal mapping associated with variational inequality and its application,” SIAM J. Optim.11(4), 962-973. · Zbl 1010.90084 |
| [47] | Zhou, W. J. and Li, D. H. [2008] “ A globally convergent BFGS method for nonlinear monotone equations without any merit functions,” Math. Comput.77(264), 2231-2240. · Zbl 1203.90180 |
| [48] | Zhou, G. and Toh, K. C. [2005] “ Superlinear convergence of a newton-type algorithm for monotone equations,” J. Optim. Theory Appl.125(1), 205-211. · Zbl 1114.65055 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
