Descent Perry conjugate gradient methods for systems of monotone nonlinear equations. (English) Zbl 1455.65085
Summary: In this paper, we present a family of Perry conjugate gradient methods for solving large-scale systems of monotone nonlinear equations. The methods are developed by combining modified versions of [A. Perry, Oper. Res. 26, 1073–1078 (1978; Zbl 0419.90074)] conjugate gradient method with the hyperplane projection technique of [M. V. Solodov and B. F. Svaiter, Appl. Optim. 22, 355–369 (1999; Zbl 0928.65059)]. Global convergence and numerical results of the methods are established and preliminary numerical results shows that the proposed methods are promising and more effective compared to some existing methods in the literature.
MSC:
| 65H10 | Numerical computation of solutions to systems of equations |
| 65K05 | Numerical mathematical programming methods |
| 90C30 | Nonlinear programming |
| 90C53 | Methods of quasi-Newton type |
| 49M37 | Numerical methods based on nonlinear programming |
Keywords:
nonlinear equations; eigenvalue analysis; hyperplane projection; monotonicity property; global convergence; conjugate gradient methodsSoftware:
ACGSSVReferences:
| [1] | Andrei, N., Open problems in conjugate gradient algorithms for unconstrained optimization, Bull. Malays. Math. Sci. Soc., 34, 2, 319-330 (2011) · Zbl 1225.49030 |
| [2] | Andrei, N., Accelerated adaptive Perry conjugate gradient algorithms based on the self-scaling BFGS update, J. Comput. Appl. Math., 149-164, 325 (2017) · Zbl 1365.65158 |
| [3] | Arazm, MR; Babaie-Kafaki, S.; Ghanbari, R., An extended Dai-Liao conjugate gradient method with global convergence for nonconvex functions, Glasnik Matematic, 52, 72, 361-375 (2017) · Zbl 1380.65099 |
| [4] | Babaie-Kafaki, S.; Ghanbari, R.; Mahdavi-Amiri, N., Two new conjugate gradient methods based on modified secant equations, J. Comput. Appl. Math., 234, 5, 1374-1386 (2010) · Zbl 1202.65071 |
| [5] | Babaie-Kafaki, S.; Ghanbari, R., A descent family of Dai-Liao conjugate gradient methods, Optim. Methods Softw., 29, 3, 583-591 (2013) · Zbl 1285.90063 |
| [6] | Babaie-Kafaki, S.; Ghanbari, R., The Dai-Liao nonlinear conjugate gradient method with optimal parameter choices, Eur. J. Oper. Res., 234, 625-630 (2014) · Zbl 1304.90216 |
| [7] | Babaie-Kafaki, S.; Ghanbari, R., Two optimal Dai-Liao conjugate gradient methods, Optimization., 64, 2277-2287 (2015) · Zbl 1386.65158 |
| [8] | Babaie-Kafaki, S.; Ghanbari, R., A descent extension of of the Polak-Ribieré-Polyak conjugate gradient method, Comput. Math. Appl., 68, 2014, 2005-2011 (2014) · Zbl 1369.65077 |
| [9] | Bouaricha, A.; Schnabel, RB, Tensor methods for large sparse systems of nonlinear equations, Math. Program., 377-400, 82 (1998) · Zbl 0951.65046 |
| [10] | Broyden, CG, A class of methods for solving nonlinear simultaneous equations, Math. Comput., 577-593, 19 (1965) · Zbl 0131.13905 |
| [11] | Cheng, W., A PRP type method for systems of monotone equations, Math. Comput. Modell., 15-20, 50 (2009) · Zbl 1185.65088 |
| [12] | Dai, YH; Liao, LZ, New conjugacy conditions and related nonlinear conjugate gradient methods, Appl. Math. Optim., 43, 1, 87-101 (2001) · Zbl 0973.65050 |
| [13] | Dai, YH; Yuan, YX, Nonlinear Conjugate Gradient Methods (2000), Shanghai: Shanghai Scientific and Technical Publishers, Shanghai |
| [14] | Dai, Z.; Chen, X.; Wen, F., A modified Perrys conjugate gradient method-based derivative-free method for solving large-scale nonlinear monotone equation, Appl. Math. Comput., 270, 378-386 (2015) · Zbl 1410.90248 |
| [15] | Dauda, MK; Mamat, M.; Mohamed, MA; Waziri, MY, Improved quasi-Newton method via SR1 update for solving symmetric systems of nonlinear equations, Malayan J. Fund. Appl. Sci., 15, 1, 117-120 (2019) |
| [16] | Dolan, ED; Moré, JJ, Benchmarking optimization software with performance profiles, Math. Program., 91, 2, 201-2013 (2002) · Zbl 1049.90004 |
| [17] | Fasano, G.; Lampariello, F.; Sciandrone, M., A truncated nonmonotone Gauss-Newton method for large-scale nonlinear least-squares problems, Comput. Optim. Appl., 343-358, 34 (2006) · Zbl 1122.90094 |
| [18] | Fatemi, M., An optimal parameter for Dai-Liao family of conjugate gradient methods, J. Optim. Theory Appl., 169, 2, 587-605 (2016) · Zbl 1368.90131 |
| [19] | Ford, JA; Moghrabi, IA, Multi-step quasi-Newton methods for optimization, J. Comput. Appl. Math., 50, 13, 305-323 (1994) · Zbl 0807.65062 |
| [20] | Ford, JA; Narushima, Y.; Yabe, H., Multi-step nonlinear conjugate gradient methods for unconstrained minimization, Comput. Optim. Appl., 40, 2, 191-216 (2008) · Zbl 1181.90221 |
| [21] | Grippo, L.; Lampariello, F.; Lucidi, S., A nonmonotone linesearch technique for Newtons method, SIAM J. Numer. Anal., 707-716, 23 (1986) · Zbl 0616.65067 |
| [22] | Hager, WW; Zhang, H., A survey of nonlinear conjugate gradient methods, Pac. J. Optim., 2, 1, 35-58 (2006) · Zbl 1117.90048 |
| [23] | Hestenes, MR; Stiefel, EL, Methods of conjugate gradients for solving linear systems, J. Res. Nat. Bur. Stand., 49, 409-436 (1952) · Zbl 0048.09901 |
| [24] | Kanzow, C.; Yamashita, N.; Fukushima, M., Levenberg-Marquardt methods for constrained nonlinear equations with strong local convergence properties, J. Comput. Appl. Math., 172, 375-397 (2004) · Zbl 1064.65037 |
| [25] | Khoshgam, Z., Ashrafi, A.: A new modidified scaled conjugate gradient method for large-scale unconstrained optimization with non-convex objective function. Optimization Methods and Software, 10.1080/10556788.2018.1457152 (2018) · Zbl 1422.90023 |
| [26] | Kincaid, D.; Cheney, W., Numerical Analysis (1991), California: Brooks/Cole Publishing Company, California · Zbl 0745.65001 |
| [27] | Koorapetse, M.; Kaelo, P.; Offen, ER, A scaled derivative-free projection method for solving nonlinear monotone equations, Bullet. Iran. Math. Soc., 45, 3, 755-770 (2018) · Zbl 1412.90141 |
| [28] | Levenberg, K., A method for the solution of certain non-linear problems in least squares, Q. Appl. Math., 164-166, 2 (1944) · Zbl 0063.03501 |
| [29] | Li, DH; Fukushima, M., A globally and superlinearly convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations, SIAM J. Numer. Anal., 37, 1, 152-172 (2000) · Zbl 0946.65031 |
| [30] | Li, DH; Fukushima, M., A derivative-free linesearch and global convergence of Broyden-like method for nonlinear equations, Optim. Methods Softw., 583-599, 13 (2000) |
| [31] | Li, G.; Tang, C.; Wei, Z., New conjugacy condition and related new conjugate gradient methods for unconstrained optimization, J. Comput. Appl. Math., 202, 2, 523-539 (2007) · Zbl 1116.65069 |
| [32] | Liu, D.Y., Shang, Y.F.: A new Perry conjugate gradient method with the generalized conjugacy condition. In: 2010 International Conference on Issue Computational Intelligence and Software Engineering (CiSE) (2010) |
| [33] | Liu, D.Y., Xu, G.Q.: A Perry descent conjugate gradient method with restricted spectrum. Optimization Online, Nonlinear Optimization (unconstrained optimization), pp. 1-19 (2011) |
| [34] | Liu, J. K., Feng, Y. M.: A norm descent derivative-free algorithm for solving large-scale nonlinear symmetric equations. 10.1016/j.cam.2018.05.006(2017) · Zbl 1458.65059 |
| [35] | Liu, JK; Li, SJ, A projection method for convex constrained monotone nonlinear equationswith applications, Comput. Math. Appl., 70, 10, 2442-2453 (2015) · Zbl 1443.65073 |
| [36] | Livieris, IE; Pintelas, P., Globally convergent modified Perrys conjugate gradient method, Appl. Math. Comput., 218, 9197-9207 (2012) · Zbl 1245.65068 |
| [37] | Livieris, IE; Pintelas, P., A new class of spectral conjugate gradient methods based on a modified secant equation for unconstrained optimization, J. Comput. Appl. Math., 239, 396-405 (2013) · Zbl 1258.65058 |
| [38] | Livieris, I.E., Pintelas, P.: A descent Dai-Liao conjugate gradient method based on a modified secant equation and its global convergence. ISRN Computational Mathematics (2012) · Zbl 1245.65067 |
| [39] | Livieris, IE; Pintelas, P., A new conjugate gradient algorithm for training neural networks based on a modified secant equation, Appl. Math. Comput., 221, 2013, 491-502 (2013) · Zbl 1329.65128 |
| [40] | Marquardt, DW, An algorithm for least-squares estimation of nonlinear parameters, SIAM J. Appl. Math., 11, 431-441 (1963) · Zbl 0112.10505 |
| [41] | Mompati, S.; Koorapetse, M.; Kaelo, P., Globally convergent three-term conjugate gradient projection methods for solving nonlinear monotone equations, Arabian J. Math., 7, 4, 289-301 (2018) · Zbl 1412.90142 |
| [42] | Nocedal, J.; Wright, SJ, Numerical Optimization (1999), New York: Springer, New York · Zbl 0930.65067 |
| [43] | Ortega, JM; Rheinboldt, WC, Iterative Solution of Nonlinear Equations in Several Variables (1970), New York: Academic Press, New York · Zbl 0241.65046 |
| [44] | Peiting, G., Chuanjiang, H.: A derivative-free three-term projection algorithm involving spectral quotient for solving nonlinear monotone equations. Optimization. A Journal of Mathematical Programming and Operations Research, pp. 1-18 (2018) · Zbl 1417.90098 |
| [45] | Perry, A., A modified conjugate gradient algorithm, Oper. Res. Tech. Notes, 26, 6, 1073-1078 (1978) · Zbl 0419.90074 |
| [46] | Polak, BT, The conjugate gradient method in extreme problems, USSR Comput. Math. Math. Phys., 94-112, 4 (1969) · Zbl 0229.49023 |
| [47] | Polak, E.; Ribire, G., Note sur la convergence de mthodes de directions conjugues, Rev. Fr. Inform. Rech. Oper., 16, 35-43 (1969) · Zbl 0174.48001 |
| [48] | Solodov, VM; Iusem, AN, Newton-type methods with generalized distances for constrained optimization, Optimization, 41, 3, 257-27 (1997) · Zbl 0905.49015 |
| [49] | Solodov, M.V., Svaiter, B.F.: A globally convergent inexact Newton method for systems of monotone equations. In: Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, pp. 355-369. Springer (1998) · Zbl 0928.65059 |
| [50] | Sun, M.; Wang, X.; Feng, D., A family of conjugate gradient methods for large-scale nonlinear equations, J. Inequal. Appl., 236, 1-8 (2017) · Zbl 1371.90101 |
| [51] | Sun, W.; Yuan, YX, Optimization Theory and Methods: Nonlinear Programming (2006), NewYork: Springer, NewYork · Zbl 1129.90002 |
| [52] | Tong, XJ; Qi, L., On the convergence of a trust-region method for solving constrained nonlinear equations with degenerate solutions, J. Optim. Theory Appl., 123, 1, 187-211 (2004) · Zbl 1069.65055 |
| [53] | Waziri, M.Y., Ahmed, K., Sabiu, J.: A Dai-Liao conjugate gradient method via modified secant equation for system of nonlinear equations. Arabian Journal of Mathematics. 10.1007/s40065-019-0264-6, 1-15 (2019) |
| [54] | Waziri, MY; Ahmed, K.; Sabiu, J., A family of Hager-Zhang conjugate gradient methods for system of monotone nonlinear equations, Appl. Math. Comput., 361, 645-660 (2019) · Zbl 1428.90163 |
| [55] | Waziri, MY; Leong, WJ; Hassan, MA, Jacobian free-diagonal Newton’s method for nonlinear systems with singular Jacobian, Malaysian J. Math. Sci., 5, 2, 241-255 (2011) · Zbl 1244.65072 |
| [56] | Waziri, M.Y., Sabiu, J.: A Derivative-free conjugate gradient method and its global convergence for solving symmetric nonlinear equations. Hindawi Publishing Corporation International Journal of Mathematics and Mathematical Sciences, Vol. 2015, pp. 8 · Zbl 1476.65078 |
| [57] | Wei, Z., Li, G., Qi, L.: New quasi-Newton methods for unconstrained optimization problems, vol. 175 (2006) · Zbl 1100.65054 |
| [58] | Xiao, Y.; Zhu, H., A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing, J. Math. Anal. Appl., 405, 310-319 (2013) · Zbl 1316.90050 |
| [59] | Yabe, H.; Takano, M., Global convergence properties of nonlinear conjugate gradient methods with modified secant condition, Comput. Optim. Appl., 28, 2, 203-225 (2004) · Zbl 1056.90130 |
| [60] | Yan, QR; Peng, XZ; Li, DH, A globally convergent derivative-free method for solving large-scale nonlinear monotone equations, J. Comput. Appl. Math., 234, 649-657 (2010) · Zbl 1189.65102 |
| [61] | Yu, G., A derivative-free method for solving large-scale nonlinear systems of equations, J. Ind. Manag. Optim., 6, 149-160 (2010) · Zbl 1187.65055 |
| [62] | Yu, G., Nonmonotone spectral gradient-type methods for large-scale unconstrained optimization and nonlinearsystems of equations, Pac. J. Optim., 7, 387-404 (2011) · Zbl 1228.49038 |
| [63] | Yuan, YX, A modified BFGS algorithm for unconstrained optimization, IMA J. Numer. Anal., 11, 325-332 (1991) · Zbl 0733.65039 |
| [64] | Yuan, Y., Subspace methods for large scale nonlinear equations and nonlinear least squares, Optim. Eng., 10, 207-218 (2009) · Zbl 1171.65040 |
| [65] | Yuan, GL; Wei, ZX; Lu, XW, A BFGS trust-region method for nonlinear equations, Computing, 92, 4, 317-333 (2011) · Zbl 1241.65049 |
| [66] | Yuan, G.; Zhang, M., A three term Polak-Ribiere-Polyak conjugate gradient algorithm for large-scale nonlinear equations, J. Comput. Appl. Math., 286, 186-195 (2015) · Zbl 1316.90038 |
| [67] | Zhang, JZ; Deng, NY; Chen, LH, New quasi-Newton equation and related methods for unconstrained optimization, J. Optim. Theory Appl., 102, 1, 147-157 (1999) · Zbl 0991.90135 |
| [68] | Zhang, J.; Xu, C., Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations, J. Comput. Appl. Math., 137, 2, 269-278 (2001) · Zbl 1001.65065 |
| [69] | Zhang, J.; Wang, Y., A new trust region method for nonlinear equations, Math. Methods Oper. Res., 283-298, 58 (2003) · Zbl 1043.65072 |
| [70] | Zhao, YB; Li, D., Monotonicity of fixed point and normal mappings associated with variational inequality and its application, SIAM J. Optim., 11, 962-973 (2001) · Zbl 1010.90084 |
| [71] | Zhou, W.; Shen, D., Convergence properties of an iterative method for solving symmetric non-linear equations, J. Optim. Theory Appl., 164, 1, 277-289 (2015) · Zbl 1307.90175 |
| [72] | Zhou, W.; Li, D., Limited memory bfgs method for nonlinear monotone equations, J. Comput. Math., 25, 1, 89-96 (2007) |
| [73] | Zhou, W.; Wang, F., A PRP-based residual method for large-scale monotone nonlinear equations, Appl. Math. Comput., 261, 1-7 (2015) · Zbl 1410.90208 |
| [74] | Zhou, W.; Zhang, L., A nonlinear conjugate gradient method based on the MBFGS secant condition, Optim. Methods Softw., 21, 5, 707-714 (2006) · Zbl 1112.90096 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
