×

Full convergence of the steepest descent method with inexact line searches. (English) Zbl 0821.90089

Summary: Several finite procedures for determining the step size of the steepest descent method for unconstrained optimization, without performing exact one-dimensional minimizations, have been considered in the literature. The convergence analysis of these methods requires that the objective function have bounded level sets and that its gradient satisfy a Lipschitz condition, in order to establish just stationarity of all cluster points. We consider two of such procedures and prove, for a convex objective, convergence of the whole sequence to a minimizer without any level set boundedness assumption and, for one of them, without any Lipschitz condition.

MSC:

90C25 Convex programming
90C30 Nonlinear programming
Full Text: DOI

References:

[1] DOI: 10.1007/BF01400920 · Zbl 0524.65045 · doi:10.1007/BF01400920
[2] Avriel M., Nonlinear Programming,Analysis and Methods (1976)
[3] Dennis J.E., Numerical Methods for Unconstrained Optimization and Nonlinear Equations (1983) · Zbl 0579.65058
[4] DOI: 10.1007/BF01071091 · doi:10.1007/BF01071091
[5] Iusem A. N. Sxaiter B. F. A proximal regularization f the steepest descent method to be published in RAIRO, Recherche Opiratéonelle
[6] Iusem A. N. Sxaiter B. F. Teboulle M. Entropy-like proximal methods In convex programming to be published in mathematic of Operations Research
[7] Minoux M., Mathmatical Programming. Theorj und Algorithms (1986)
[8] Polyak B., Introduction to Optirnization (1987)
[9] Rey Pastor J., Análisis matemático (1957)
[10] Zangwill W.I., Nonlineur Proyrtrmming: a Unified Approach (1987)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.