×

A multistart gradient-based algorithm with surrogate model for global optimization. (English) Zbl 1329.90110

Summary: Gradient-based optimization algorithms are probably the most efficient option for the solution of a local optimization problem. These methods are intrinsically limited in the search of a local optimum of the objective function: if a global optimum is searched, the application of local optimization algorithms can be still successful if the algorithm is initialized starting from a large number of different points in the design space (multistart algorithms). As a counterpart, the cost of the exploration is further increased, linearly with the number of adopted starting points. Consequently, the use of a multistart local optimization algorithm is rarely adopted, mainly for two reasons: i) the large computational cost and ii) the absence of a guarantee about the success of the search (in fact, there is not a general indication about the minimum number of starting points able to guarantee the success of global optimization).
In this paper, techniques for reducing the computational cost of the full process together with some techniques able to maximize the efficiency of a parallel multistart search are described and tested. An extensive use of surrogate models is applied in order to drastically reduce the computational effort in practical applications, where the computational cost of a single objective function evaluation is high. Declustering techniques are also adopted in order to exploit at best the different local searches.

MSC:

90C26 Nonconvex programming, global optimization
90C52 Methods of reduced gradient type