×

On the comparison of initialisation strategies in differential evolution for large scale optimisation. (English) Zbl 1391.90412

Summary: Differential evolution (DE) has shown to be a promising global optimisation solver for continuous problems, even for those with a large dimensionality. Different previous works have studied the effects that a population initialisation strategy has on the performance of DE when solving large scale continuous problems, and several contradictions have appeared with respect to the benefits that a particular initialisation scheme might provide. Some works have claimed that by applying a particular approach to a given problem, the performance of DE is going to be better than using others. In other cases however, researchers have stated that the overall performance of DE is not going to be affected by the use of a particular initialisation method. In this work, we study a wide range of well-known initialisation techniques for DE. Taking into account the best and worst results, statistically significant differences among considered initialisation strategies appeared. Thus, with the aim of increasing the probability of appearance of high-quality results and/or reducing the probability of appearance of low-quality ones, a suitable initialisation strategy, which depends on the large scale problem being solved, should be selected.

MSC:

90C06 Large-scale problems in mathematical programming
90C59 Approximation methods and heuristics in mathematical programming

References:

[1] Bratley, P., Fox, B.L.: Algorithm 659: implementing sobol’s quasirandom sequence generator. ACM Trans. Math. Softw. 14(1), 88-100 (1988) · Zbl 0642.65003 · doi:10.1145/42288.214372
[2] Das, S., Mullick, S.S., Suganthan, P.: Recent advances in differential evolution—-an updated survey. Swarm Evolut. Comput. 27, 1-30 (2016)
[3] Dong, N., Wu, C.H., Ip, W.H., Chen, Z.Q., Chan, C.Y., Yung, K.L.: An opposition-based chaotic GA/PSO hybrid algorithm and its application in circle detection. Comput. Math. Appl. 64(6), 1886-1902 (2012) · Zbl 1268.90142 · doi:10.1016/j.camwa.2012.03.040
[4] Ergezer, M., Simon, D.: Mathematical and experimental analyses of oppositional algorithms. IEEE Trans. Cybern. 44(11), 2178-2189 (2014) · doi:10.1109/TCYB.2014.2303117
[5] Kazimipour, B., Li, X., Qin, A.: Effects of population initialization on differential evolution for large scale optimization. In: 2014 IEEE Congress on Evolutionary Computation (CEC), pp. 2404-2411 (2014). doi:10.1109/CEC.2014.6900624
[6] Kazimipour, B., Li, X., Qin, A.K.: Initialization methods for large scale global optimization. In: 2013 IEEE Congress on Evolutionary Computation (CEC), pp. 2750-2757 (2013). doi:10.1109/CEC.2013.6557902 · Zbl 0917.65005
[7] León, C., Miranda, G., Segura, C.: METCO: a parallel plugin-based framework for multi-objective optimization. Int. J. Artif. Intell. Tools 18(4), 569-588 (2009) · doi:10.1142/S0218213009000275
[8] Li, X., Tang, K., Omidvar, M., Yang, Z., Qin, K.: Benchmark functions for the CEC’2013 special session and competition on large scale global optimization. Technical report, Evolutionary Computation and Machine Learning Group, RMIT University, Australia, (2013) · Zbl 0642.65003
[9] Matsumoto, M., Nishimura, T.: Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Model. Comput. Simul. 8(1), 3-30 (1998) · Zbl 0917.65005 · doi:10.1145/272991.272995
[10] Qin, A., Li, X.: Differential evolution on the CEC-2013 single-objective continuous optimization testbed. In: 2013 IEEE Congress on Evolutionary Computation (CEC), pp. 1099-1106 (2013). doi:10.1109/CEC.2013.6557689 · Zbl 0917.65005
[11] Rajashekharan, L., Shunmuga Velayutham, C.: Is Differential Evolution Sensitive to Pseudo Random Number Generator Quality?—An Investigation. In: Berretti, S., Thampi, S. M., Srivastava., Praveen Ranjan (eds) Intelligent systems technologies and applications: vol 1, pp. 305-313. Springer International Publishing, Cham (2016)
[12] Sayed, E., Essam, D., Sarker, R., Elsayed, S.: Decomposition-based evolutionary algorithm for large scale constrained problems. Inf. Sci. 316, 457-486 (2015) · doi:10.1016/j.ins.2014.10.035
[13] Segura, C., Coello, C.A.C., Hernández-Díaz, A.G.: Improving the vector generation strategy of differential evolution for large-scale optimization. Inf. Sci. 323, 106-129 (2015) · doi:10.1016/j.ins.2015.06.029
[14] Segura, C., Coello, C.A.C., Segredo, E., Aguirre, A.H.: A novel diversity-based replacement strategy for evolutionary algorithms. IEEE Trans. Cybern. 46(12), 3233-3246 (2015)
[15] Skanderova, L., Řehoř, A.: Comparison of Pseudorandom Numbers Generators and Chaotic Numbers Generators used in Differential Evolution. In: Zelinka, I., Suganthan, Ponnuthurai, N., Chen, G., Snasel, V., Abraham, A., Rössler, O (eds) Nostradamus 2014: prediction, modeling and analysis of complex systems, pp. 111-121. Springer International Publishing, Cham (2014) · Zbl 1317.65139
[16] Sloan, I.H.: Lattice methods for multiple integration. J. Comput. Appl. Math. 12, 131-143 (1985) · Zbl 0597.65014 · doi:10.1016/0377-0427(85)90012-3
[17] Storn, R., Price, K.: Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J. of Glob. Optim. 11(4), 341-359 (1997) · Zbl 0888.90135 · doi:10.1023/A:1008202821328
[18] Xu, Q., Wang, L., Wang, N., Hei, X., Zhao, L.: A review of opposition-based learning from 2005 to 2012. Eng. Appl. Artif. Intell. 29, 1-12 (2014) · doi:10.1016/j.engappai.2013.12.004
[19] Zhao, S.Z., Suganthan, P.N.: Empirical investigations into the exponential crossover of differential evolutions. Swarm Evolut. Comput. 9, 27-36 (2013) · doi:10.1016/j.swevo.2012.09.004
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.