×

Metamodels for mixed variables based on moving least squares. Application to the structural analysis of a rigid frame. (English) Zbl 1364.74075

Summary: Surrogate-based optimization has become a major field in engineering design, due to its capacity to handle complex systems involving expensive simulations. However, the majority of general-purpose surrogates (also called metamodels) are restricted to continuous variables, although versatile problems involve additional types of variables (discrete, integer, and even categorical to model technological options). Therefore, the main contribution of this paper consists in the development of metamodels specifically dedicated to handle mixed variables, in particular continuous and unordered categorical variables, and their comparison with state-of-the-art approaches. This task is performed in three steps: (i) considering an appropriate parametrization (integer mapping, regular simplex, dummy, effect codings) for the mixed variable design vector; (ii) defining metrics to compare pairs of design vectors; (iii) carrying out an ordinary or moving least square regression scheme based on the parametrization and metric previously defined. The proposed metamodels have been tested on six analytical benchmark test cases, and applied to the structural finite element analysis model of a rigid frame characterized by continuous and categorical variables. In particular, it is demonstrated that using a standard regular simplex representation for the nominal categorical variables usually outperforms a direct conversion of the nominal parameters to integer values, while offering an efficient and systematic way to encompass all types of variables in a common framework. It is also shown that the choice of a given variable representation has a higher impact on the results than the selected scheme (ordinary or moving least squares), or than the metric used for calculating distances between samples.

MSC:

74P10 Optimization of other properties in solid mechanics
90C59 Approximation methods and heuristics in mathematical programming

Software:

Matlab
Full Text: DOI

References:

[1] Abhishek K, Leyffer S, Linderoth JT (2010) Modeling without categorical variables: a mixed-integer nonlinear program for the optimization of thermal insulation systems. Optim Eng 11:185-212 · Zbl 1273.80009 · doi:10.1007/s11081-010-9109-z
[2] Abramson M, Audet C, Chrissis JW, Walston JG (2009) Mesh adaptive direct search algorithms for mixed variable optimization. Optim Lett 3:35-47 · Zbl 1154.90551 · doi:10.1007/s11590-008-0089-2
[3] Agresti A (1996) An introduction to categorical data analysis. Wiley, New York · Zbl 0868.62008
[4] Ahmad A, Dey L (2007) A method to compute distance between two categorical values of same attribute in unsupervised learning for categorical data set. Pattern Recognit Lett 28(1):110-118 · doi:10.1016/j.patrec.2006.06.006
[5] Aiken LS, West SG, Reno RR (1991) Multiple regression: testing and interpreting interactions. Sage, Thousand Oaks
[6] Bandler JW, Koziel S, Madsen K (2008) Editorial-surrogate modeling and space mapping for engineering optimization. Optim Eng 9:307-310 · doi:10.1007/s11081-008-9043-5
[7] Bar-Hen A, Daudin JJ (1995) Generalization of the Mahalanobis distance in the mixed case. J Multivar Anal 53:332-342 · Zbl 0820.62058 · doi:10.1006/jmva.1995.1040
[8] Boriah, S.; Chandola, V.; Kumar, V., Similarity measures for categorical data: a comparative evaluation, Atlanta, Georgia, 24-26 April
[9] Breitkopf P, Filomeno Coelho R (eds) (2010) Multidisciplinary design optimization in computational mechanics. ISTE/Wiley, Chippenham
[10] Breitkopf P, Rassineux A, Villon P (2002) An introduction to moving least squares meshfree methods. Rev Eur Éléments Finis 11(7-8):825-867 · Zbl 1120.74856 · doi:10.3166/reef.11.825-867
[11] Ferreira AJM (2009) MATLAB codes for finite element analysis: solids and structures. Solid mechanics and its applications. Springer, Berlin · Zbl 1192.74001
[12] Forrester AIJ, Keane AJ (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1-3):50-79 · doi:10.1016/j.paerosci.2008.11.001
[13] Grossmann IE (2002) Review of nonlinear mixed-integer and disjunctive programming techniques. Optim Eng 3:227-252 · Zbl 1035.90050 · doi:10.1023/A:1021039126272
[14] Hemker T (2008) Derivative free surrogate optimization for mixed-integer nonlinear black box problems in engineering. PhD thesis, Technischen Universität Darmstadt, Germany
[15] Kokkolaras M, Audet C, Dennis DE Jr (2001) Mixed variable optimization of the number and composition of heat intercepts in a thermal insulation system. Optim Eng 2:5-29 · Zbl 1078.90595 · doi:10.1023/A:1011860702585
[16] Lancaster P, Salkauskas K (1981) Surfaces generated by moving least squares methods. Math Comput 37(155):141-158 · Zbl 0469.41005 · doi:10.1090/S0025-5718-1981-0616367-1
[17] Li R, Emmerich MTM, Bäck T, Eggermont J, Dijkstra J, Reiber JHC (2009) Radial basis function neural networks for metamodeling and optimization in mixed integer spaces. Lorentz Center Optimizing Drug Design, Leiden University · Zbl 1078.90595
[18] Liao, T.; Montes de Oca, MA; Stützle, T., Tuning parameters across mixed dimensional instances: a performance scalability study of Sep-G-CMA-ES, Dublin, Ireland, 12-16 July
[19] Lindroth P (2011) Product configuration from a mathematical optimization perspective. PhD thesis, Chalmers University of Technology, Gothenburg, Sweden
[20] Mahalanobis, PC, On the generalized distance in statistics, No. 2, 49-55 (1936) · Zbl 0015.03302
[21] McCane B, Albert MH (2008) Distance functions for categorical and mixed variables. Pattern Recognit Lett 29(7):986-993 · doi:10.1016/j.patrec.2008.01.021
[22] Meckesheimer M, Barton RR, Simpson T, Limayem F, Yannou B (2001) Metamodeling of combined discrete/continuous responses. AIAA J 1950-1959 (American Institute of Aeronautics and Astronautics)
[23] Nayroles B, Touzot G, Villon P (1992) Generalizing the finite element method: diffuse approximation and diffuse elements. Comput Mech 10:307-318 · Zbl 0764.65068 · doi:10.1007/BF00364252
[24] Papadrakakis M, Lagaros ND, Plevris V (2005) Design optimization of steel structures considering uncertainties. Eng Struct 27:1408-1418 · doi:10.1016/j.engstruct.2005.04.002
[25] Park J, Sandberg IW (1991) Universal approximation using radial basis function networks. Neural Comput 3:246-257 · doi:10.1162/neco.1991.3.2.246
[26] Racine JS, Li Q (2004) Nonparametric estimation of regression functions with both categorical and continuous data. J Econom 119(1):93-130 · Zbl 1337.62062
[27] Liew RJY, Chen H, Shanmugam NE, Chen WF (2000) Improved nonlinear plastic hinge analysis of space frame structures. Eng Struct 22(10):1324-1338 · doi:10.1016/S0141-0296(99)00085-1
[28] Schuëller GI, Jensen HA (2008) Computational methods in optimization considering uncertainties—an overview. Comput Methods Appl Mech Eng 198(1):2-13 · Zbl 1194.74258 · doi:10.1016/j.cma.2008.05.004
[29] Senin N, Wallace DR, Borland N, Jakiela M (1999) Distributed modeling and optimization of mixed variable design problems. Tech rep TR 9901, MIT CADlab
[30] Sun C, Zeng J, Pan JS (2011) A modified particle swarm optimization with feasibility-based rules for mixed-variable optimization problems. Int J Innov Comput Inf Control 7(6):3081-3096
[31] Wilson DR, Martinez TR (1997) Improved heterogeneous distance functions. J Artif Intell Res 6:1-34 · Zbl 0894.68118
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.