×

Distributionally robust optimization for engineering design under uncertainty. (English) Zbl 07864304

Summary: This paper addresses the challenge of design optimization under uncertainty when the designer only has limited data to characterize uncertain variables. We demonstrate that the error incurred when estimating a probability distribution from limited data affects the out-of-sample performance (ie, performance under the true distribution) of optimized designs. We demonstrate how this can be mitigated by reformulating the engineering design problem as a distributionally robust optimization (DRO) problem. We present computationally efficient algorithms for solving the resulting DRO problem. The performance of the DRO approach is explored in a practical setting by applying it to an acoustic horn design problem. The DRO approach is compared against traditional approaches to optimization under uncertainty, namely, sample-average approximation and multiobjective optimization incorporating a risk reduction objective. In contrast with the multiobjective approach, the proposed DRO approach does not use an explicit risk reduction objective but rather specifies a so-called ambiguity set of possible distributions and optimizes against the worst-case distribution in this set. Our results show that the DRO designs, in some cases, significantly outperform those designs found using the sample-average or the multiobjective approach.
{© 2019 John Wiley & Sons, Ltd.}

MSC:

90Cxx Mathematical programming
74Pxx Optimization problems in solid mechanics
90Bxx Operations research and management science
Full Text: DOI

References:

[1] KennedyMC, O’HaganA. Bayesian calibration of computer models. J Royal Stat Soc Ser B Stat Methodol. 2001;63(3):425‐464. · Zbl 1007.62021
[2] BeyerH‐G, SendhoffB. Robust optimization—a comprehensive survey. Comput Methods Appl Mech Eng. 2007;196(33‐34):3190‐3218. · Zbl 1173.74376
[3] DuX, ChenW. Efficient uncertainty analysis methods for multidisciplinary robust design. AIAA Journal. 2002;40(3):545‐581.
[4] DuX, ChenW. Methodology for managing the effect of uncertainty in simulation‐based design. AIAA Journal. 2000;38(8):1471‐1478.
[5] KeaneAJ, NairPB. Computational Approaches for Aerospace Design: The Pursuit of Excellence. Hoboken, NJ: John Wiley & Sons; 2005.
[6] HeltonJC, JohnsonJD, OberkampfWL. An exploration of alternative approaches to the representation of uncertainty in model predictions. Reliab Eng Syst Saf. 2004;85(1‐3):39‐71.
[7] RaoSS, CaoL. Optimum design of mechanical systems involving interval parameters. J Mech Des. 2002;124(3):465‐472.
[8] Ben‐TalA, El GhaouiL, NemirovskiA. Robust Optimization. Princeton, NJ: Princeton University Press; 2009. · Zbl 1221.90001
[9] ZamanK, RangavajhalaS, McDonaldMP, MahadevanS. A probabilistic approach for representation of interval uncertainty. Reliab Eng Syst Saf. 2011;96(1):117‐130.
[10] SmetsP. Probability, possibility, belief: Which and where? In: Quantified Representation of Uncertainty and Imprecision. Dordrecht, The Netherlands: Springer; 1998:1‐24. · Zbl 0924.68183
[11] GohJ, SimM. Distributionally robust optimization and its tractable approximations. Operations Research. 2010;58(4‐part‐1):902‐917. · Zbl 1228.90067
[12] DelageE, YeY. Distributionally robust optimization under moment uncertainty with application to data‐driven problems. Operations Research. 2010;58(3):595‐612. · Zbl 1228.90064
[13] WiesemannW, KuhnD, SimM. Distributionally robust convex optimization. Operations Research. 2014;62(6):1358‐1376. · Zbl 1327.90158
[14] Ben‐TalA, den HertogD, De WaegenaereA, MelenbergB, RennenG. Robust solutions of optimization problems affected by uncertain probabilities. Management Science. 2013;59(2):341‐357.
[15] Van ParysBP, EsfahaniPM, KuhnD. From data to decisions: distributionally robust optimization is optimal. arXiv preprint arXiv:1704.04118. 2017.
[16] HuZ, HongLJ. Kullback‐Leibler divergence constrained distributionally robust optimization. Optimization Online. 2013.
[17] CalafioreGC. Ambiguous risk measures and optimal robust portfolios. SIAM J Optim. 2007;18(3):853‐877. · Zbl 1154.91022
[18] BertsimasD, GuptaV, KallusN. Robust sample average approximation. Mathematical Programming. 2018;171(1‐2):217‐282. · Zbl 1432.90168
[19] GotohJ‐Y, KimMJ, LimAEB. Robust empirical optimization is almost the same as mean-variance optimization. Oper Res Lett. 2018;46:448‐452. · Zbl 1525.90300
[20] EsfahaniPM, KuhnD. Data‐driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations. arXiv preprint arXiv:1505.05116. 2015.
[21] KleywegtAJ, ShapiroA, Homem‐de‐MelloT. The sample average approximation method for stochastic discrete optimization. SIAM J Optim. 2002;12(2):479‐502. · Zbl 0991.90090
[22] MathWorks. Matlab optimization toolbox. Version 7.6, MATLAB 2017a. Natick, MA; MathWorks; 2017.
[23] XuH, CaramanisC, MannorS. A distributional interpretation of robust optimization. Math Oper Res. 2012;37(1):95‐110. · Zbl 1243.90167
[24] PhilpottAB, deMatosVL, KapelevichL. Distributionally robust SDDP. Comput Manag Sci. 2017:1‐24.
[25] GrantM, BoydS. CVX: Matlab software for disciplined convex programming, version 2.1. 2014. https://cvxr.com/cvx
[26] GrantMC, BoydSP. Graph implementations for nonsmooth convex programs. In: Blondel VD (ed.), Boyd SP (ed.), Kimura H (ed.), eds. Recent Advances in Learning and Control. London, UK: Springer‐Verlag; 2008:95‐110. Lecture Notes in Control and Information Sciences. https://stanford.edu/ boyd/graph_dcp.html · Zbl 1205.90223
[27] FilippiS, CappéO, GarivierA. Optimism in reinforcement learning and Kullback‐Leibler divergence. In: Proceedings of the 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton); 2010; Allerton, IL.
[28] PflugG, WozabalD. Ambiguity in portfolio selection. Quantitative Finance. 2007;7(4):435‐442. · Zbl 1190.91138
[29] Shafieezadeh‐AbadehS, EsfahaniPM, KuhnD. Distributionally robust logistic regression. In: Proceedings of the Advances in Neural Information Processing Systems NIPS; 2015; Montreal, Canada.
[30] GaoR, KleywegtAJ. Distributionally robust stochastic optimization with Wasserstein distance. arXiv preprint arXiv:1604.02199. 2016.
[31] CopasJB. Regression, prediction and shrinkage. J Royal Stat Soc Ser B Methodol. 1983;45(3):311‐335. · Zbl 0532.62048
[32] NgLWT, WillcoxKE. Multifidelity approaches for optimization under uncertainty. Int J Numer Methods Eng. 2014;100(10):746‐772. · Zbl 1352.74230
[33] EftangJL, HuynhDBP, KnezevicDJ, PateraAT. A two‐step certified reduced basis method. J Sci Comput. 2012;51(1):28‐58. · Zbl 1244.65172
[34] UdawalpolaR, BerggrenM. Optimization of an acoustic horn with respect to efficiency and directivity. Int J Numer Methods Eng. 2008;73(11):1571‐1606. · Zbl 1159.76043
[35] NgLW‐T, HuynhDBP, WillcoxK. Multifidelity uncertainty propagation for optimization under uncertainty. In: Proceedings of the 12th AIAA Aviation Technology, Integration, and Operations (ATIO) Conference and 14Th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference AIAA; 2012; Indiana, IN.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.