×

A Monte Carlo method for estimating sensitivities of reflected diffusions in convex polyhedral domains. (English) Zbl 07213005

Summary: We develop an effective Monte Carlo method for estimating sensitivities or gradients of expectations of sufficiently smooth functionals of a reflected diffusion in a convex polyhedral domain with respect to its defining parameters, namely its initial condition, drift, and diffusion coefficients and directions of reflection. Our method, which falls into the class of infinitesimal perturbation analysis (IPA) methods, uses a probabilistic representation for such sensitivities as the expectation of a functional of the reflected diffusion and its associated derivative process. The latter process is the unique solution to a constrained linear stochastic differential equation with jumps whose coefficients, domain, and directions of reflection are modulated by the reflected diffusion. We propose a consistent estimator for such sensitivities using an Euler approximation of the reflected diffusion and its associated derivative process. Proving that the Euler approximation converges is challenging because the derivative process jumps whenever the reflected diffusion hits the boundary of the domain. A key step in the proof is establishing a continuity property of the related derivative map, which is of independent interest. We compare the performance of our IPA estimator with a standard likelihood ratio estimator (whenever the latter is applicable) and provide numerical evidence that the variance of the former is substantially smaller than that of the latter. We illustrate our method with an example of a rank-based interacting diffusion model of equity markets. Interestingly, we show that estimating certain sensitivities of the rank-based interacting diffusion model using our method for a reflected Brownian motion description of the model outperforms a finite difference method for a stochastic differential equation description of the model.

MSC:

65C05 Monte Carlo methods
60H10 Stochastic ordinary differential equations (aspects of stochastic analysis)
60J65 Brownian motion

References:

[1] Asmussen S, Glynn PW (2007) Stochastic Simulation: Algorithms and Analysis (Springer, New York).Google Scholar · Zbl 1126.65001
[2] Banner AD, Fernholz R, Karatzas I (2005) Atlas models of equity markets. Ann. Appl. Probab. 15(4):2296-2330.Google Scholar · Zbl 1099.91056
[3] Blanchet J, Murthy KRA (2018) Exact simulation of multidimensional reflected Brownian motion. J. Appl. Probab. 55(1):137-156.Google Scholar · Zbl 1401.65006
[4] Bossy M, Gobet E, Talay D (2004) Symmetrized Euler scheme for an efficient approximation of reflected diffusions. J. Appl. Probab. 4(3):877-889.Google Scholar · Zbl 1076.65009
[5] Chen H, Mandelbaum A (1991) Leontief systems, RBVs and RBMs. Davis MHA, Elliott RJ, eds. Applied Stochastic Analysis, Stochastics Monographs, vol. 5 (Gordon and Breach, New York), 1-43.Google Scholar · Zbl 0729.90021
[6] Costantini C, Pacciarotti B, Sartoretto F (1998) Numerical approximation for functionals of reflecting diffusion processes. SIAM J. Appl. Math. 58(1):73-102.Google Scholar · Zbl 0913.60031
[7] Dupuis P, Ramanan K (1999) Convex duality and the Skorokhod problem. I. Probab. Theory Related Fields 115(2):153-195.Google Scholar · Zbl 0944.60061
[8] Fernholz ER (2002) Stochastic Portfolio Theory (Springer, New York).Google Scholar · Zbl 1049.91067
[9] Glasserman P (2003) Monte Carlo Methods in Financial Engineering (Springer, New York).Google Scholar
[10] Gobet E (2001) Efficient schemes for the weak approximation of reflected diffusions. Monte Carlo Methods Appl. 7(1-2):193-202.Google Scholar · Zbl 0986.65002
[11] Harrison JM (2013) Brownian Models of Performance and Control (Cambridge University Press, Cambridge, UK).Google Scholar · Zbl 1308.60003
[12] Ichiba T, Karatzas I (2010) On collisions of Brownian particles. Ann. Appl. Probab. 20(3):951-977.Google Scholar · Zbl 1235.60111
[13] Ichiba T, Karatzas I, Shkolnikov M (2013) Strong solutions of stochastic equations with rank-based coefficients. Probab. Theory Related Fields 156(1-2):229-248.Google Scholar · Zbl 1302.60092
[14] Ichiba T, Papathanakos V, Banner A, Karatzas I, Fernholz R (2011) Hybrid atlas models. Ann. Appl. Probab. 21(2):609-644.Google Scholar · Zbl 1230.60046
[15] Kang W, Williams RJ (2007) An invariance principle for semimartingale reflecting Brownian motions in domains with piecewise smooth boundaries. Ann. Appl. Probab. 17(2):741-779.Google Scholar · Zbl 1125.60030
[16] Lépingle D (1995) Euler scheme for reflected stochastic differential equations. Math. Comput. Simulation 38(1-3):119-126.Google Scholar · Zbl 0824.60062
[17] Lipshutz D, Ramanan K (2018) On directional derivatives of Skorokhod maps in convex polyhedral domains. Ann. Appl. Probab. 28(2):688-750.Google Scholar · Zbl 1401.90232
[18] Lipshutz D, Ramanan K (2019a) Pathwise differentiability of reflected diffusions in convex polyhedral domains. Annales de l’Institut Henri Poincare Probab. Statist. Forthcoming.Google Scholar · Zbl 1466.60076
[19] Lipshutz D, Ramanan K (2019b) Sensitivity analysis of the stationary distribution of reflected Brownian motion in a convex polyhedral cone. Working paper, Technion, Haifa, Israel.Google Scholar
[20] Liu Y (1993) Numerical approches to stochastic differential equations with boundary conditions. Unpublished doctoral dissertation, Purdue University, West Lafayette, IN.Google Scholar
[21] Mandelbaum A, Pats G (1998) State-dependent stochastic networks. Part I. Approximations and applications with continuous diffusion limits. Ann. Appl. Probab. 8(2):569-646.Google Scholar · Zbl 0945.60025
[22] Milshtein GN (1995) The solving of boundary value problems by numerical integration of stochastic equations. Math. Comput. Simulation 38(1-3):77-85.Google Scholar · Zbl 0824.60059
[23] Peterson WP (1991) A heavy traffic limit theorem for networks of queues with multiple customer types. Math. Oper. Res. 16(1):90-118.Link, Google Scholar · Zbl 0727.60114
[24] Pettersson R (1995) Approximations for stochastic differential equations with reflecting convex boundaries. Stochastic Processes Appl. 59(2):295-308.Google Scholar · Zbl 0841.60042
[25] Pettersson R (1997) Penalization schemes for reflecting stochastic differential equations. Bernoulli 3(4):403-414.Google Scholar · Zbl 0899.60053
[26] Ramanan K (2006) Reflected diffusions defined via the extended Skorokhod map. Electronic J. Probab. 11(36):934-992.Google Scholar · Zbl 1111.60043
[27] Ramanan K, Reiman MI (2003) Fluid and heavy traffic diffusion limits for a generalized processor sharing model. Ann. Appl. Probab. 13(1):100-139.Google Scholar · Zbl 1016.60083
[28] Ramanan K, Reiman MI (2008) The heavy traffic limit of an unbalanced generalized processor sharing model. Ann. Appl. Probab. 18(1):22-58.Google Scholar · Zbl 1144.60056
[29] Reiman MI (1984) Open queueing networks in heavy traffic. Math. Oper. Res. 9(3):441-458.Link, Google Scholar · Zbl 0549.90043
[30] Reiman MI, Williams RJ (1988) A boundary property of semimartingale reflecting Brownian motions. Probab. Theory Related Fields 77(1):87-97.Google Scholar · Zbl 0617.60081
[31] Rogers LCG, Williams D (2000) Diffusions, Markov Processes and Martingales. Volume 2: Itô Calculus, 2nd ed. (Cambridge University Press, Cambridge, UK).Google Scholar · Zbl 0949.60003
[32] Słomínski L (1994) On approximation of solutions of multidimensional SDE’s with reflecting boundary conditions. Stochastic Processes Appl. 50(2):197-219.Google Scholar · Zbl 0799.60055
[33] Słomínski L (2001) Euler’s approximations of solutions of SDEs with reflecting boundary. Stochastic Processes Appl. 94(2):317-337.Google Scholar · Zbl 1053.60062
[34] Ward A, Glynn PW (2003) A diffusion approximation for a Markovian queue with reneging. Queueing Systems 43(1-2):103-128.Google Scholar · Zbl 1054.60100
[35] Whitt W (2002) An Introduction to Stochastic-Process Limits and Their Applications to Queues. Internet Supplement. Accessed April 30, 2019, http://www.columbia.edu/∼ww2040/supplement.html.Google Scholar · Zbl 0993.60001
[36] Yan L (2002) The Euler scheme with irregular coefficients. Ann. Probab. 30(3):1172-1194.Google Scholar · Zbl 1020.60054
[37] Yang J, · Zbl 0742.93084
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.