×

Control and stopping of a diffusion process on an interval. (English) Zbl 0938.93067

Authors’ abstract: “Consider a process \(X(\cdot)= \{X(t), 0\leq t<\infty\}\) which takes values in the interval \(I= (0,1)\), satisfies a stochastic differential equation \[ dX(t)= \beta(t)dt+ \sigma(t)dW(t),\quad x(0)= x\in I \] and, when it reaches an endpoint of the interval \(I\), it is absorbed there. Suppose that the parameters \(\beta\) and \(\sigma\) are selected by a controller at each instant \(t\in[0,\infty)\) from a set depending on the current position. Assume also that the controller selects a stopping time \(\tau\) for the process and seeks to maximize \({\mathbf E}u(X(\tau))\), where \(u:[0,1]\to {\mathfrak R}\) is a continuous “reward” function. If \(\lambda:= \inf\{x\in I: u(x)= \max u\}\) and \(\rho:= \sup\{x\in I: u(x)= \max u\}\), then, to the left of \(\lambda\), it is best to maximize the mean-variance ratio \((\beta/\sigma^2)\) or to stop, and to the right of \(\rho\), it is best to minimize the ratio \((\beta/\sigma^2)\) or to stop. Between \(\lambda\) and \(\rho\), it is optimal to follow any policy that will bring the process \(X(\cdot)\) to a point of maximum for the function \(u(\cdot)\) with probability 1, and then stop”.

MSC:

93E20 Optimal stochastic control
62L15 Optimal stopping in statistics
60G40 Stopping times; optimal stopping problems; gambling theory
Full Text: DOI

References:

[1] Dy nkin, E. B. and Yushkevich, A. A. (1969). Markov Processes: Theorems and Problems. Plenum Press, New York.
[2] EL Karoui, N. (1981). Les aspects probabilistes du contr ole stochastique. Lecture Notes in Math. 876 73-238. Springer, Berlin. · Zbl 0472.60002
[3] Fakeev, A. G. (1970). Optimal stopping rules for processes with continuous parameter. Theory Probab. Appl. 15 324-331. · Zbl 0204.51805
[4] Fakeev, A. G. (1971). Optimal stopping of a Markov process. Theory Probab. Appl. 16 694-696. · Zbl 0273.60027 · doi:10.1137/1116076
[5] Feller, W. (1952). The parabolic differential equations and the associated semigroup of transformations. Ann. of Math. 55 468-519. JSTOR: · Zbl 0047.09303 · doi:10.2307/1969644
[6] Karatzas, I. and Shreve, S. E. (1991). Brownian Motion and Stochastic Calculus, 2nd ed. Springer, New York. · Zbl 0734.60060
[7] Pestien, V. C. and Sudderth, W. D. (1985). Continuous-time red-and-black: how to control a diffusion to a goal. Math. Oper. Res. 10 599-611. JSTOR: · Zbl 0596.93052 · doi:10.1287/moor.10.4.599
[8] Shiry aev, A. N. (1973). Statistical Sequential Analy sis. Amer. Math. Soc., Providence, RI.
[9] Shiry aev, A. N. (1978). Optimal Stopping Rules. Springer, New York. · Zbl 0391.60002
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.