×

Parameter estimation: the proper way to use Bayesian posterior processes with Brownian noise. (English) Zbl 1314.62190

Summary: This paper studies a problem of Bayesian parameter estimation for a sequence of scaled counting processes whose weak limit is a Brownian motion with an unknown drift. The main result of the paper is that the limit of the posterior distribution processes is, in general, not equal to the posterior distribution process of the mentioned Brownian motion with the unknown drift. Instead, it is equal to the posterior distribution process associated with a Brownian motion with the same unknown drift and a different standard deviation coefficient. The difference between the two standard deviation coefficients can be arbitrarily large. The characterization of the limit of the posterior distribution processes is then applied to a family of stopping time problems. We show that the proper way to find asymptotically optimal solutions to stopping time problems, with respect to the scaled counting processes, is by looking at the limit of the posterior distribution processes rather than by the naive approach of looking at the limit of the scaled counting processes themselves. The difference between the performances can be arbitrarily large.

MSC:

62L12 Sequential estimation
60J65 Brownian motion

References:

[1] Bayraktar E, Dayanik S, Karatzas I (2006) Adaptive Poisson disorder problem. Ann. Appl. Probab. 16:1190-1261. CrossRef · Zbl 1104.62093
[2] Bergemann D, Välimäki J (1997) Market diffusion with two-sided learning. RAND J. Econom. 28:773-795. CrossRef
[3] Berry DA, Fristedt B (1985) Bandit Problems: Sequential Allocation of Experiments (Chapman and Hall, New York). CrossRef · Zbl 0659.62086
[4] Billingsley P (1999) Convergence of Probability Measures, 2nd ed. (John Wiley & Sons, New York). CrossRef · Zbl 0944.60003
[5] Bolton P, Harris C (1999) Strategic experimentation. Econometrica 67:349-374. CrossRef · Zbl 1023.91500
[6] Buonaguidi B, Muliere P (2013) Sequential testing problems for Lévy processes. Sequential Anal. 32:47-70. CrossRef · Zbl 1261.62075
[7] Chen H, Yao DD (2001) Fundamentals of Queuing Networks: Performance, Asymptotics, and Optimization (Springer, Berlin). CrossRef
[8] Cohen A, Solan E (2013) Bandit problems with Lévy processes. Math. Oper. Res. 38(1):92-107. Abstract · Zbl 1304.60048
[9] Dayanik S (2010) Wiener disorder problem with observations at fixed discrete time epochs. Math. Oper. Res. 35(4):756-785. Abstract · Zbl 1238.60047
[10] Felli L, Harris C (1996) Learning, wage dynamics and firm-specific human capital. J. Political Econom. 104:838-868. CrossRef
[11] Gapeev PV (2005) The disorder problem for compound Poisson processes with exponential jumps. Ann. Appl. Probab. 15:487-499. CrossRef · Zbl 1068.60062
[12] Gapeev PV, Peskir G (2004) The Wiener sequential testing problem with finite horizon. Stochastics Stochastic Rep. 76:59-75. CrossRef · Zbl 1054.62087
[13] Gapeev PV, Peskir G (2006) The Wiener disorder problem with finite horizon. Stochastic Processes Their Appl. 116(12):1770-1791. CrossRef · Zbl 1105.60027
[14] Gapeev PV, Shiryaev AN (2011) On the sequential testing problem for some diffusion processes. Stochastics: Internat. J. Probab. Stochastic Processes 83:519-535. CrossRef · Zbl 1228.62098
[15] Jacod J, Shiryaev AN (1987) Limit Theorems for Stochastic Processes (Springer, Berlin). CrossRef
[16] Jovanovic B (1979) Job matching and the theory of turnover. J. Political Econom. 87:972-990. CrossRef
[17] Kalman RE, Bucy RS (1961) New results in linear filtering and prediction theory. J. Basic Engrg. 83:95-108. CrossRef
[18] Karatzas IA, Shreve SE (1991) Brownian Motion and Stochastic Calculus, 2nd ed. (Springer, New York).
[19] Keller G, Rady S (1999) Optimal experimentation in a changing environment. Rev. Econom. Stud. 66:475-507. CrossRef · Zbl 0946.91049
[20] Moscarini G (2005) Job matching and the wage distribution. Econometrica 73:481-516. CrossRef · Zbl 1145.91364
[21] Peskir G, Shiryaev AN (2002) Solving the Poisson disorder problem. Sandmann K, Schönbucher P, eds. Advances in Finance and Stochastics. Essays in Honour of Dieter Sondermann (Springer, Berlin), 295-312. CrossRef · Zbl 1009.60033
[22] Polson NG, Roberts GO (1994) Bayes factors for discrete observations from diffusion processes. Biometrica 11:11-26. CrossRef · Zbl 0815.62069
[23] Sezer SO (2010) On the Wiener disorder problem. Ann. Appl. Probab. 20(4):1537-1566. CrossRef · Zbl 1203.62136
[24] Shiryaev AN (1978) Optimal Stopping Rules (Springer, Berlin).
[25] Vellekoop MH, Clark JMC (2001) Optimal speed of detection in generalized Wiener disorder problems. Stochastic Processes Their Appl. 95(1):25-54. CrossRef · Zbl 1059.60055
[26] Whitt W (2006) Staffing a call center with uncertain arrival rate and absenteeism. Production Oper. Management 15(1):88-102.
[27] Zakai M (1969) On the optimal filtering of diffusion processes. Z. Wahrsch. Verw. Gebiete 11:230-243. CrossRef · Zbl 0164.19201
[28] Zhitlukhin MV, Shiryaev AN (2011) A Bayesian sequential testing problem of three hypotheses for Brownian motion. Statist. Risk Model. 28:227-249. CrossRef · Zbl 1228.62101
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.