×

Two-stage importance sampling with mixture proposals. (English) Zbl 06276808

Summary: For importance sampling (IS), multiple proposals can be combined to address different aspects of a target distribution. There are various methods for IS with multiple proposals, including Hesterberg’s stratified IS estimator, Owen and Zhou’s regression estimator, and Tan’s maximum likelihood estimator. For the problem of efficiently allocating samples to different proposals, it is natural to use a pilot sample to select the mixture proportions before the actual sampling and estimation. However, most current discussions are in an empirical sense for such a two-stage procedure. In this article, we establish a theoretical framework of applying the two-stage procedure for various methods, including the asymptotic properties and the choice of the pilot sample size. By our simulation studies, these two-stage estimators can outperform estimators with naive choices of mixture proportions. Furthermore, while Owen and Zhou’s and Tan’s estimators are designed for estimating normalizing constants, we extend their usage and the two-stage procedure to estimating expectations and show that the improvement is still preserved in this extension.

MSC:

62-XX Statistics
Full Text: DOI

References:

[1] Battiti R., Proceedings of the International Neural Network Conference (INNC 90)-Paris-France pp 757– (1990) · doi:10.1007/978-94-009-0643-3_68
[2] Bauwens L., The Econometrics Journal 1 pp 23– (2008) · doi:10.1111/1368-423X.11003
[3] Bollerslev T., Journal of Econometrics 31 pp 307– (1986) · Zbl 0616.62119 · doi:10.1016/0304-4076(86)90063-1
[4] Chow Y., Probability Theory: Independence, Interchangeability, Martingales (2003)
[5] Cochran W., Sampling Techniques (1977)
[6] Denny M., European Journal of Physics 22 pp 403– (2001) · doi:10.1088/0143-0807/22/4/315
[7] Duffie D., The Journal of Derivatives 4 pp 7– (1997) · doi:10.3905/jod.1997.407971
[8] Dunkel J., Proceedings of the 2007 Winter Simulation Conference pp 958– (2007) · doi:10.1109/WSC.2007.4419692
[9] Durrett R., Probability: Theory and Examples (1996) · Zbl 1202.60002
[10] Engle R., Econometrica: Journal of the Econometric Society 50 pp 987– (1982) · Zbl 0491.62099 · doi:10.2307/1912773
[11] Fan S., Computer Graphics Forum (Vol. 25) pp 351– (2006)
[12] Ford E., Statistical Challenges in Modern Astronomy IV (Vol. 371) pp 189– (2007)
[13] Gelman A., Statistical Science 13 pp 163– (1998) · Zbl 0966.65004 · doi:10.1214/ss/1028905934
[14] Geweke J., Econometrica: Journal of the Econometric Society 57 pp 1317– (1989) · Zbl 0683.62068 · doi:10.2307/1913710
[15] Geyer C., The Annals of Statistics 22 pp 1993– (1994) · Zbl 0829.62029 · doi:10.1214/aos/1176325768
[16] DOI: 10.1198/jcgs.2009.07174 · doi:10.1198/jcgs.2009.07174
[17] DOI: 10.1080/01621459.1996.10476670 · doi:10.1080/01621459.1996.10476670
[18] Glasserman P., Management Science 46 pp 1349– (2000) · Zbl 1232.91348 · doi:10.1287/mnsc.46.10.1349.12274
[19] Haberman S., The Annals of Statistics 17 pp 1631– (1989) · Zbl 0699.62027 · doi:10.1214/aos/1176347385
[20] DOI: 10.1080/00401706.1995.10484303 · doi:10.1080/00401706.1995.10484303
[21] Hoogerheide L., International Journal of Forecasting 26 pp 231– (2010) · doi:10.1016/j.ijforecast.2010.01.007
[22] Jorion P., Value At Risk: The New Benchmark for Controlling Market Risk (1997)
[23] Kong A., Journal of the Royal Statistical Society, Series B 65 pp 585– (2003) · Zbl 1067.62054 · doi:10.1111/1467-9868.00404
[24] DOI: 10.1198/016214506000001202 · Zbl 1226.65002 · doi:10.1198/016214506000001202
[25] Liu J., Monte Carlo Strategies in Scientific Computing (2008) · Zbl 1132.65003
[26] DOI: 10.1080/01621459.1993.10476295 · doi:10.1080/01621459.1993.10476295
[27] DOI: 10.1080/01621459.2000.10473909 · doi:10.1080/01621459.2000.10473909
[28] DOI: 10.1080/00949659808811890 · Zbl 0961.62029 · doi:10.1080/00949659808811890
[29] Robert C., Monte Carlo Statistical Methods (2004) · Zbl 1096.62003 · doi:10.1007/978-1-4757-4145-2
[30] Rothenberg T., Handbook of Econometrics (Vol. 2) pp 881– (1984) · doi:10.1016/S1573-4412(84)02007-9
[31] Rubinstein R., Simulation and the Monte Carlo Method (2008)
[32] Smith P., IEEE Journal on Selected Areas in Communications 15 pp 597– (1997) · doi:10.1109/49.585771
[33] DOI: 10.1198/016214504000001664 · Zbl 1084.65007 · doi:10.1198/016214504000001664
[34] van der Vaart A., Asymptotic Statistics (2000) · Zbl 0910.62001
[35] van der Vaart A., Weak Convergence and Empirical Processes (1996) · Zbl 0862.60002 · doi:10.1007/978-1-4757-2545-2
[36] Veach E., Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques pp 419– (1995)
[37] West M., Journal of the Royal Statistical Society, Series B 55 pp 409– (1993)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.