Least-squares forecast averaging. (English) Zbl 1429.62421
Summary: This paper proposes forecast combination based on the method of Mallows Model Averaging (MMA). The method selects forecast weights by minimizing a Mallows criterion. This criterion is an asymptotically unbiased estimate of both the in-sample mean-squared error (MSE) and the out-of-sample one-step-ahead mean-squared forecast error (MSFE). Furthermore, the MMA weights are asymptotically mean-square optimal in the absence of time-series dependence. We show how to compute MMA weights in forecasting settings, and investigate the performance of the method in simple but illustrative simulation environments. We find that the MMA forecasts have low MSFE and have much lower maximum regret than other feasible forecasting methods, including equal weighting, BIC selection, weighted BIC, AIC selection, weighted AIC, Bates-Granger combination, predictive least squares, and Granger-Ramanathan combination.
MSC:
| 62M20 | Inference from stochastic processes and prediction |
| 62M10 | Time series, auto-correlation, regression, etc. in statistics (GARCH) |
References:
| [1] | Akaike, H., 1973. Information theory and an extension of the maximum likelihood principle. In: Petroc, B., Csake, F. (Eds.), Second International Symposium on Information Theory; Akaike, H., 1973. Information theory and an extension of the maximum likelihood principle. In: Petroc, B., Csake, F. (Eds.), Second International Symposium on Information Theory · Zbl 0283.62006 |
| [2] | Akaike, H., A Bayesian extension of the minimum AIC procedure of autoregressive model fitting, Biometrika, 66, 237-242 (1979) · Zbl 0407.62064 |
| [3] | Avramov, D., Stock return predictability and model uncertainty, Journal of Finance, 64, 423-458 (2002) |
| [4] | Banasali, R. J., Asymptotically efficient autoregressive model selection for multistep prediction, Annals of the Institute of Statistical Mathematics, 48, 577-602 (1996) · Zbl 0926.62086 |
| [5] | Bates, J. M.; Granger, C. M.W., The combination of forecasts, Operations Research Quarterly, 20, 451-468 (1969) |
| [6] | Brock, William; Durlauf, Stephen, Growth empirics and reality, World Bank Economic Review, 15, 229-272 (2001) |
| [7] | Brock, William; Durlauf, Stephen; West, Kenneth D., Policy analysis in uncertain economic environments, Brookings Papers on Economic Activity, 1, 235-322 (2003) |
| [8] | Buckland, S. T.; Burnhamn, K. P.; Augustin, N. H., Model selection: An integral part of inference, Biometrics, 53, 603-618 (1997) · Zbl 0885.62118 |
| [9] | Burnham, Kenneth P.; Anderson, David R., Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach (2002), Springer: Springer New York · Zbl 1005.62007 |
| [10] | Clemen, R. T., Combining forecasts: A review and annotated bibliography, International Journal of Forecasting, 5, 559-581 (1989) |
| [11] | Diebold, F. X.; Lopez, J. A., Forecast evaluation and combination, (Maddala; Rao, Handbook of Statistics (1996), Elsevier: Elsevier Amsterdam) |
| [12] | Fernandez; Ley, C. E.; Steel, M. F.J., Benchmark priors for Bayesian model averaging, Journal of Econometrics, 100, 381-427 (2001) · Zbl 1091.62507 |
| [13] | Fernandez; Ley, C. E.; Steel, M. F.J., Model uncertainty in cross-country growth regressions, Journal of Applied Econometrics, 16, 563-576 (2001) |
| [14] | Garratt, A.; Lee, K.; Pesaran, M. H.; Shin, Y., Forecasting uncertainties in macroeconomic modelling: An application to the UK economy, Journal of the American Statistical Association, 98, 829-838 (2003) |
| [15] | Granger, C. W.J., Combining Forecasts—Twenty years later, Journal of Forecasting, 8, 167-173 (1989) |
| [16] | Granger, C. W.J.; Ramanathan, R., Improved methods of combining forecast accuracy, Journal of Forecasting, 19, 197-204 (1984) |
| [17] | Hansen, Bruce E., Least squares model averaging, Econometrica, 75, 1175-1189 (2007) · Zbl 1133.91051 |
| [18] | Hendry, D. F.; Clements, M. P., Pooling of forecasts, Econometrics Journal, 5, 1-26 (2002) · Zbl 1053.62104 |
| [19] | Hjort, Nils Lid; Claeskens, Gerda, Frequentist model average estimators, Journal of the American Statistical Association, 98, 879-899 (2003) · Zbl 1047.62003 |
| [20] | Hoeting, Jennifer A.; Madigan, David; Raftery, Adrian E.; Volinsky, Chris T., Bayesian model averaging: A tutorial, Statistical Science, 14, 382-417 (1999) · Zbl 1059.62525 |
| [21] | Ing, Ching-Kang, Multistep prediction in autoregressive processes, Econometric Theory, 19, 254-279 (2003) · Zbl 1441.62747 |
| [22] | Ing, Ching-Kang, Selecting optimal multistep predictors for autoregressive processes of unknown order, Annals of Statistics, 32, 693-722 (2004) · Zbl 1048.62088 |
| [23] | Ing, Ching-Kang, Accumulated prediction errors, information criteria and optimal forecasting for autoregressive time series, Annals of Statistics, 35, 1238-1277 (2007) · Zbl 1118.62097 |
| [24] | Ing, Ching-Kang; Wei, Ching-Zong, On same-realization prediction in an infinite-order autoregressive process, Journal of Multivariate Analysis, 85, 130-155 (2003) · Zbl 1038.62086 |
| [25] | Ing, Ching-Kang; Wei, Ching-Zong, Order selection for same-realization predictions in autoregressive processes, Annals of Statistics, 33, 2423-2474 (2005) · Zbl 1086.62105 |
| [26] | Lee, Sangyeol; Karagrigoriou, Alex, An asymptotically optimal selection of the order of a linear process, Sankhya Series A, 63, 93-106 (2001) · Zbl 1004.62068 |
| [27] | Li, Ker-Chau, Asymptotic optimality for \(C_p, C_L\), cross-validation and generalized cross-validation: Discrete Index Set, Annals of Statistics, 15, 958-975 (1987) · Zbl 0653.62037 |
| [28] | Mallows, C. L., Some comments on \(C_p\), Technometrics, 15, 661-675 (1973) · Zbl 0269.62061 |
| [29] | Min, C.-K.; Zellner, A., Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates, Journal of Econometrics, 56, 89-118 (1993) · Zbl 0800.62800 |
| [30] | Rissanen, J., Order estimation by accumulated prediction errors, Journal of Applied Probability, 23A, 55-61 (1986) · Zbl 0579.62078 |
| [31] | Sala-i-Martin, Xavier; Doppelhofer, Gernot; Miller, Ronald I., Determinants of long-term growth: A Bayesian averaging of classical estimates (BACE) approach, American Economic Review, 94, 813-835 (2004) |
| [32] | Schwarz, G., Estimating the dimension of a model, Annals of Statistics, 6, 461-464 (1978) · Zbl 0379.62005 |
| [33] | Shibata, Ritaei, Asymptotically efficient selection of the order of the model for estimating parameters of a linear process, Annals of Statistics, 8, 147-164 (1980) · Zbl 0425.62069 |
| [34] | Shibata, Ritaei, An optimal selection of regression variables, Biometrika, 68, 45-54 (1981) · Zbl 0464.62054 |
| [35] | Shibata, Ritaei, Asymptotic mean efficiency of a selection of regression variables, Annals of the Institute of Statistical Mathematics, 35, 415-423 (1983) · Zbl 0563.62043 |
| [36] | Stock, J. H.; Watson, M. W., A comparison of linear and nonlinear univariate models for forecasting macroeconomic time series, (Engle, R.; White, H., Cointegration, Causality and Forecasting: A Festschrift for Clive W.J. Granger (1999), Oxford University Press) |
| [37] | Stock, J. H.; Watson, M. W., Combination forecasts of output growth in a seven-country data set, Journal of Forecasting, 23, 405-430 (2004) |
| [38] | Stock, J.H., Watson, M.W., 2005. An empirical comparison of methods for forecasting using many predictors. Working paper, NBER; Stock, J.H., Watson, M.W., 2005. An empirical comparison of methods for forecasting using many predictors. Working paper, NBER |
| [39] | Stock, J. H.; Watson, M. W., Forecasting with many predictors, (Elliott, G.; Granger, C. W.J.; Timmermann, A., Handbook of Economic Forecasting, vol. 1 (2006), Elsevier: Elsevier Amsterdam), 515-554 |
| [40] | Timmermann, Allan, Forecast combinations, (Elliott, G.; Granger, C. W.J.; Timmermann, A., Handbook of Economic Forecasting, vol. 1 (2006), Elsevier: Elsevier Amsterdam), 135-196 · Zbl 1273.91014 |
| [41] | Whittle, P., Bounds for the moments of linear and quadratic forms in independent variables, Theory of Probability and Its Applications, 5, 302-305 (1960) · Zbl 0101.12003 |
| [42] | Wright, Jonathan H., 2003a. Bayesian model averaging and exchange rate forecasting. Federal Reserve Board International Finance Discussion Papers, 779; Wright, Jonathan H., 2003a. Bayesian model averaging and exchange rate forecasting. Federal Reserve Board International Finance Discussion Papers, 779 |
| [43] | Wright, Jonathan H., 2003b. Forecasting US Inflation by Bayesian Model Averaging. Federal Reserve Board International Finance Discussion Papers, 780; Wright, Jonathan H., 2003b. Forecasting US Inflation by Bayesian Model Averaging. Federal Reserve Board International Finance Discussion Papers, 780 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
