Structural combination of seasonal exponential smoothing forecasts applied to load forecasting. (English) Zbl 1430.62211
Summary: This article draws from research on ensembles in computational intelligence to propose structural combinations of forecasts, which are point forecast combinations that are based on information from the parameters of the individual models that generated the forecasts. Two types of structural combination are proposed which use seasonal exponential smoothing as base models, and are applied to forecast short-term electricity demand. Although forecasting performance may depend on how ensembles are generated, results show that the proposed combinations can outperform competitive benchmarks. The methods can be used to forecast other seasonal data and be extended to different types of forecasting models.
MSC:
| 62M20 | Inference from stochastic processes and prediction |
| 62P20 | Applications of statistics to economics |
| 91B84 | Economic time series analysis |
Keywords:
forecasting; combination of forecasts; electricity demand/load forecasting; ensembles; exponential smoothing methodsReferences:
| [1] | Armstrong, J. S., Principles of forecasting: a handbook for researchers and practitioners, 30 (2001), Springer |
| [2] | Arora, S., Time series forecasting with applications in macroeconomics and energy (2013), Somerville College, University of Oxford, Ph.D. thesis |
| [3] | Bakker, B.; Heskes, T., Clustering ensembles of neural network models, Neural Networks: The Official Journal of the International Neural Network Society, 16, 2, 261-269 (2003) |
| [4] | Barak, S.; Sadegh, S. S., Forecasting energy consumption using ensemble arimaanfis hybrid algorithm, International Journal of Electrical Power & Energy Systems, 82, Supplement C, 92-104 (2016) |
| [5] | Bates, J. M.; Granger, C. W., The combination of forecasts, Journal of the Operational Research Society, 20, 4, 451-468 (1969) |
| [6] | Bergmeir, C.; Hyndman, R.; Bentez, J., Bagging exponential smoothing methods using STL decomposition and Box-Cox transformation, International Journal of Forecasting, 32, 2, 303-312 (2016) |
| [7] | Brown, W. M.; Gedeon, T. D.; Groves, D. I., Use of noise to augment training data: a neural network method of mineral-potential mapping in regions of limited known deposit examples, Natural Resources Research, 12, 2, 141-152 (2003) |
| [8] | Catania, L. (2014). Mcsprocedure. URL: https://www.rdocumentation.org/packages/MCS/versions/0.1.3/topics/MCSprocedure; Catania, L. (2014). Mcsprocedure. URL: https://www.rdocumentation.org/packages/MCS/versions/0.1.3/topics/MCSprocedure |
| [9] | Chan, C. K.; Kingsman, B. G.; Wong, H., Determining when to update the weights in combined forecasts for product demandan application of the cusum technique, European Journal of Operational Research, 153, 3, 757-768 (2004) · Zbl 1099.90535 |
| [10] | Che, J., Optimal sub-models selection algorithm for combination forecasting model, Neurocomputing, 151, P1, 364-375 (2015) |
| [11] | Clemen, R. T., Combining forecasts: A review and annotated bibliography, International Journal of Forecasting, 5, 4, 559-583 (1989) |
| [12] | Clements, M. P.; Harvey, D. I., Forecast encompassing tests and probability forecasts, Journal of Applied Econometrics, 25, 6, 1028-1062 (2010) |
| [13] | Crone, S. F.; Hibon, M.; Nikolopoulos, K., Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction, International Journal of Forecasting, 27, 3, 635-660 (2011) |
| [14] | De Livera, A. M.; Hyndman, R. J.; Snyder, R. D., Forecasting time series with complex seasonal patterns using exponential smoothing, Journal of the American Statistical Association, 106, 496, 1513-1527 (2011) · Zbl 1234.62123 |
| [15] | De Menezes, L.; Bunn, D., The persistence of specification problems in the distribution of combined forecast errors, International Journal of Forecasting, 14, 3, 415-426 (1998) |
| [16] | De Menezes, L.; Bunn, D. W.; Taylor, J. W., Review of guidelines for the use of combined forecasts, European Journal of Operational Research, 120, 1, 190-204 (2000) · Zbl 0962.91531 |
| [17] | Deutsch, M.; Granger, C. W.; Teräsvirta, T., The combination of forecasts using changing weights, International Journal of Forecasting, 10, 1, 47-57 (1994) |
| [18] | Donaldson, R. G.; Kamstra, M., Forecast combining with neural networks, Journal of Forecasting, 15, 1, 49-61 (1996) |
| [19] | Fiordaliso, a., A nonlinear forecasts combination method based on Takagi-Sugeno fuzzy systems, International Journal of Forecasting, 14, 3, 367-379 (1998) |
| [20] | Friedman, J. H., Multivariate adaptive regression splines, The Annals of Statistics, 19, 1, 1-67 (1991) · Zbl 0765.62064 |
| [21] | Garson, G. D., Interpreting neural-network connection weights, AI Expert, 6, 4, 46-51 (1991) |
| [22] | Goh, A., Back-propagation neural networks for modeling complex systems, Artificial Intelligence in Engineering, 9, 3, 143-151 (1995) |
| [23] | Granger, C., Modelling nonlinear economic relationships (1993), Oxford University Press · Zbl 0893.90030 |
| [24] | Hahn, H.; Meyer-Nieberg, S.; Pickl, S., Electric load forecasting methods: Tools for decision making, European Journal of Operational Research, 199, 3, 902-907 (2009) · Zbl 1176.90291 |
| [25] | Hansen, P. R.; Lunde, A.; Nason, J. M., The model confidence set, Econometrica, 79, 2, 453-497 (2011) · Zbl 1210.62030 |
| [26] | Hippert, H.; Pedreira, C.; Souza, R., Neural networks for short-term load forecasting: a review and evaluation, IEEE Transactions on Power Systems, 16, 1, 44-55 (2001) |
| [27] | Hyndman, R.; Koehler, A.; Ord, J.; Snyder, R., Forecasting with exponential smoothing: The state space approach, Springer Series in Statistics (2008), Berlin Heidelberg: Berlin Heidelberg Springer · Zbl 1211.62165 |
| [28] | Hyndman, R. J. (2018). forecast: Forecasting functions for time series and linear models. URL: http://github.com/robjhyndman/forecast; Hyndman, R. J. (2018). forecast: Forecasting functions for time series and linear models. URL: http://github.com/robjhyndman/forecast |
| [29] | Hyndman, R. J.; Athanasopoulos, G., Forecasting: Principles and practice (2014), OTexts |
| [30] | Jang, J.; Sun, C.; Mizutani, E., Neuro-fuzzy and soft computing: A computational approach to learning and machine intelligence (1997), Prentice Hall |
| [31] | Jing, B.-Y., On the relative performance of the block bootstrap for dependent data, Communications in Statistics-Theory and Methods, 26, 6, 1313-1328 (1997) · Zbl 1127.62333 |
| [32] | Kasabov, N., Foundations of neural networks, fuzzy systems, and knowledge engineering, A Bradford book (1996), MIT Press · Zbl 0925.68356 |
| [33] | Khwaja, A.; Zhang, X.; Anpalagan, A.; Venkatesh, B., Boosted neural networks for improved short-term electric load forecasting, Electric Power Systems Research, 143, Supplement C, 431-437 (2017) |
| [34] | Kolassa, S., Combining exponential smoothing forecasts using Akaike weights, International Journal of Forecasting, 27, 2, 238-251 (2011) |
| [35] | Kourentzes, N.; Petropoulos, F.; Trapero, J. R., Improving forecasting by estimating time series structural components across multiple frequencies, International Journal of Forecasting, 30, 2, 291-302 (2014) |
| [36] | Li, S.; Goel, L.; Wang, P., An ensemble approach for short-term load forecasting by extreme learning machine, Applied Energy, 170, Supplement C, 22-29 (2016) |
| [37] | Matijaš, M.; a. K. Suykens, J.; Krajcar, S., Load forecasting using a multivariate meta-learning system, Expert Systems with Applications, 40, 11, 1-11 (2013) |
| [38] | Nowotarski, J.; Liu, B.; Weron, R.; Hong, T., Improving short term load forecast accuracy via combining sister forecasts, Energy, 98, 40-49 (2016) |
| [39] | Ord, K.; Fildes, R. A.; Kourentzes, N., Principles of business forecasting (2017), Wessex Press Publishing Co |
| [40] | Pai, P.-F.; Hong, W.-C., Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms, Electric Power Systems Research, 74, 3, 417-425 (2005) |
| [41] | Pesaran, M. H.; Pick, A., Forecast combination across estimation windows, Journal of Business & Economic Statistics, 29, 2, 307-318 (2011) · Zbl 1214.62095 |
| [42] | Petropoulos, F.; Hyndman, R. J.; Bergmeir, C., Exploring the sources of uncertainty: Why does bagging for time series forecasting work?, European Journal of Operational Research, 268, 2, 545-554 (2018) · Zbl 1403.62169 |
| [43] | Stock, J. H.; Watson, M. W., Combination forecasts of output growth in a seven-country data set, Journal of Forecasting, 23, 6, 405-430 (2004) |
| [44] | Taylor, J. W., Short-term electricity demand forecasting using double seasonal exponential smoothing, Journal of the Operational Research Society, 54, 8, 799-805 (2003) · Zbl 1097.91541 |
| [45] | Taylor, J. W., Triple seasonal methods for short-term electricity demand forecasting, European Journal of Operational Research, 204, 1, 139-152 (2010) · Zbl 1178.91165 |
| [46] | Taylor, J. W.; Buizza, R., Using weather ensemble predictions in electricity demand forecasting, International Journal of Forecasting, 19, 1, 57-70 (2003) |
| [47] | Taylor, J. W.; Majithia, S., Using combined forecasts with changing weights for electricity demand profiling, The Journal of the Operational Research Society, 51, 1, 72-82 (2000) · Zbl 1107.91359 |
| [48] | Taylor, J. W.; de Menezes, L. M.; McSharry, P. E., A comparison of univariate methods for forecasting electricity demand up to a day ahead, International Journal of Forecasting, 22, 1, 1-16 (2006) |
| [49] | Timmermann, A. (2006). Chapter 4 forecast combinations. (pp. 135-196). Elsevier (vol. 1). Handbook of Economic Forecastiing.; Timmermann, A. (2006). Chapter 4 forecast combinations. (pp. 135-196). Elsevier (vol. 1). Handbook of Economic Forecastiing. |
| [50] | Xiong, L.; Shamseldin, A. Y.; O’Connor, K. M., A non-linear combination of the forecasts of rainfall-runoff models by the first-order Takagi-Sugeno fuzzy system, Journal of Hydrology, 245, 1-4, 196-217 (2001) |
| [51] | Zhang, G. P., A neural network ensemble method with jittered training data for time series forecasting, Information Sciences, 177, 23, 5329-5346 (2007) |
| [52] | Zhou, Z.-H.; Wu, J.; Tang, W., Ensembling neural networks: Many could be better than all, Artificial Intelligence, 137, 1-2, 239-263 (2002) · Zbl 0995.68077 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
