×

Gaussian clustering and jump-diffusion models of electricity prices: a deep learning analysis. (English) Zbl 1480.91154

Summary: We propose a deep learning-based methodology to investigate the complex dynamics of electricity prices observed in power markets. The aims are: (a) to process missing data in power price time series with irregular observation times; (b) to detect a Gaussian component in the log-return empirical distributions if there is one; (c) to define suitable stochastic models of the dynamics of power prices. We apply this methodology to US wholesale electricity price time series which are characterized by missing data, high volatility, jumps and spikes. To this end, a multi-layer neural network is built and trained based on a dataset containing information on market prices, traded volumes, numbers of trades and counterparties. The forecasts of the trained neural network are used to fill the gaps in the electricity price time series. Starting with the no-gap reconstructed electricity price time series, clustering techniques are then used to identify the largest Gaussian cluster in the log-return empirical distribution. In each market under investigation, we found that log-returns show considerably large Gaussian clusters. This fact allows us to decouple normal stable periods in which log-returns present Gaussian behavior from turbulent periods in which jumps and spikes occur. The decoupling between the stable motion and the turbulent motion enabled us to define suitable mean-reverting jump-diffusion models of power prices and provide an estimation procedure that makes use of the full information contained in both the Gaussian component and the jumpy component of the log-return distribution. The results obtained demonstrate an interesting agreement with empirical data.

MSC:

91B74 Economic models of real-world systems (e.g., electricity markets, etc.)
60J74 Jump processes on discrete state spaces
68T07 Artificial neural networks and deep learning

Software:

NESToolbox
Full Text: DOI

References:

[1] Bahadori, M.T., Liu, Y.: Granger causality analysis in irregular time series. Proceedings of the 12th SIAM International Conference on Data Mining (2012)
[2] Bao, W.; Yue, J.; Rao, Y., A deep learning framework for financial time series using stacked autoencoders and long-short term memory, PLoS ONE, 12, 7, e0180944 (2017) · doi:10.1371/journal.pone.0180944
[3] Borovkova, S.; Schmeck, MD, Electricity price modeling with stochastic time change, Energy Econ., 63, 51-65 (2017)
[4] Broersen, PMT, Spectral analysis of irregularly sampled data with time series models, Open Signal Process. J., 1, 7-14 (2008) · Zbl 1322.62216
[5] Cartea, A.; Figuera, M., Pricing in electricity markets: a mean reverting jump diffusion model with seasonality, Appl. Math. Finance, 12, 4, 313-335 (2005) · Zbl 1134.91526
[6] Che, Z., Purushotham, S., Cho, K., Sontag, D., Liu, Y.: Recurrent Neural Networks for Multivariate Time Series with Missing Values. Sci. Rep. 8, Article number: 6085 (2018)
[7] Chen, H., Power Grid Operation in a Market Environment: Economic Efficiency and Risk Mitigation (2017), London: Wiley-IEEE Press, London
[8] Clements, AE; Hurn, AS; Li, Z., Strategic bidding and rebidding in electricity markets, Energy Econ., 59, 24-36 (2016)
[9] Cleveland, RB; Cleveland, WS; McRae, JE; Terpenning, IJ, STL: A seasonal-trend decomposition procedure based on LOESS, J. Offic. Stat., 6, 1, 3-33 (1990)
[10] Cuevas-Tello, JC; Tino, P.; Raychaudhury, S.; Yao, X.; Harva, M., Uncovering delayed patterns in noisy and irregularly sampled time series: an astronomy application, Pattern Recogn., 43, 3, 1165-1179 (2009) · Zbl 1187.68442
[11] Dagum, EB; Bianconcini, S., Seasonal Adjustment Methods and Real Time Trend-Cycle Estimation (2016), Berlin: Springer, Berlin · Zbl 1347.62004
[12] Duffie, D.; Singleton, K., Simulated moments estimation of Markov models of asset prices, Econometrica, 61, 929-952 (1993) · Zbl 0783.62099
[13] Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of 2nd International Conference on Knowledge Discovery and Data Mining. Portland, OR, pp. 226-231 (1996)
[14] Eydeland, A.; Wolyniec, K., Energy and Power Risk Management (2003), Chichester: Wiley, Chichester
[15] Fiorenzani, S., Quantitative Methods for Electricity Trading and Risk Management (2006), London: Palgrave Macmillan, London
[16] Foster, G.: Wavelets for period analysis of unevenly sampled time series. Astron. J. (1996). doi:10.1086/118137
[17] French, KR, Stock returns and the week-end effect, J. Financ. Econ., 8, 55-69 (1980)
[18] Gelman, A., Method of moments using Monte Carlo simulation, J. Comput. Graph. Stat., 4, 1, 36-54 (1995)
[19] Geman, H., Commodities and Commodity Derivatives (2005), Chichester: Wiley, Chichester
[20] Geman, H.; Roncoroni, A., Understanding the fine structure of electricity prices, J. Bus., 79, 1225-1262 (2006)
[21] Gómez, V.; Maravall, A.; Peña, D., Missing observations in ARIMA models: skipping approach versus additive outlier approach, J. Econom., 88, 341-363 (1999) · Zbl 1054.62621
[22] Hamilton, JD, A new approach to the economic analysis of nonstationary time series and the business cycle, Econometrica, 57, 357-384 (1989) · Zbl 0685.62092
[23] Hamilton, JD, Time Series Analysis (1994), Princeton: Princeton University Press, Princeton · Zbl 0831.62061
[24] Hochreiter, S.; Schmidhuber, J., Long short-term memory, Neural Comput., 9, 1735-1780 (1997)
[25] Huisman, R.; Mahieu, R., Regime jumps in electricity prices, Energy Econ., 25, 423-434 (2003)
[26] Kegnenlezom, M.; Takam Soh, PT; Mbele Bidima, MLD; Emvudu, WY, A jump-diffusion model for pricing electricity under price-cap regulation, Math. Sci., 13, 395-405 (2019) · Zbl 1452.91309
[27] Kreindler, DM; Lumsden, CJ, The effects of the irregular sample and missing data in time series analysis, Nonlinear Dyn. Psychol. Life Sci., 10, 2, 187-214 (2006)
[28] Lucia, J.; Schwartz, ES, Electricity prices and power derivatives: evidence from the Nordic power exchange, Rev. Deriv. Res., 5, 5-50 (2002) · Zbl 1064.91508
[29] Ma, Q., Li, S., Shen, L., Wang, J., Wei, J., Yu, Z., Cottrell. G.W.: End-to-end incomplete time series modeling from linear memory of latent variables. IEEE Trans. Cybern. (2019). doi:10.1109/TCYB.2019.2906426
[30] Mantegna, RN; Stanley, HE, Stochastic process with ultraslow convergence to a Gaussian: the truncated Lévy flight, Phys. Rev. Lett., 73, 2946-2949 (1994) · Zbl 1020.82610
[31] Mantegna, RN; Stanley, HE, An Introduction to Econophysics—Correlations and Complexity in Finance (2007), Cambridge: Cambridge University Press, Cambridge · Zbl 1134.91001
[32] Mari, C., Regime-switching characterization of electricity prices dynamics, Phys. A, 371, 552-564 (2006)
[33] Mari, C.: Short-term movements of electricity prices and long-term investments in power generating technologies. Energy Syst. (2021). doi:10.1007/s12667-020-00422-8
[34] McFadden, M., A method of simulated moments for estimation of discrete response models without numerical integration, Econometrica, 57, 5, 995-1026 (1989) · Zbl 0679.62101
[35] Meyer-Brandis, T.; Tankov, P., Multi-factor jump-diffusion models of electricity prices, Int. J. Theor. Appl. Finance, 11, 5, 503-528 (2008) · Zbl 1185.91191
[36] Mondal, D.; Percival, DB, Wavelet variance analysis for gappy time series, Ann. Inst. Stat. Math., 62, 5, 943-966 (2008) · Zbl 1432.62309
[37] Owen, M., Practical Signal Processing (2007), Cambridge: Cambridge University Press, Cambridge
[38] Paraschiv, P.; Fleten, SE; Schürle, M., A spot-forward model for electricity prices with regime shifts, Energy Econ., 47, 142-153 (2015)
[39] Rehfeld, K.; Marwan, N.; Heitzig, J.; Kurths, J., Comparison of correlation analysis techniques for irregularly sampled time series, Nonlinear Process. Geophys., 18, 3, 389-404 (2011)
[40] Ren, H., Cromwell, E., Kravitz, B., Chen, X.: Using deep learning to fill spatio-temporal data gaps in hydrological monitoring networks. Hydrol. Earth Syst. Sci. Discuss. (2019). doi:10.5194/hess-2019-196
[41] Rundo, F.; Trenta, F.; Di Stallo, AL; Battiato, S., Machine Learning for quantitative finance applications: a survey, Appl. Sci., 2019, 9, 5574-5593 (2019)
[42] Schulz, M.; Stattegger, K., Spectrum: spectral analysis of unevenly spaced paleoclimatic time series, Comput. Geosci., 23, 9, 929-945 (1997)
[43] Suo, Q., Yao, L., Xun, G., Sun, J., Zhang, A.: Recurrent imputation for multivariate time series with missing values. In: IEEE International Conference on Healthcare Informatics (2019)
[44] Tripathi, S.; Govindajaru, RS, On selection of kernel parameters in relevance vector machines for hydrologic applications, Stoch. Environ. Res. Risk Assess., 21, 747-764 (2007) · Zbl 1231.62197
[45] Voit, J., The Statistical Mechanics of Financial Markets (2005), Berlin: Springer, Berlin · Zbl 1107.91055
[46] Weron, R.; Bierbrauer, M.; Trück, S., Modeling electricity prices: jump-diffusion and regime switching, Phys. A, 336, 39-48 (2004)
[47] Weron, R., Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach (2013), London: Wiley, London
[48] Weron, R., Electricity price forecasting: a review of the state-of-the-art with a look into the future, Int. J. Forecast., 30, 4, 1030-1081 (2014)
[49] Wong, WK; Xia, M.; Chu, WC, Adaptive neural networks models for time-series forecasting, Eur. J. Oper. Res., 207, 807-816 (2010) · Zbl 1208.62151
[50] Xu, Z.; Zhang, J.; Wang, J.; Xu, Z., Prediction research of financial time series based on deep learning, Soft. Comput., 24, 8295-8312 (2020)
[51] Zhang, J.; Tan, Z.; Yang, S., Day-ahead electricity price forecasting by a new hybrid method, Comput. Ind. Eng., 63, 3, 695-701 (2012)
[52] Zhang, P.; Qi, GM, Neural network forecasting for seasonal trend time series, Eur. J. Oper. Res., 160, 501-514 (2005) · Zbl 1066.62094
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.