×

A two-stage maximum entropy approach for time series regression. (English) Zbl 07854506

Summary: The maximum entropy bootstrap for time series is a technique that creates a large number of replicates, as elements of an ensemble, for inference purposes, which satisfies the ergodic and the central limit theorems. As an alternative to the use of traditional techniques, this work proposes generalized maximum entropy for the estimation of parameters in all the replicated models. An empirical application and a simulated example illustrate the advantages of this two-stage maximum entropy approach for time series regression modeling, where maximum entropy is used both in data replication and in parameter estimation.

MSC:

62M10 Time series, auto-correlation, regression, etc. in statistics (GARCH)
91B84 Economic time series analysis
94A17 Measures of information, entropy

Software:

meboot; hdrcde
Full Text: DOI

References:

[1] Belsley, D. A., Kuh, E., and Welsch, R. E.. 2004. Regression Diagnostics - Identifying Influential Data and Sources of Collinearity. Hoboken, New Jersey: John Wiley & Sons. · Zbl 0479.62056
[2] Caputo, M. R, and Paris, Q.. 2008. Comparative statics of the generalized maximum entropy estimator of the general linear model. European Journal of Operational Research185 (1):195-203. doi:. · Zbl 1141.62002
[3] Golan, A.2018. Foundations of Info-Metrics: Modeling, Inference, and Imperfect Information. New York: Oxford University Press. · Zbl 1383.62003
[4] Golan, A., Judge, G., and Miller, D.. 1996. Maximum Entropy Econometrics: Robust Estimation with Limited Data. Chichester: John Wiley & Sons. · Zbl 0884.62126
[5] Henderson, H., Golan, A., and Seabold, S.. 2015. Incorporating prior information when true priors are unknown: An information-theoretic approach for increasing efficiency in estimation. Economics Letters127:1-5. doi:. · Zbl 1321.62009
[6] Hyndman, R. J.1996. Computing and graphing highest density regions. The American Statistician50 (2):120-6.
[7] Hyndman, R., Einbeck, J., and Wand, M.. 2018. hdrcde: Highest Density Regions and Conditional Density Estimation. https://CRAN.R-project.org/package=hdrcde.
[8] Jaynes, E. T.1957a. Information theory and statistical mechanics. Physical Review106 (4):620-30. doi:. · Zbl 0084.43701
[9] Jaynes, E. T.1957b. Information theory and statistical mechanics. II. Physical Review108 (2):171-90. doi:. · Zbl 0084.43701
[10] Macedo, P.2017. Ridge regression and generalized maximum entropy: An improved version of the Ridge-GME parameter estimator. Communications in Statistics - Simulation and Computation46 (5):3527-39. · Zbl 1368.62206
[11] Macedo, P.2020. Freedman’s paradox: A solution based on normalized entropy. In Theory and Applications of Time Series Analysis, Contributions to Statistics, 239-52. Cham: Springer. · Zbl 07617300
[12] Mittelhammer, R., Cardell, N. S., and Marsh, T. L.. 2013. The data-constrained generalized maximum entropy estimator of the GLM: Asymptotic theory and inference. Entropy15 (12):1756-75. doi:. · Zbl 1296.62058
[13] Preckel, P. V.2001. Least squares and entropy: A penalty function perspective. American Journal of Agricultural Economics83 (2):366-77. doi:.
[14] Shannon, C. E.1948. A mathematical theory of communication. The Bell System Technical Journal27 (3):379-423. doi:. · Zbl 1154.94303
[15] Vinod, H. D.2004. Ranking mutual funds using unconventional utility theory and stochastic dominance. Journal of Empirical Finance11 (3):353-77. doi:.
[16] Vinod, H. D.2006. Maximum entropy ensembles for time series inference in economics. Journal of Asian Economics17 (6):955-78. doi:.
[17] Vinod, H. D, and López-de-Lacalle, J.. 2009. Maximum entropy bootstrap for time series: The meboot r package. Journal of Statistical Software29 (5):1-19. doi:.
[18] Wu, X.2009. A weighted generalized maximum entropy estimator with a data-driven weight. Entropy11 (4):917-30. doi:. · Zbl 1179.91209
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.