Computation of the fundamental limits of data compression for certain nonstationary ARMA vector sources. (English) Zbl 07895091
Summary: In the present article, the differential entropy rate and the rate distortion function (RDF) are computed for certain nonstationary real Gaussian autoregressive moving average (ARMA) vector sources.
MSC:
| 94A17 | Measures of information, entropy |
| 94A15 | Information theory (general) |
| 68P30 | Coding and information theory (compaction, compression, models of communication, encoding schemes, etc.) (aspects in computer science) |
Keywords:
autoregressive moving average (ARMA) vector process; data compression; differential entropy rate; rate distortion function (RDF)References:
| [1] | Shannon, C. E., A Mathematical Theory of Communication, Bell Syst. Tech. J., 27, 3, 379-423, 1948 · Zbl 1154.94303 · doi:10.1002/j.1538-7305.1948.tb01338.x |
| [2] | Wyner, A., Fundamental Limits in Information Theory, Proc. IEEE, 69, 2, 239-251, 1981 · doi:10.1109/PROC.1981.11956 |
| [3] | Cover, T. M.; Thomas, J. A., Elements of Information Theory, 2006, Hoboken, NJ: Wiley, Hoboken, NJ · Zbl 1140.94001 |
| [4] | Toms, W.; Berger, T., Information Rates of Stochastically Driven Dynamic Systems, IEEE Trans. Inform. Theory, 17, 1, 113-114, 1971 · Zbl 0224.93045 · doi:10.1109/TIT.1971.1054569 |
| [5] | Gutiérrez-Gutiérrez, J.; Crespo, P. M., Asymptotically Equivalent Sequences of Matrices and Multivariate ARMA Processes, IEEE Trans. Inform. Theory, 57, 8, 5444-5454, 2011 · Zbl 1365.62341 · doi:10.1109/TIT.2011.2159042 |
| [6] | Gray, R. M., Toeplitz and Circulant Matrices: A Review, Found. Trends Commun. Inform. Theory, 2, 3, 155-239, 2006 · doi:10.1561/0100000006 |
| [7] | Gutiérrez-Gutiérrez, J.; Crespo, P. M., Block Toeplitz Matrices: Asymptotic Results and Applications, Found. Trends Commun. Inform. Theory, 8, 3, 179-257, 2011 · Zbl 1278.15031 · doi:10.1561/0100000066 |
| [8] | Ephraim, Y.; Lev-Ari, H.; Gray, R. M., Asymptotic Minimum Discrimination Information Measure for Asymptotically Weakly Stationary Processes, IEEE Trans. Inform. Theory, 34, 5, 1033-1040, 1988 · Zbl 0665.94004 · doi:10.1109/18.21226 |
| [9] | Gersho, A.; Gray, R. M., Vector Quantization and Signal Compression, 2012, New York: Springer, New York |
| [10] | Gutiérrez-Gutiérrez, J., Barasoain-Echepare, Í., Zárraga-Rodríguez, M., and Insausti, X., Necessary and Sufficient Conditions for AR Vector Processes to Be Stationary: Applications in Information Theory and in Statistical Signal Processing, Appl. Math. Comput., 2023, vol. 445, Article 127824 (14 pp.). doi:10.1016/j.amc.2022.127824 · Zbl 1511.62220 |
| [11] | Gutiérrez-Gutiérrez, J., Zárraga-Rodríguez, M., and Insausti, X., On the Asymptotic Optimality of a Low-Complexity Coding Strategy for WSS, MA, and AR Vector Sources, Entropy, 2020, vol. 22, no. 12, Article 1378 (20 pp.). doi:10.3390/e22121378 |
| [12] | Kolmogorov, A., On the Shannon Theory of Information Transmission in the Case of Continuous Signals, IRE Trans. Inform. Theory, 2, 4, 102-108, 1956 · doi:10.1109/TIT.1956.1056823 |
| [13] | Gutiérrez-Gutiérrez, J., A Modified Version of the Pisarenko Method to Estimate the Power Spectral Density of Any Asymptotically Wide Sense Stationary Vector Process, Appl. Math. Comput., 2019, vol. 362, Article 124526 (11 pp.). doi:10.1016/j.amc.2019.06.040 · Zbl 1433.15030 |
| [14] | Gutiérrez-Gutiérrez, J., Zárraga-Rodríguez, M., Crespo, P.M., and Insausti, X., Rate Distortion Function of Gaussian Asymptotically WSS Vector Processes, Entropy, 2018, vol. 20, no. 9, Article 719 (12 pp.). doi:10.3390/e20090719 |
| [15] | Bhatia, R., Matrix Analysis, 1997, New York: Springer, New York · doi:10.1007/978-1-4612-0653-8 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
