Transformed statistical distance measures and the Fisher information matrix. (English) Zbl 1239.62061
Summary: Most multivariate statistical techniques are based upon the concept of distance. The purpose of this paper is to introduce statistical distance measures, which are normalized Euclidean distance measures, where the covariances of observed correlated measurements \(x_{1},\ldots ,x_{n}\) and entries of the Fisher information matrix (FIM) are used as weighting coefficients. The measurements are subject to random fluctuations of different magnitudes and have therefore different variabilities. A rotation of the coordinate system through a chosen angle while keeping the scatter of points given by the data fixed, is therefore considered. It is shown that when the FIM is positive definite, the appropriate statistical distance measure is a metric. In case of a singular FIM, the metric property depends on the rotation angle. The introduced statistical distance measures are matrix related, and are based on m parameters unlike a statistical distance measure in quantum information, which is also related to the Fisher information and where the information about one parameter in a particular measurement procedure is considered. A transformed FIM of a stationary process as well as the Sylvester resultant matrix are used to ensure the relevance of the appropriate statistical distance measures. The approach used in this paper is such that the matrix properties are crucial for ensuring the relevance of the introduced statistical distance measures.
MSC:
| 62H05 | Characterization and structure theory for multivariate probability distributions; copulas |
| 15B99 | Special matrices |
| 62M10 | Time series, auto-correlation, regression, etc. in statistics (GARCH) |
| 62H99 | Multivariate analysis |
Keywords:
Givens rotation matrix; Euclidean distance; Sylvester resultant matrix; quantum informationReferences:
| [1] | Anderson, T. W., An Introduction to Multivariate Statistical Analysis (2003), John Wiley: John Wiley New York · Zbl 0083.14601 |
| [2] | Barndorff-Nielsen, O. E.; Gill, R. D., Fisher information in quantum statistics, J. Phys. A, 30, 4481-4490 (2000) · Zbl 1004.81006 |
| [3] | Braunstein, S. L.; Caves, C. M., Statistical Distance and the Geometry of Quantum States, Phys. Rev. Lett., 72, 3439-3443 (1994) · Zbl 0973.81509 |
| [4] | Bretscher, O., Linear Algebra with Applications (1997), Prentice-Hall · Zbl 0896.15001 |
| [5] | Brockwell, P. J.; Davis, R. A., Time Series: Theory and Methods (1991), Springer-Verlag: Springer-Verlag Berlin, New York · Zbl 0673.62085 |
| [6] | Frieden, B. R., Physics from Fisher Information: A Unification (1998), Cambridge University Press: Cambridge University Press New York · Zbl 0881.60016 |
| [7] | Frieden, B. R., Science from Fisher Information: A Unification (2004), Cambridge University Press: Cambridge University Press New York · Zbl 1079.81013 |
| [8] | Golub, G. H.; Van Loan, C. F., Matrix Computations (1996), John Hopkins University Press · Zbl 0865.65009 |
| [9] | Holevo, A. S., Probabilistic and Statistical Aspects of Quantum Theory (2011), Edizioni Della Normale: Edizioni Della Normale SNS Pisa · Zbl 1316.81015 |
| [10] | Horn, R. A.; Johnson, C. R., Matrix Analysis (1985), North-Holland, Cambridge University Press · Zbl 0576.15001 |
| [11] | Ibragimov, I. A.; Has’minskii˘, R. Z., Statistical Estimation, Asymptotic Theory (1981), Springer-Verlag: Springer-Verlag New York · Zbl 0389.62024 |
| [12] | Johnson, R. A.; Wichern, D. W., Applied Multivariate Statistical Analysis (1988), Prentice-Hall · Zbl 0663.62061 |
| [13] | Jones, P. J.; Kok, P., Geometric derivation of the quantum speed limit, Phys. Rev. A, 82, 022107 (2010) |
| [14] | Klein, A.; Spreij, P., On Fisher’s information matrix of an ARMAX process and Sylvester’s resultant matrices, Linear Algebra Appl., 237/238, 579-590 (1996) · Zbl 0843.62087 |
| [15] | Klein, A.; Spreij, P., On Fisher’s information matrix of an ARMA process, (Csiszar, I.; Michaletzky, Gy., Stochastic Differential and Difference Equations. Stochastic Differential and Difference Equations, Progress in Systems and Control Theory, vol. 23 (1997), Birkhäuser: Birkhäuser Boston), 273-284 · Zbl 0890.62069 |
| [16] | Klein, A.; Mélard, G.; Spreij, P., On the resultant property of the Fisher information matrix of a vector ARMA process, Linear Algebra Appl., 403, 291-313 (2005) · Zbl 1084.15021 |
| [17] | Klein, A.; Spreij, P., The Bezoutian, state space realizations and Fisher’s information matrix of an ARMA process, Linear Algebra Appl., 416, 160-174 (2006) · Zbl 1096.62085 |
| [18] | Klein, A.; Spreij, P., An explicit expression for the Fisher information matrix of a multiple time series process, Linear Algebra Appl., 417, 140-149 (2006) · Zbl 1092.62087 |
| [19] | Kullback, S., Information Theory and Statistics (1959), John Wiley & Sons: John Wiley & Sons New York · Zbl 0149.37901 |
| [20] | P. Kok, Tutorial: statistical distance and Fisher information, 8 August 2006.; P. Kok, Tutorial: statistical distance and Fisher information, 8 August 2006. |
| [21] | Lancaster, P.; Tismenetsky, M., The Theory of Matrices with Applications (1985), Academic Press: Academic Press Orlando · Zbl 0516.15018 |
| [22] | Petz, D., Quantum Information Theory and Quantum Statistics (2008), Springer-Verlag: Springer-Verlag Berlin, Heidelberg · Zbl 1145.81002 |
| [23] | Rao, C. R., Information and the accuracy attainable in the estimation of statistical parameters, Bull. Calcutta Math. Soc., 37, 81-91 (1945) · Zbl 0063.06420 |
| [24] | Luo, Shunlong, Wigner-Yanase skew information vs. quantum Fisher information, Proc. Amer. Math. Soc., 132, 3, 885-890 (2003) · Zbl 1119.62124 |
| [25] | S. Wesolkowski, P. Fieguth, A probabilistic shading invariant color distance measure, in: 15th European Signal Processing Conference, Poznan, Poland, September 2007, pp. 1907—1911.; S. Wesolkowski, P. Fieguth, A probabilistic shading invariant color distance measure, in: 15th European Signal Processing Conference, Poznan, Poland, September 2007, pp. 1907—1911. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
