×

Study of incompatibility or near compatibility of bivariate discrete conditional probability distributions through divergence measures. (English) Zbl 1457.62039

Summary: Consider a two-dimensional discrete random variable \((X, Y)\) with possible values \(1, 2, \dots, I\) for \(X \) and \(1, 2, \dots, J\) for \(Y\). For specifying the distribution of \((X, Y)\), suppose both conditional distributions, of \(X\) given \(Y\) and of \(Y\) given \(X\), are provided. Under this setting, we present here different ways of measuring discrepancy between incompatible conditional distributions in the finite discrete case. In the process, we also suggest different ways of defining the most nearly compatible distributions in incompatible cases. Many new divergence measures are discussed along with those that are already known for determining the most nearly compatible joint distribution \(\mathbf{P}\). Finally, a comparative study is carried out between all these divergence measures as some examples.

MSC:

62B10 Statistical aspects of information-theoretic topics
62H05 Characterization and structure theory for multivariate probability distributions; copulas
Full Text: DOI

References:

[1] Arnold BC, Press SJ. Compatible conditional distributions. J Am Stat Assoc. 1989;84:152-156. doi: 10.1080/01621459.1989.10478750[Taylor & Francis Online], [Web of Science ®], [Google Scholar] · Zbl 0676.62011
[2] Arnold BC, Gokhale DV. On uniform marginal representations of contingency tables. Stat Probab Lett. 1994;21:311-316. doi: 10.1016/0167-7152(94)00024-7[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0805.62063
[3] Arnold BC, Gokhale DV. Distributions most nearly compatible with given families of conditional distributions: the finite discrete case. Test. 1998;7:377-390. doi: 10.1007/BF02565119[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0955.62053
[4] Arnold BC, Castillo E, Sarabia JM. Conditional specification of statistical models. New York: Springer-Verlag; 1999. [Google Scholar] · Zbl 0932.62001
[5] Arnold BC, Castillo E, Sarabia JM. Exact and near compatibility of discrete conditional distributions. Comput Stat Data Anal. 2002;40:231-252. doi: 10.1016/S0167-9473(01)00111-6[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0993.62006
[6] Mosteller F. Association and estimation in contingency tables. J Am Stat Assoc. 1968;63:1-28. doi: 10.2307/2283825[Taylor & Francis Online], [Web of Science ®], [Google Scholar]
[7] Kullback S. Information theory and statistics. New York: John Wiley & Sons; 1968. [Google Scholar] · Zbl 0897.62003
[8] Pardo L. Statistical inference based on divergence measures. Boca Raton, FL: Chapman & Hall/CRC Press; 2006. [Google Scholar] · Zbl 1118.62008
[9] Renyi A. On measures of information and entropy. Proceedings of the fourth Berkeley symposium on mathematics, statistics and probability; 1961. Berkeley, CA: University of California Press. p. 547-561. [Google Scholar] · Zbl 0106.33001
[10] Nadarajah S, Zografos K. Expressions for Renyi and Shannon entropies for bivariate distribution. Inform Sci. 2005;170:173-189. doi: 10.1016/j.ins.2004.02.020[Crossref], [Web of Science ®], [Google Scholar] · Zbl 1066.62007
[11] Mahalanobis PC. On the generalised distance in statistics. Proc Natl Inst Sci India. 1936;2:49-55. [Google Scholar] · Zbl 0015.03302
[12] Adhikari BP, Joshi DP. Distance discrimination et résumé exhaustif. Publications de l’Institut Statistics, University de Paris. 1956;5:57-74. [Google Scholar] · Zbl 0073.35701
[13] Rao CR. On the distance between two populations. Sankhyā. 1949;9:246-248. [Google Scholar]
[14] Rao CR. On the use and interpretation of distance function in statistics. Bull Int Stat Inst. 1954;34:90-100. [Google Scholar] · Zbl 0057.35601
[15] Chernoff H. A measure of asymptotic efficiency for tests of a hypothesis based on a sum of observations. Ann Math Stat. 1952;23:493-507. doi: 10.1214/aoms/1177729330[Crossref], [Google Scholar] · Zbl 0048.11804
[16] Kolmogorov AN. On tables of random numbers. Sankhyā. 1963;25:369-376. [Google Scholar] · Zbl 0126.33203
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.