Showing 1–2 of 2 results for author: Stefani, A G

Confidence Intervals for the Mutual Information

Authors: A. G. Stefani, J. B. Huber, C. Jardin, H. Sticht

Abstract: By combining a bound on the absolute value of the difference of mutual information between two joint probablity distributions with a fixed variational distance, and a bound on the probability of a maximal deviation in variational distance between a true joint probability distribution and an empirical joint probability distribution, confidence intervals for the mutual information of two random vari… ▽ More By combining a bound on the absolute value of the difference of mutual information between two joint probablity distributions with a fixed variational distance, and a bound on the probability of a maximal deviation in variational distance between a true joint probability distribution and an empirical joint probability distribution, confidence intervals for the mutual information of two random variables with finite alphabets are established. Different from previous results, these intervals do not need any assumptions on the distribution and the sample size. △ Less

Submitted 27 January, 2013; v1 submitted 24 January, 2013; originally announced January 2013.

Comments: 5 pages, 2 figure

A Tight Lower Bound on the Mutual Information of a Binary and an Arbitrary Finite Random Variable in Dependence of the Variational Distance

Authors: A. G. Stefani, J. B. Huber, C. Jardin, H. Sticht

Abstract: In this paper a numerical method is presented, which finds a lower bound for the mutual information between a binary and an arbitrary finite random variable with joint distributions that have a variational distance not greater than a known value to a known joint distribution. This lower bound can be applied to mutual information estimation with confidence intervals. In this paper a numerical method is presented, which finds a lower bound for the mutual information between a binary and an arbitrary finite random variable with joint distributions that have a variational distance not greater than a known value to a known joint distribution. This lower bound can be applied to mutual information estimation with confidence intervals. △ Less

Submitted 27 January, 2013; v1 submitted 24 January, 2013; originally announced January 2013.

Comments: 4 pages, 3 figures