|
Problemy Peredachi Informatsii, 2008, Volume 44, Issue 3, Pages 19–32
(Mi ppi1277)
|
|
|
|
This article is cited in 11 scientific papers (total in 11 papers)
Information Theory
Mutual Information, Variation, and Fano's Inequality
V. V. Prelova, E. C. van der Meulenb a A. A. Kharkevich Institute for Information Transmission Problems, Russian Academy of Sciences
b Katholieke Universiteit Leuven
Abstract:
Some upper and lower bounds are obtained for the maximum of the absolute value of the difference between the mutual information $|I(X;Y)-I(X';Y')|$ of two pairs of discrete random variables $(X,Y)$ and $(X',Y')$ via the variational distance between the probability distributions of these pairs. In particular, the upper bound obtained here substantially generalizes and improves the upper bound of [1]. In some special cases, our upper and lower bounds coincide or are rather close. It is also proved that the lower bound is asymptotically tight in the case where the variational distance between $(X,Y)$ and $(X',Y')$ tends to zero.
Received: 15.05.2008
Citation:
V. V. Prelov, E. C. van der Meulen, “Mutual Information, Variation, and Fano's Inequality”, Probl. Peredachi Inf., 44:3 (2008), 19–32; Problems Inform. Transmission, 44:3 (2008), 185–197
Linking options:
https://www.mathnet.ru/eng/ppi1277 https://www.mathnet.ru/eng/ppi/v44/i3/p19
|
|