Abstract:
This paper supplements the author's paper [1]. We obtain an explicit formula which in a special case allows us to calculate the maximum of mutual information of several random variables via the variational distance between the joint distribution of these random variables and the product of their marginal distributions. We establish two new inequalities for the binary entropy function, which are related to the problem considered here.
Citation:
V. V. Prelov, “On computation of information via variation and inequalities for the entropy function”, Probl. Peredachi Inf., 46:2 (2010), 24–29; Problems Inform. Transmission, 46:2 (2010), 122–126
\Bibitem{Pre10}
\by V.~V.~Prelov
\paper On computation of information via variation and inequalities for the entropy function
\jour Probl. Peredachi Inf.
\yr 2010
\vol 46
\issue 2
\pages 24--29
\mathnet{http://mi.mathnet.ru/ppi2013}
\mathscinet{http://mathscinet.ams.org/mathscinet-getitem?mr=2724794}
\transl
\jour Problems Inform. Transmission
\yr 2010
\vol 46
\issue 2
\pages 122--126
\crossref{https://doi.org/10.1134/S003294601002002X}
\isi{https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=Publons&SrcAuth=Publons_CEL&DestLinkType=FullRecord&DestApp=WOS_CPL&KeyUT=000280241600002}
\scopus{https://www.scopus.com/record/display.url?origin=inward&eid=2-s2.0-77956144173}
Linking options:
https://www.mathnet.ru/eng/ppi2013
https://www.mathnet.ru/eng/ppi/v46/i2/p24
This publication is cited in the following 4 articles:
Vl. V. Prelov, “New inequalities for entropy function”, Moscow University Mathematics Bulletin, 79:4 (2024), 198–200
Sason I., “Entropy Bounds for Discrete Random Variables via Maximal Coupling”, IEEE Trans. Inf. Theory, 59:11 (2013), 7118–7131
Ayuev V.V., “Dinamicheskaya nastroika i korrektsiya struktury neironnoi seti rbf pri obuchenii na nepolnykh vyborkakh dannykh”, Sistemy upravleniya i informatsionnye tekhnologii, 45:3 (2011), 51–55
Mark S. Pinsker, Vyacheslav V. Prelov, Edward C. van der Meulen, “Asymptotic Investigation of the Information Rates in Certain Stationary Channels with and without Memory”, American Journal of Mathematical and Management Sciences, 21:1-2 (2001), 29