|
This article is cited in 2 scientific papers (total in 2 papers)
Information Theory
On the maximum $f$-divergence of probability distributions given the value of their coupling
V. V. Prelov Kharkevich Institute for Information Transmission Problems,
Russian Academy of Sciences, Moscow, Russia
Abstract:
The paper is a supplement to the author's paper [1]. Here we present explicit upper bounds (which are optimal in some cases) on the maximum value of the $f$-divergence $D_f(P \| Q)$ of discrete probability distributions $P$ and $Q$ provided that the distribution $Q$ (or its minimal component $q_{\min}$) and the value of the coupling of $P$ and $Q$ are fixed. We also obtain an explicit expression for the maximum value of the divergence $D_f(P \| Q)$ provided that only the value of the coupling of $P$ and $Q$ is given. Results of [1] concerning the Kullback–Leibler divergence and $\chi^2$-divergence are particular cases of the results proved in the present paper.
Keywords:
$f$-divergence, Kullback–Leibler divergence, $\chi^2$-divergence, coupling of discrete probability distributions.
Received: 12.11.2021 Revised: 16.11.2021 Accepted: 16.11.2021
Citation:
V. V. Prelov, “On the maximum $f$-divergence of probability distributions given the value of their coupling”, Probl. Peredachi Inf., 57:4 (2021), 24–33; Problems Inform. Transmission, 57:4 (2021), 321–330
Linking options:
https://www.mathnet.ru/eng/ppi2352 https://www.mathnet.ru/eng/ppi/v57/i4/p24
|
Statistics & downloads: |
Abstract page: | 96 | Full-text PDF : | 1 | References: | 21 | First page: | 9 |
|