|
Diskretnyi Analiz i Issledovanie Operatsii, 2010, Volume 17, Issue 5, Pages 67–90
(Mi da626)
|
|
|
|
A rule for the addition of entropies for underdetermined data
L. A. Sholomov Institute of System Analysis RAS, Moscow, Russia
Abstract:
The basic information characteristics for underdetermined data are introduced. For underdetermined data of the general form, it is proved that the entropy addition rule $H(X)+H(Y|X)=H(XY)$ of classic Information theory turns into a more complicated expression. The form of the expression is found. In addition, the necessary and sufficient conditions for it to coincide with the ordinary entropy addition rule are obtained. Bibliogr. 11.
Keywords:
underdetermined data, information characteristics, entropy, conditional entropy, specification, best specification, entropy addition rule.
Received: 18.02.2010 Revised: 26.05.2010
Citation:
L. A. Sholomov, “A rule for the addition of entropies for underdetermined data”, Diskretn. Anal. Issled. Oper., 17:5 (2010), 67–90; J. Appl. Industr. Math., 5:3 (2011), 431–447
Linking options:
https://www.mathnet.ru/eng/da626 https://www.mathnet.ru/eng/da/v17/i5/p67
|
Statistics & downloads: |
Abstract page: | 317 | Full-text PDF : | 93 | References: | 55 | First page: | 6 |
|