|
Lower bound to estimation distortion of a random parameter for a given amount of information
M. M. Lange, A. M. Lange Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
Abstract:
Given probability distribution density with an unknown value of a random parameter, a minimum of the average square distortion for the parameter estimates via the samples of random values as a function of the average mutual information between the samples and the estimates is investigated. This function is produced by inverting a modified rate distortion function as the dependency of the minimal values of the average mutual information on the appropriate values of the average distortion. The obtained smallest average square distortion as the function of the average mutual information is independent on an estimation form and this function yields the lower bound to the average distortion for the fixed values of the amount of information. The above relation is the bifactor fidelity decision criterion that allows one to compare various estimation functions by their efficiency in terms of the average distortion redundancy relative to the lower bound when the entropy of the quantized estimates is fixed.
Keywords:
probability distribution density, data sample, parameter estimate, square distortion, mutual information, rate distortion function, lower bound, redundancy.
Received: 30.01.2024
Citation:
M. M. Lange, A. M. Lange, “Lower bound to estimation distortion of a random parameter for a given amount of information”, Inform. Primen., 18:2 (2024), 17–24
Linking options:
https://www.mathnet.ru/eng/ia895 https://www.mathnet.ru/eng/ia/v18/i2/p17
|
Statistics & downloads: |
Abstract page: | 20 | Full-text PDF : | 8 | References: | 6 |
|