|
This article is cited in 10 scientific papers (total in 10 papers)
Analytical solution of the optimal control task of a semi-Markov process with finite set of states
P. V. Shnurkova, A. K. Gorsheninb, V. V. Belousovb a National Research University Higher School of Economics, 34 Tallinskaya Str., Moscow, 123458, Russian Federation
b Institute of Informatics Problems, Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 44-2 Vavilova Str., Moscow 119333, Russian Federation
Abstract:
The theoretical verification of the new method of finding the optimal strategy of control of a semi-Markov process with finite set of states is presented. The paper considers Markov randomized strategies of control, determined by a finite collection of probability measures, corresponding to each state. The quality characteristic is the stationary cost index. This index is a linear-fractional integral functional, depending on collection of probability measures, giving the strategy of control. Explicit analytical forms of integrands of numerator and denominator of this linear-fractional integral functional are known. The basis of consequent results is the new generalized and strengthened form of the theorem about an extremum of a linear-fractional integral functional. It is proved that problems of existence of an optimal control strategy of a semi-Markov process and finding this strategy can be reduced to the task of numerical analysis of global extremum for the given function, depending on finite number of real arguments.
Keywords:
optimal control of a semi-Markov process; stationary cost index of quality control; linear-fractional integral functional.
Received: 15.07.2016
Citation:
P. V. Shnurkov, A. K. Gorshenin, V. V. Belousov, “Analytical solution of the optimal control task of a semi-Markov process with finite set of states”, Inform. Primen., 10:4 (2016), 72–88
Linking options:
https://www.mathnet.ru/eng/ia447 https://www.mathnet.ru/eng/ia/v10/i4/p72
|
Statistics & downloads: |
Abstract page: | 405 | Full-text PDF : | 177 | References: | 60 |
|