|
On the analytical structure of some kinds of target functionals associated with the control problems of semi-Markov processes
P. V. Shnurkov National Research University Higher School of Economics, 34 Tallinskaya Str., Moscow 123458, Russian Federation
Abstract:
The present author investigates the analytical structure of three kinds of functionals from a controllable semi-Markov process with a finite set of states. It is proved that all these mathematical objects can be represented in the form of a fractional-linear integral functional defined on a finite set of probability measures that determine the control strategy of the corresponding semi-Markov process. For each of these functionals, explicit representations for the integrand functions of the numerator and denominator through the initial probabilistic characteristics of the controlled semi-Markov process are obtained. This result allows one to reduce the problem of optimal control of a semi-Markov process with a particular target functional to the problem of investigation on the global extremum of a given function of a finite number of variables.
Keywords:
stochastic control models, optimal control of semi-Markovian processes, partial-linear integral functional, basic function of partial-linear integral functional.
Received: 17.04.2022
Citation:
P. V. Shnurkov, “On the analytical structure of some kinds of target functionals associated with the control problems of semi-Markov processes”, Inform. Primen., 16:2 (2022), 75–84
Linking options:
https://www.mathnet.ru/eng/ia789 https://www.mathnet.ru/eng/ia/v16/i2/p75
|
Statistics & downloads: |
Abstract page: | 83 | Full-text PDF : | 30 | References: | 20 |
|