|
Teoriya Veroyatnostei i ee Primeneniya, 1976, Volume 21, Issue 1, Pages 157–163
(Mi tvp3304)
|
|
|
|
This article is cited in 5 scientific papers (total in 5 papers)
Short Communications
A finite controlled Markov chain with small break probability
R. Ya. Čitašvili Institute of Economics and Law of Academy of Sciences of GSSR, Tbilisi
Abstract:
The paper deals with a controlled Markov chain with a finite number of states $s\in S$ and a finite number of decisions $a\in A$. The optimality criterion is defined by $\mathbf E^{\pi}\widetilde L$, where $\widetilde L$ is a functional invariant with respect to shifts of the trajectory $(s_n,a_n;\,n\ge 1)$, and can be approximated, for small break probabilities, by the criterion defined by $\mathbf E^{\pi}c(s_{\tau},a_{\tau})$. Existence of an optimal stationary policy is proved, and a method for its construction is given.
Received: 05.08.1974
Citation:
R. Ya. Čitašvili, “A finite controlled Markov chain with small break probability”, Teor. Veroyatnost. i Primenen., 21:1 (1976), 157–163; Theory Probab. Appl., 21:1 (1976), 158–163
Linking options:
https://www.mathnet.ru/eng/tvp3304 https://www.mathnet.ru/eng/tvp/v21/i1/p157
|
|