|
This article is cited in 4 scientific papers (total in 4 papers)
Stochastic Systems
An analytical method for the analysis of inhomogeneous continuous Markov processes with piecewise constant transition intensities
K. A. Vytovtov, E. A. Barabanova Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, Moscow, 117997 Russia
Abstract:
The article deals with an inhomogeneous Markov process with finitely many discrete states, continuous time, and piecewise constant transition intensities. For the first time, analytical expressions are presented that describe both the transient and steady-state modes of the random process. To solve this problem, the fundamental matrix of the Kolmogorov system of differential equations is found in closed form in terms of elementary functions. In addition, an inhomogeneous process with periodically varying transition intensities is considered. For this case, the conditions for the existence of a steady-state mode are presented. Results of numerical calculations are provided for processes without jumps, with jumps, and with periodic jumps in the transition intensities.
Keywords:
inhomogeneous Markov process, piecewise constant transition intensity, Kolmogorov equation.
Citation:
K. A. Vytovtov, E. A. Barabanova, “An analytical method for the analysis of inhomogeneous continuous Markov processes with piecewise constant transition intensities”, Avtomat. i Telemekh., 2021, no. 12, 90–104; Autom. Remote Control, 82:12 (2021), 2112–2124
Linking options:
https://www.mathnet.ru/eng/at15853 https://www.mathnet.ru/eng/at/y2021/i12/p90
|
Statistics & downloads: |
Abstract page: | 161 | Full-text PDF : | 1 | References: | 41 | First page: | 33 |
|