|
This article is cited in 1 scientific paper (total in 1 paper)
Stochastic Systems
Practical implementation of the solution of the stabilization problem for a linear system with discontinuous random drift by indirect observations
A. V. Borisov, A. V. Bosov Federal Research Center “Computer Science and Control,” Russian Academy
of Sciences, Moscow, 119333 Russia
Abstract:
We study the implementation of the optimal control strategy obtained in [1] and supplemented in [2]. The algorithm for optimal stabilization of a linear stochastic differential system in a position determined by a piecewise constant Markov drift has been tested in a substantial number of model experiments. The drift value is observed indirectly; i.e., the control problem is solved in the statement with incomplete information. Practical implementation is complicated by the instability of Euler–Maruyama numerical schemes that implement the Wonham filter, which is a key element of the optimal control strategy. To perform calculations, the Wonham filter is approximated by stable schemes based on the optimal filtering of Markov chains by discretized observations [3]. These schemes have different implementation complexity and orders of accuracy. The paper presents a comparative analysis of the control performance for various stable approximations to the Wonham filter and its typical implementation using the Euler–Maruyama scheme. In addition, three versions of discretized filters are compared and final recommendations are given for their application in the problem of stabilizing a system with hopping drift.
Keywords:
linear differential system control, continuous-time Markov chain, quadratic objective function, Wonham filter, Euler-Maruyama scheme, discretized filter.
Citation:
A. V. Borisov, A. V. Bosov, “Practical implementation of the solution of the stabilization problem for a linear system with discontinuous random drift by indirect observations”, Avtomat. i Telemekh., 2022, no. 9, 109–127; Autom. Remote Control, 83:9 (2022), 1417–1432
Linking options:
https://www.mathnet.ru/eng/at15931 https://www.mathnet.ru/eng/at/y2022/i9/p109
|
|