Abstract:
The paper is devoted to the approximate solution of an infinite-horizon optimal control problem for a nonlinear system of differential equations with an integral cost functional. We use the technique of piecewise linearization (“hybridization”) of the original nonlinear system followed by the analysis of the resulting switched system. Then the methods of piecewise affine value and control functions, the method of dynamic programming, and the comparison principle are applied. Two cases are considered sequentially: with continuous piecewise affine value and control functions and with functions admitting discontinuities. In the latter case, it is possible to increase the effectiveness of the proposed approach by allowing gaps. Theorems on sufficient conditions for the solvability of the control problem are formulated and proved. The theorems also provide upper estimates of the minimized functional. Computationally simple algorithms are derived for the construction of estimates of the value function for this problem and of the corresponding feedback control. The operation of the proposed algorithm is demonstrated for a problem of control of a wheeled robot on the plane.
Citation:
P. A. Tochilin, “On the construction of a piecewise affine value function in an infinite-horizon optimal control problem”, Trudy Inst. Mat. i Mekh. UrO RAN, 26, no. 1, 2020, 223–238
\Bibitem{Toc20}
\by P.~A.~Tochilin
\paper On the construction of a piecewise affine value function in an infinite-horizon optimal control problem
\serial Trudy Inst. Mat. i Mekh. UrO RAN
\yr 2020
\vol 26
\issue 1
\pages 223--238
\mathnet{http://mi.mathnet.ru/timm1712}
\crossref{https://doi.org/10.21538/0134-4889-2020-26-1-223-238}
\elib{https://elibrary.ru/item.asp?id=42492206}
Linking options:
https://www.mathnet.ru/eng/timm1712
https://www.mathnet.ru/eng/timm/v26/i1/p223
This publication is cited in the following 3 articles:
P. A. Tochilin, I. A. Chistyakov, “ON PIECEWISE CUBIC ESTIMATES OF THE VALUE FUNCTION IN THE PROBLEM OF TARGET CONTROL FOR A NONLINEAR SYSTEM”, Differencialʹnye uravneniâ, 60:5 (2024)
P. A. Tochilin, I. A. Chistyakov, “O postroenii razryvnogo kusochno-affinnogo sinteza v zadache tselevogo upravleniya”, Tr. IMM UrO RAN, 27, no. 3, 2021, 194–210
Chistyakov I.A. Tochilin P.A., “Application of Piecewise Quadratic Value Functions to the Approximate Solution of a Nonlinear Target Control Problem”, Differ. Equ., 56:11 (2020), 1513–1523