Classical characteristics of the Bellman equation in constructions of grid optimal synthesis

We consider optimal control problems with fixed final time and terminal–integral cost functional, and address the question of constructing a grid optimal synthesis (a universal feedback) on the basis of classical characteristics of the Bellman equation. To construct an optimal synthesis, we propose a numerical algorithm that relies on the necessary optimality conditions (the Pontryagin maximum principle) and sufficient conditions in the Hamiltonian form. We obtain estimates for the efficiency of the numerical method. The method is illustrated by an example of the numerical solution of a nonlinear optimal control problem.