A controlled partially observable model having periodic characteristics

An averaged controlled stochastically discontinuous model in which the information is incomplete over an infinite time horizon is studied. A range of periodic control strategies are introduced and its sufficiency is proved for models having periodic characteristics. An algorithm for design of an $\varepsilon$-optimal periodic strategy is described. A «four-armed bandit» problem is considered for illustration.