Abstract:
The paper is devoted to the development and examination of the interval analysis-based numerical methods of the guaranteed learning of neural direct-propagation networks. Developed were contractive operators that allow for the singularities of the problem of learning (quadratic learning performance functional and superpositional weight-linear/nonlinear structure of the neural networks) and are used in the numerical methods of learning. The results of computer-aided experiments studying effectiveness of the developed methods were presented. The method of learning based on the algorithm of inverse error propagation and the method of weight shaking for determination of the global optimum were compared.
Presented by the member of Editorial Board:B. T. Polyak
This publication is cited in the following 11 articles:
Interval Analysis, 2023, 29
D. S. Girenko, V. N. Zhidkov, N. V. Kim, “Accuracy of Neural Network Manipulator Control”, Russ. Engin. Res., 42:9 (2022), 929
Bartłomiej Jacek Kubica, Paweł Hoser, Artur Wiliński, Lecture Notes in Computer Science, 12139, Computational Science – ICCS 2020, 2020, 414
Bartłomiej Jacek Kubica, Studies in Computational Intelligence, 805, Interval Methods for Solving Nonlinear Constraint Satisfaction, Optimization and Similar Problems, 2019, 101
P. V. Saraev, S. L. Blyumin, A. V. Galkin, A. S. Sysoev, Advances in Intelligent Systems and Computing, 679, Proceedings of the Second International Scientific Conference “Intelligent Information Technologies for Industry” (IITI'17), 2018, 141
P. V. Saraev, Yu. E. Polozova, Yu. L. Polozov, “Primenenie rezultatov intervalnogo neirosetevogo prognozirovaniya dlya kalibrovki sredstv izmerenii v sistemakh upravleniya”, Probl. upravl., 2 (2017), 50–55
A. Galkin, A. Sysoev, P. Saraev, “Variable structure objects remodelling based on neural networks”, International Conference on Industrial Engineering, Applications and Manufacturing, ICIEAM 2017, IEEE, 2017
A. Galkin, A. Sysoev, P. Saraev, 2017 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM), 2017, 1
S. P. Adam, G. D. Magoulas, D. A. Karras, M. N. Vrahatis, “Bounding the search space for global optimization of neural networks learning error: an interval analysis approach”, J. Mach. Learn. Res., 17 (2016), 169
A. G. Shumikhin, A. S. Boyarshinova, “Identification of a complex control object with frequency characteristics obtained experimentally with its dynamic neural network model”, Autom. Remote Control, 76:4 (2015), 650–657
A. G. Shumikhin, A. S. Boyarshinova, “Algoritm vybora strukturnykh parametrov iskusstvennoi neironnoi seti i ob'ema obuchayuschei vyborki pri approksimatsii povedeniya dinamicheskogo ob'ekta”, Kompyuternye issledovaniya i modelirovanie, 7:2 (2015), 243–251