|
This article is cited in 5 scientific papers (total in 5 papers)
Robust, Adaptive and Network Control
Comparative analysis of the results of training a neural network with calculated weights and with random generation of the weights
P. Sh. Geidarov Institute of Control Systems, Azerbaijan National Academy of Sciences, Baku, Azerbaijan
Abstract:
Neural networks based on metric recognition methods allow, based on the initial conditions of the computer vision task such as the number of images and samples, to determine the structure of the neural network (the number of neurons, layers, connections), and also allow to analytically calculate the values of the weights on the connections of the neural network. As feedforward neural networks, they can also be trained by classical learning algorithms. The possibility of precomputation of the values of the neural network weights allows us to say that the procedure for creating and training a feedforward neural network is accelerated in comparison with the classical scheme for creating and training a neural network where values of the weights are randomly generated. In this work, we conduct two experiments based on the handwritten numbers dataset MNIST that confirm this statement.
Keywords:
neural networks, metric recognition methods, nearest neighbor method, backpropagation algorithms, random weight initialization.
Citation:
P. Sh. Geidarov, “Comparative analysis of the results of training a neural network with calculated weights and with random generation of the weights”, Avtomat. i Telemekh., 2020, no. 7, 56–78; Autom. Remote Control, 81:7 (2020), 1211–1229
Linking options:
https://www.mathnet.ru/eng/at15159 https://www.mathnet.ru/eng/at/y2020/i7/p56
|
Statistics & downloads: |
Abstract page: | 136 | Full-text PDF : | 33 | References: | 30 | First page: | 9 |
|