|
Simple robust neural network
V. S. Timofeev, M. A. Sivak Novosibirsk state technical university, prosp. K. Marksa 20, Novosibirsk 630073, Russia
Abstract:
The classification problem and applying simple neural networks for solving it are considered. The robust modification of the error backpropagation algorithm that is used for training neural networks is proposed. The proclaim that allows building the proposed modification with the Huber loss-function is proved. In order to study the properties of the obtained neural network, a number of computational experiments has been carried out. The different values of outliers' fraction, noise level, and training and test samples size have been considered. The result analysis shows that the proposed modification can significantly increase classification accuracy and learning rate of a neural network when working with noisy data.
Keywords:
classification problem, neural network, Huber loss-function, error backpropagation algorithm.
.
Received: 17.11.2020 Revised: 04.10.2021 Accepted: 21.10.2021
Citation:
V. S. Timofeev, M. A. Sivak, “Simple robust neural network”, Sib. Zh. Ind. Mat., 24:4 (2021), 126–138
Linking options:
https://www.mathnet.ru/eng/sjim1156 https://www.mathnet.ru/eng/sjim/v24/i4/p126
|
Statistics & downloads: |
Abstract page: | 189 | Full-text PDF : | 109 | References: | 21 | First page: | 1 |
|