|
Optimization of hyperparameters of neural networks using high-performance computing for prediction of precipitation
A. K. Gorsheninab, V. Yu. Kuzminc a Institute of Informatics Problems, Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
b Faculty of Computational Mathematics and Cybernetics, M. V. Lomonosov Moscow State University, Leninskie Gory, GSP-1, Moscow 119991, Russian Federation
c “Wi2Geo LLC”, 3-1 Mira Prosp., Moscow 129090, Russian Federation
Abstract:
The paper describes the procedure for tuning hyperparameters of the neural network for analyzing spatial meteorological data using the tools of the hybrid high-performance computing system. The comparison of precipitation forecasting accuracy has been carried out on the basis of such methods as grid and random searches. It has been demonstrated that even with a relatively small number of random choices of combinations of hyperparameters, it is possible to obtain an accuracy comparable to brute force, with moderate time costs. These results show the ability to automatically build a neural network architecture based on the general model for solving applied problems.
Keywords:
artificial neural network, forecasting, deep learning, hyperparameters, high-performance computing, CUDA.
Received: 15.01.2019
Citation:
A. K. Gorshenin, V. Yu. Kuzmin, “Optimization of hyperparameters of neural networks using high-performance computing for prediction of precipitation”, Inform. Primen., 13:1 (2019), 75–81
Linking options:
https://www.mathnet.ru/eng/ia581 https://www.mathnet.ru/eng/ia/v13/i1/p75
|
Statistics & downloads: |
Abstract page: | 478 | Full-text PDF : | 520 | References: | 37 |
|