|
This article is cited in 3 scientific papers (total in 3 papers)
COMPUTER SYSTEMS AND NETWORKS
Fast and gate-efficient approximated activations for bipolar morphological neural networks
E. E. Limonova Federal Research Center "Computer Science and Control" of Russian Academy of Sciences, Moscow, Russia
Abstract:
Bipolar morphological neural networks are aimed at efficient hardware implementation without multiplications inside the convolutional layers. However, they use resource demanding activation functions based on binary logarithm and exponent. In this paper, the computationally efficient approximations for activation functions of bipolar morphological neural networks are considered. Mitchell's approximation is used for binary logarithm and demonstrates 12 times decrease in the estimated logic gate number and latency. Schraudolph's approximation used for exponent has 3 times lower logic gates complexity and latency. The usage of approximate activation functions provides a 12–40% latency decrease for the BM convolutional layers with a small number of input channels and 3 $\times$ 3 filters compared to standard ones. The experiments show that these approximations can be used in the BM ResNet trained for classification task with a reasonable recognition accuracy decreasing from 99.08% to 98.90%.
Keywords:
bipolar morphological networks, approximations, computational efficiency.
Citation:
E. E. Limonova, “Fast and gate-efficient approximated activations for bipolar morphological neural networks”, Informatsionnye Tekhnologii i Vychslitel'nye Sistemy, 2022, no. 2, 3–10
Linking options:
https://www.mathnet.ru/eng/itvs762 https://www.mathnet.ru/eng/itvs/y2022/i2/p3
|
Statistics & downloads: |
Abstract page: | 31 | Full-text PDF : | 17 |
|