Abstract:
In this paper, we introduce commutative, but generally not associative, groupoids AGS(N) consisting of idempotents. The groupoid (AGS(N),+) is closely related to the multilayer feedforward neural networks N (hereinafter just a neural network). It turned out that in such neural networks, specifying a subnet of a fixed neural network is tantamount to specifying some special tuple composed of finite sets of neurons in the original network. All special tuples defining some subnet of the neural network N are contained in the set AGS(N). The rest of the tuples from AGS(N) also have a neural network interpretation. Thus, AGS(N)=F1∪F2, where F1 is the set of tuples that induce subnets and F2 is the set of other tuples. If two subnets of a neural network are specified, then two cases arise. In the first case, a new subnet can be obtained from these subnets by merging the sets of all neurons of these subnets. In the second case, such a merger is impossible due to neural network reasons. The operation (+) for any tuples from AGS(N) returns a tuple that induces a subnet or returns a neutral element that does not induce subnets. In particular, if for two elements from F1 the operation (+) returns a neutral element, then the subnets induced by these elements cannot be combined into one subnet. For any two elements from AGS(N), the operation has a neural network interpretation. In this paper, we study the algebraic properties of the groupoids AGS(N) and construct some classes of endomorphisms of such groupoids. It is shown that every subnet N′ of the net N defines a subgroupoid T in the groupoid AGS(N) isomorphic to AGS(N′). It is proved that for every finite monoid G there is a neural network N such that G is isomorphically embeddable into the monoid of all endomorphisms AGS(N)). This statement is the main result of the work.
This work is supported by the Krasnoyarsk Mathematical Center and financed by the Ministry of Science and Higher Education of the Russian Federation in the framework of the establishment and development of regional Centers for Mathematics Research and Education (Agreement No. 075-02-2020-1534/1).
Citation:
A. V. Litavrin, “Endomorphisms of finite commutative groupoids related with multilayer feedforward neural networks”, Trudy Inst. Mat. i Mekh. UrO RAN, 27, no. 1, 2021, 130–145
\Bibitem{Lit21}
\by A.~V.~Litavrin
\paper Endomorphisms of finite commutative groupoids related with multilayer feedforward neural networks
\serial Trudy Inst. Mat. i Mekh. UrO RAN
\yr 2021
\vol 27
\issue 1
\pages 130--145
\mathnet{http://mi.mathnet.ru/timm1798}
\crossref{https://doi.org/10.21538/0134-4889-2021-27-1-130-145}
\elib{https://elibrary.ru/item.asp?id=44827401}
Linking options:
https://www.mathnet.ru/eng/timm1798
https://www.mathnet.ru/eng/timm/v27/i1/p130
This publication is cited in the following 5 articles:
Andrey V. Litavrin, “On the bipolar classification of endomorphisms of a groupoid”, Zhurn. SFU. Ser. Matem. i fiz., 17:3 (2024), 378–387
A. V. Litavrin, T. V. Moiseenkova, “Ob odnom gruppoide, assotsiirovannom s kompozitsiei mnogosloinykh neironnykh setei pryamogo rasprostraneniya signala”, Zhurnal SVMO, 26:2 (2024), 111–122
A. V. Litavrin, “Integral Classification of Endomorphisms of an Arbitrary Algebra with Finitary Operations”, Algebra Logic, 2024
Andrey V. Litavrin, “On anti-endomorphisms of groupoids”, Izvestiya Irkutskogo gosudarstvennogo universiteta. Seriya Matematika, 44 (2023), 82–97
Andrey V. Litavrin, “On endomorphisms of the additive monoid of subnets of a two-layer neural network”, Izvestiya Irkutskogo gosudarstvennogo universiteta. Seriya Matematika, 39 (2022), 111–126