|
Problemy Peredachi Informatsii, 2009, Volume 45, Issue 1, Pages 51–59
(Mi ppi1259)
|
|
|
|
This article is cited in 16 scientific papers (total in 16 papers)
Automata Theory
Perceptrons of large weight
V. V. Podolskii M. V. Lomonosov Moscow State University, Faculty of Mechanics and Mathematics
Abstract:
A threshold gate is a linear combination of input variables with integer coefficients (weights). It outputs 1 if the sum is positive. The maximum absolute value of the coefficients of a threshold gate is called its weight. A degree-$d$ perceptron is a Boolean circuit of depth 2 with a threshold gate at the top and any Boolean elements of fan-in at most $d$ at the bottom level. The weight of a perceptron is the weight of its threshold gate.
For any constant $d\ge 2$ independent of the number of input variables $n$, we construct a degree-$d$ perceptron that requires weights of at least $n^{\Omega(n^d)}$; i.e., the weight of any degree-$d$ perceptron that computes the same Boolean function must be at least $n^{\Omega(n^d)}$. This bound is tight: any degree-$d$ perceptron is equivalent to a degree-$d$ perceptron of weight $n^{O(n^d)}$. For the case of threshold gates (i.e., $d=1$), the result was proved by Håstad in [2]; we use Håstad's technique.
Received: 22.07.2008
Citation:
V. V. Podolskii, “Perceptrons of large weight”, Probl. Peredachi Inf., 45:1 (2009), 51–59; Problems Inform. Transmission, 45:1 (2009), 46–53
Linking options:
https://www.mathnet.ru/eng/ppi1259 https://www.mathnet.ru/eng/ppi/v45/i1/p51
|
Statistics & downloads: |
Abstract page: | 624 | Full-text PDF : | 101 | References: | 57 | First page: | 17 |
|