Part of Advances in Neural Information Processing Systems 2 (NIPS 1989)
David MacKay, Kenneth Miller
Linsker has reported the development of centre---surround receptive fields and oriented receptive fields in simulations of a Hebb-type equation in a linear network. The dynamics of the learning rule are analysed in terms of the eigenvectors of the covariance matrix of cell activities. Analytic and computational results for Linsker's covariance matrices, and some general theorems, lead to an expla(cid:173) nation of the emergence of centre---surround and certain oriented structures.
Linsker [Linsker, 1986, Linsker, 1988] has studied by simulation the evolution of weight vectors under a Hebb-type teacherless learning rule in a feed-forward linear network. The equation for the evolution of the weight vector w of a single neuron, derived by ensemble averaging the Hebbian rule over the statistics of the input patterns, is:!
a at Wi = k! + L(Qij + k 2 )wj subject to -Wmax ~ Wi < Wmax