Pavlovian pattern learning by nonlinear neural networks

Author(s): Grossberg, S. |

Year: 1971

Citation: Proceedings of the National Academy of Sciences, 68, 828-831

Abstract: This note describes laws for the anatomy, potentials, spiking rules, and transmitters of some networks of formal neurons that enable them to learn spatial patterns by Pavlovian conditioning. Applications to spacetime pattern learning and operant conditioning are then possible, if the conditioning is viewed as multi-channel Pavlovian conditioning in a highly inhomogeneous anatomy. In suitable anatomies, biases in learning because of axon collaterals with nonuniformly distributed diameters can be corrected if one properly couples the action potential to transmitter potentiation, and chooses signal velocity proportional to axon diameter. These anatomies can contain any number of cells. Anatomies exist in which patterns may be learned without their being practiced overtly, whereas persistent recall of old patterns without the learning of newly imposed patterns is impossible. Physiologically, this constraint has the trivial interpretation that signals from one cell to another first pass through the intervening synaptic knob. Mechanisms that control learning rates at times important to the network (e.g., reward and punishment times) can be discussed. Serial behavior like that described by Lashley is possible: this consists of sequential learning and performance of patterns faster than would be allowed by a motor-feedback control, at velocities influenced by arousal level, with the possibility of abrupt termination of performance if conflicting environmental demands arise. Analogs of pattern completion and mass action exist, as do phase transitions in memory (for some rate parameters and anatomies, memory is rigid, for others, it is plastic). The laws limit the ways in which these networks can be interconnected to yield specific discrimination, learning, memory, and recall capabilities.

Topics: Mathematical Foundations of Neural Networks, Applications: Other, Models: Other,

PDF download




Cross References


  1. Embedding fields: A theory of learning with physiological implications
    A learning theory in continuous time is derived herein from simple psychologicalpostulates. The theory has an anatomical and neurophysiological interpretation interms of nerve cell bodies, axons, synaptic knobs, membrane ... Article Details

  2. Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II.
    1. Introduction - This paper describes some networks ..lf that can learn, simultaneously remember,and perform individually upon demand any number of spatiotemporal patterns(e.g., "motor sequences" and "internal perceptual ... Article Details

  3. Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, I.
    1. Introduction. This paper describes some networks 9R that can learn,simultaneously remember, and individually reproduce on demand any numberof spatiotemporal patterns (e.g., "motor sequences") of essentially arbitrary ... Article Details

  4. Some physiological and biochemical consequences of psychological postulates
    This note lists some psychological, physiological, and biochemical predictions that have been derived from simple psychological postu]ates. These psychological postulates have been used to derive a nev learning theory, 1-3 ... Article Details

  5. On learning of spatiotemporal patterns by networks with ordered ordered sensory and motor components, I: Excitatory components of the cerebellum
    Many of our sensory and motor organs have linearly ordered components, for example the fingers on a hand, the tonotopic organization of the auditory system, the successivjeo ints on arms and legs,t he spine,e tc. This paper ... Article Details

  6. On the global limits and oscillations of a system of nonlinear differential equations describing a flow of a probabilistic network
    1. INTRODUCTION: This paper considers various aspects of the global limiting and oscillatorybehavior of the following system of nonlinear differential equations.sx;(t) ... Article Details

  7. On the variational systems of some nonlinear difference-differential equations
    This paper studies the variational systems of two closely related systemsof nonlinear difference-differential equations which arise in prediction- andlearning-theoretical applications ([1], [2], [31). The first system is ... Article Details