+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Learning of sequential movements by neural network model with dopamine-like reinforcement signal



Learning of sequential movements by neural network model with dopamine-like reinforcement signal



Experimental Brain Research 121(3): 350-354,.



Dopamine neurons appear to code an error in the prediction of reward. They are activated by unpredicted rewards, are not influenced by predicted rewards, and are depressed when a predicted reward is omitted. After conditioning, they respond to reward-predicting stimuli in a similar manner. With these characteristics, the dopamine response strongly resembles the predictive reinforcement teaching signal of neural network models implementing the temporal difference learning algorithm. This study explored a neural network model that used a reward-prediction error signal strongly resembling dopamine responses for learning movement sequences. A different stimulus was presented in each step of the sequence and required a different movement reaction, and reward occur-red at the end of the correctly performed sequence. The dopamine-like predictive reinforcement signal efficiently allowed the model to learn long sequences. By contrast, learning with an unconditional reinforcement signal required synaptic eligibility traces of longer and biologically less-plausible durations for obtaining satisfactory performance. Thus, dopamine-like neuronal signals constitute excellent teaching signals for learning sequential behavior.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 008949251

Download citation: RISBibTeXText

PMID: 9746140

DOI: 10.1007/s002210050467


Related references

A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91(3): 871-890, 1999

Synaptic plasticity model of a spiking neural network for reinforcement learning. Neurocomputing 71(13-15): 3037-3043, 2008

The Use of Artificial Neural Networks to Study Perception in Animals || A Neural-Network Reinforcement-Learning Model of Domestic Chicks That Learn to Localize the Centre of Closed Arenas. Philosophical Transactions Biological Sciences 362(1479): 383-401, 2007

A spiking neural network model of model-free reinforcement learning with high-dimensional sensory input and perceptual ambiguity. Plos one 10(3): E0115620, 2015

A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Brain Research. Cognitive Brain Research 1(1): 3-38, 1992

Reinforcement learning of songbird premotor representations in a spiking neural network model. Society for Neuroscience Abstract Viewer and Itinerary Planner : Abstract No 680 1, 2002

The temporal-spatial properties of LIP neurons for sequential eye movements simulated in a neural network model. Society for Neuroscience Abstracts 21(1-3): 281, 1995

A model to explain the emergence of reward expectancy neurons using reinforcement learning and neural network. Neurocomputing 69(10-12): 1327-1331, 2006

A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning. Plos Computational Biology 14(1): E1005925, 2018

A neural-network reinforcement-learning model of domestic chicks that learn to localize the centre of closed arenas. Philosophical Transactions of the Royal Society of London. Series B Biological Sciences 362(1479): 383-401, 2007

A neural model of cortico-cerebellar interactions during attentive imitation and predictive learning of sequential handwriting movements. Neural Networks 13(8-9): 999-1046, 2000

Predictive Movements and Human Reinforcement Learning of Sequential Action. Cognitive Science 42(Suppl. 3): 783-808, 2018

Dynamic nonlinear state-space model with a neural network via improved sequential learning algorithm for an online real-time hydrological modeling. Journal of Hydrology 468-469(none), 2012

A neural network-like critic for reinforcement learning. Neural Networks 8(3): 363-373, 1995

Computational models of reinforcement learning: the role of dopamine as a reward signal. Cognitive Neurodynamics 4(2): 91-105, 2010