+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

A neural-network reinforcement-learning model of domestic chicks that learn to localize the centre of closed arenas



A neural-network reinforcement-learning model of domestic chicks that learn to localize the centre of closed arenas



Philosophical Transactions of the Royal Society of London. Series B Biological Sciences 362(1479): 383-401



Previous experiments have shown that when domestic chicks (Gallus gallus) are first trained to locate food elements hidden at the centre of a closed square arena and then are tested in a square arena of double the size, they search for food both at its centre and at a distance from walls similar to the distance of the centre from the walls experienced during training. This paper presents a computational model that successfully reproduces these behaviours. The model is based on a neural-network implementation of the reinforcement-learning actor - critic architecture (in this architecture the 'critic' learns to evaluate perceived states in terms of predicted future rewards, while the 'actor' learns to increase the probability of selecting the actions that lead to higher evaluations). The analysis of the model suggests which type of information and cognitive mechanisms might underlie chicks' behaviours: (i) the tendency to explore the area at a specific distance from walls might be based on the processing of the height of walls' horizontal edges, (ii) the capacity to generalize the search at the centre of square arenas independently of their size might be based on the processing of the relative position of walls' vertical edges on the horizontal plane (equalization of walls' width), and (iii) the whole behaviour exhibited in the large square arena can be reproduced by assuming the existence of an attention process that, at each time, focuses chicks' internal processing on either one of the two previously discussed information sources. The model also produces testable predictions regarding the generalization capabilities that real chicks should exhibit if trained in circular arenas of varying size. The paper also highlights the potentialities of the model to address other experiments on animals' navigation and analyses its strengths and weaknesses in comparison to other models.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 012938249

Download citation: RISBibTeXText

PMID: 17255019

DOI: 10.1098/rstb.2006.1966


Related references

The Use of Artificial Neural Networks to Study Perception in Animals || A Neural-Network Reinforcement-Learning Model of Domestic Chicks That Learn to Localize the Centre of Closed Arenas. Philosophical Transactions Biological Sciences 362(1479): 383-401, 2007

Synaptic plasticity model of a spiking neural network for reinforcement learning. Neurocomputing 71(13-15): 3037-3043, 2008

A spiking neural network model of model-free reinforcement learning with high-dimensional sensory input and perceptual ambiguity. Plos one 10(3): E0115620, 2015

Reinforcement learning of songbird premotor representations in a spiking neural network model. Society for Neuroscience Abstract Viewer & Itinerary Planner : Abstract No 680 1, 2002

A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Brain Research. Cognitive Brain Research 1(1): 3-38, 1992

Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental Brain Research. 121(3): 350-354,., 1998

A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning. Plos Computational Biology 14(1): E1005925, 2018

A model to explain the emergence of reward expectancy neurons using reinforcement learning and neural network. Neurocomputing 69(10-12): 1327-1331, 2006

The role of basal ganglia in reinforcement learning and imprinting in domestic chicks. Neuroreport 12(8): 1743-1747, 2001

Basal ganglia of domestic chicks is critical for reinforcement learning Coding of evaluation and anticipation. Society for Neuroscience Abstracts 27(2): 1985, 2001

An illness induced conditioned aversion in domestic chicks 1 trial learning with a long delay of reinforcement. Behavioral Biology 20(4): 441-453, 1977

An illness-induced conditioned aversion in domestic chicks: one-trial learning with a long delay of reinforcement. Behavioral Biology 20(4): 441-453, 1977

A neural network-like critic for reinforcement learning. Neural Networks 8(3): 363-373, 1995

Prespeech motor learning in a neural network using reinforcement. Neural Networks 38: 64-75, 2013

A layered network model of associative learning: learning to learn and configuration. Psychological Review 95(4): 411-433, 1988