+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning



From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning



Psychological Science 27(6): 848-858



Theoretical models distinguish two decision-making strategies that have been formalized in reinforcement-learning theory. A model-based strategy leverages a cognitive model of potential actions and their consequences to make goal-directed choices, whereas a model-free strategy evaluates actions based solely on their reward history. Research in adults has begun to elucidate the psychological mechanisms and neural substrates underlying these learning processes and factors that influence their relative recruitment. However, the developmental trajectory of these evaluative strategies has not been well characterized. In this study, children, adolescents, and adults performed a sequential reinforcement-learning task that enabled estimation of model-based and model-free contributions to choice. Whereas a model-free strategy was apparent in choice behavior across all age groups, a model-based strategy was absent in children, became evident in adolescents, and strengthened in adults. These results suggest that recruitment of model-based valuation systems represents a critical cognitive component underlying the gradual maturation of goal-directed behavior.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 057901801

Download citation: RISBibTeXText

PMID: 27084852

DOI: 10.1177/0956797616639301


Related references

Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning. Journal of Neuroscience 37(11): 3009-3017, 2017

Goal-directed behaviours by reinforcement learning. Neurocomputing 28(1-3): 107-125, 1999

Model-Based Reinforcement Learning for Infinite-Horizon Approximate Optimal Tracking. IEEE Transactions on Neural Networks and Learning Systems 28(3): 753-758, 2017

Goal-directed EEG activity evoked by discriminative stimuli in reinforcement learning. Psychophysiology 52(2): 238-248, 2015

Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. American Journal of Psychiatry 168(7): 718-726, 2011

Effects of psychosocial stress on the goal-directed and habit memory systems during learning and later execution. Psychoneuroendocrinology 77: 275-283, 2017

Computational Properties of the Hippocampus Increase the Efficiency of Goal-Directed Foraging through Hierarchical Reinforcement Learning. Frontiers in Computational Neuroscience 10: 128, 2016

Reinforcement learning of goal-directed obstacle-avoiding reaction strategies in an autonomous mobile robot. Robotics and Autonomous Systems 15(4): 275-299, 1995

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control. Frontiers in Neural Circuits 8: 126, 2014

Habit, Attitude, and Planned Behaviour: Is Habit an Empty Construct or an Interesting Case of Goal-directed Automaticity?. European Review of Social Psychology 10(1): 101-134, 1999

The "proactive" model of learning: Integrative framework for model-free and model-based reinforcement learning utilizing the associative learning-based proactive brain concept. Behavioral Neuroscience 130(1): 6, 2016

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Journal of Neuroscience 27(47): 12860-7, 2007

Reinforcement learning design-based adaptive tracking control with less learning parameters for nonlinear discrete-time MIMO systems. IEEE Transactions on Neural Networks and Learning Systems 26(1): 165-176, 2015

The effect of partial reinforcement on the acquisition and extinction of sign tracking and goal tracking in the rat. Bulletin of the Psychonomic Society 19(2): 115-118, 1982

Goal direction orientation, generalized turning habit, and goal gradient as factors in maze learning in the rat. Journal of Comparative Psychology 17(2): 225-232, 1934