+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Imaginative Reinforcement Learning: Computational Principles and Neural Mechanisms



Imaginative Reinforcement Learning: Computational Principles and Neural Mechanisms



Journal of Cognitive Neuroscience 29(12): 2103-2113



Imagination enables us not only to transcend reality but also to learn about it. In the context of reinforcement learning, an agent can rationally update its value estimates by simulating an internal model of the environment, provided that the model is accurate. In a series of sequential decision-making experiments, we investigated the impact of imaginative simulation on subsequent decisions. We found that imagination can cause people to pursue imagined paths, even when these paths are suboptimal. This bias is systematically related to participants' optimism about how much reward they expect to receive along imagined paths; providing feedback strongly attenuates the effect. The imagination effect can be captured by a reinforcement learning model that includes a bonus added onto imagined rewards. Using fMRI, we show that a network of regions associated with valuation is predictive of the imagination effect. These results suggest that imagination, although a powerful tool for learning, is also susceptible to motivational biases.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 059830343

Download citation: RISBibTeXText

PMID: 28707569

DOI: 10.1162/jocn_a_01170


Related references

Reinforcement learning: Computational theory and biological mechanisms. Hfsp Journal 1(1): 30-40, 2007

Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. Cerebral Cortex 22(3): 509-526, 2012

Human learning improves machine learning: neural and computational mechanisms of perceptual training. Journal of Neuroscience 31(11): 3937-3938, 2011

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis. European Journal of Neuroscience 35(7): 1024-1035, 2012

Learning to minimize efforts versus maximizing rewards: computational principles and neural correlates. Journal of Neuroscience 34(47): 15621-15630, 2014

Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder. Brain 140(4): 1147-1157, 2017

Collective computational properties of neural networks: New learning mechanisms. Physical Review. A General Physics 34(5): 4217-4228, 1986

Computational Modeling of Fear Extinction Learning in PTSD: Cognitive and Neural Mechanisms. Biological Psychiatry 81(10): S235-S236, 2017

A biologically plausible computational model of meta learning in reinforcement learning. Society for Neuroscience Abstract Viewer & Itinerary Planner : Abstract No 283 20, 2002

Beyond simple reinforcement learning: the computational neurobiology of reward-learning and valuation. European Journal of Neuroscience 35(7): 987-990, 2012

Linking Individual Learning Styles to Approach-Avoidance Motivational Traits and Computational Aspects of Reinforcement Learning. Plos one 11(11): E0166675, 2016

The Computational Development of Reinforcement Learning during Adolescence. Plos Computational Biology 12(6): E1004953, 2016

Schizophrenia: a computational reinforcement learning perspective. Schizophrenia Bulletin 34(6): 1008-1011, 2008

Sensory Learning: From Neural Mechanisms to Rehabilitation || Neural Mechanisms of Recovery following Early Visual Deprivation. Philosophical Transactions Biological Sciences 364(1515): 383-398, 2009

Reinforcement learning in depression: A review of computational research. Neuroscience and Biobehavioral Reviews 55: 247-267, 2015