+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

The effect of novelty on reinforcement learning



The effect of novelty on reinforcement learning



Progress in Brain Research 202: 415-439



Recent research suggests that novelty has an influence on reward-related learning. Here, we showed that novel stimuli presented from a pre-familiarized category can accelerate or decelerate learning of the most rewarding category, depending on the condition. The extent of this influence depended on the individual trait of novelty seeking. Different reinforcement learning models were developed to quantify subjects' choices. We introduced a bias parameter to model explorative behavior toward novel stimuli and characterize individual variation in novelty response. The theoretical framework allowed us to test different assumptions, concerning the motivational value of novelty. The best fitting-model combined all novelty components and had a significant positive correlation with both the experimentally measured novelty bias and the independent novelty-seeking trait. Altogether, we have not only shown that novelty by itself enhances behavioral responses underlying reward processing, but also that novelty has a direct influence on reward-dependent learning processes, consistently with computational predictions.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 056307555

Download citation: RISBibTeXText

PMID: 23317843

DOI: 10.1016/b978-0-444-62604-2.00021-6


Related references

Novelty and Inductive Generalization in Human Reinforcement Learning. Topics in Cognitive Science 7(3): 391-415, 2015

The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural Networks 21(10): 1493-1499, 2008

Association between locomotor response to novelty and light reinforcement: sensory reinforcement as a rodent model of sensation seeking. Behavioural Brain Research 230(2): 380-388, 2012

The effect of type of reinforcement, form of reinforcement, and orientation upon a visual-motor learning task. Diss Abstr 25(3): 2075, 1964

The effect of pornography on penile tumescence as a function of reinforcement and novelty. Behavior Therapy 8(5): 938-946, 1977

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis. European Journal of Neuroscience 35(7): 1024-1035, 2012

Reinforcement Learning with Limited Reinforcement: Using Bayes Risk for Active Learning in POMDPs. Proceedings of the .. International Conference on Machine Learning. International Conference on Machine Learning 301: 256-263, 2008

Effects of signaled reward in instrumental conditioning enhanced learning on differential reinforcement of low rates and differential reinforcement of high rates schedules of reinforcement. Animal Learning & Behavior 13(1): 6-12, 1985

Partial reinforcement and two functions of reward and secondary reinforcement in discrimination learning set in the monkey. Dissertation Absts: 1831, 1959

Reinforcement in Discrimination Learning: with Special Attention to the Effects of Delayed Reinforcement. Journal of Genetic Psychology 104: 225-233, 1964

Model-based reinforcement learning under concurrent schedules of reinforcement in rodents. Learning and Memory 16(5): 315-323, 2009

Maze learning in the absence of primary reinforcement; a study of secondary reinforcement. Journal of Comparative and Physiological Psychology 42(3): 161-173, 1949

The intercalated reinforcement technique learning without differential total reinforcement between groups. Behavior Research Methods 5(4): 337-339, 1973

Simulation of rat behavior by a reinforcement learning algorithm in consideration of appearance probabilities of reinforcement signals. Bio Systems 80(1): 83-90, 2005

Reinforcement effects of food and stimulus novelty. Psychol Rec 18(2): 253-260, 1968