+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control



Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control



Frontiers in Neural Circuits 8: 126



Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 054585436

Download citation: RISBibTeXText

PMID: 25389391

DOI: 10.3389/fncir.2014.00126


Related references

Involvement of the basal ganglia and dopamine system in learning and execution of goal-directed behavior. Nagatsu, Toshiharu , Reprint Author, Nabeshima, Toshitaka, McCarty, Richard, Goldstein, David S Catecholamine research: From molecular insights to clinical medicine: 377-380, 2002

Reward-Based Learning Drives Rapid Sensory Signals in Medial Prefrontal Cortex and Dorsal Hippocampus Necessary for Goal-Directed Behavior. Neuron 97(1): 83-91.E5, 2018

An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction, and punishment learning. Frontiers in Computational Neuroscience 8: 47, 2014

Considerations upon the anatomical model of reward-based learning in the basal ganglia. Medical Hypotheses 54(3): 397-399, 2000

Focal basal ganglia lesions are associated with impairments in reward-based reversal learning. Brain 131(Pt 3): 829-841, 2008

Vascular Risk Factors and Diseases Modulate Deficits of Reward-Based Reversal Learning in Acute Basal Ganglia Stroke. Plos one 11(5): E0155267, 2016

A spiking neuron model of the cortico-basal ganglia circuits for goal-directed and habitual action learning. Neural Networks 41: 212-224, 2013

The allocation of attention to learning of goal-directed actions: a cognitive neuroscience framework focusing on the Basal Ganglia. Frontiers in Psychology 3: 535, 2012

Involvement of the prelimbic area of the rodent in goal directed behavior and reward devaluation learning. European Journal of Neuroscience 12(Suppl. 11): 84, 2000

Frontostriatal mechanisms in instruction-based learning as a hallmark of flexible goal-directed behavior. Frontiers in Psychology 3: 192, 2012

Reward-Based Exploration: Adaptive Control for Deep Reinforcement Learning. Ieice Transactions on Information and Systems E101.D(9): 2409-2412, 2018

Neural activity in cortico-basal ganglia circuits of juvenile songbirds encodes performance during goal-directed learning. Elife 6:, 2017

The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia. Neuroscience and Biobehavioral Reviews 100: 19-34, 2019

Complementary roles of basal ganglia and cerebellum in learning and motor control. Current Opinion in Neurobiology 10(6): 732-739, 2000

The cerebellum is involved in reward-based reversal learning. Cerebellum 7(3): 433-443, 2008