Acetylcholine-based entropy in response selection: a model of how striatal interneurons modulate exploration, exploitation, and response variability in decision-making.

Frontiers in Neuroscience
Andrea Stocco

Abstract

The basal ganglia play a fundamental role in decision-making. Their contribution is typically modeled within a reinforcement learning framework, with the basal ganglia learning to select the options associated with highest value and their dopamine inputs conveying performance feedback. This basic framework, however, does not account for the role of cholinergic interneurons in the striatum, and does not easily explain certain dynamic aspects of decision-making and skill acquisition like the generation of exploratory actions. This paper describes basal ganglia acetylcholine-based entropy (BABE), a model of the acetylcholine system in the striatum that provides a unified explanation for these phenomena. According to this model, cholinergic interneurons in the striatum control the level of variability in behavior by modulating the number of possible responses that are considered by the basal ganglia, as well as the level of competition between them. This mechanism provides a natural way to account for the role of basal ganglia in generating behavioral variability during the acquisition of certain cognitive skills, as well as for modulating exploration and exploitation in decision-making. Compared to a typical reinforcement learning...Continue Reading

Citations

Jun 17, 2014·British Journal of Pharmacology·Vincent LaurentBernard W Balleine
Apr 25, 2014·British Journal of Pharmacology·Vincent LaurentBernard W Balleine
Dec 17, 2014·Neuropharmacology·Jérémie NaudéPhilippe Faure
May 16, 2018·Nature Neuroscience·Joshua D Berke
Jun 8, 2021·Frontiers in Neural Circuits·Daniel EskenaziNao Chuhma

❮ Previous
Next ❯

Software Mentioned

FROST

Related Concepts

Related Feeds

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

Related Papers

Brain Research. Cognitive Brain Research
Daeyeol LeeDominic J Barraclough
Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences
Hyojung Seo, Daeyeol Lee
© 2022 Meta ULC. All rights reserved