Rational and mechanistic perspectives on reinforcement learning

Cognition
Nick Chater

Abstract

This special issue describes important recent developments in applying reinforcement learning models to capture neural and cognitive function. But reinforcement learning, as a theoretical framework, can apply at two very different levels of description: mechanistic and rational. Reinforcement learning is often viewed in mechanistic terms--as describing the operation of aspects of an agent's cognitive and neural machinery. Yet it can also be viewed as a rational level of description, specifically, as describing a class of methods for learning from experience, using minimal background knowledge. This paper considers how rational and mechanistic perspectives differ, and what types of evidence distinguish between them. Reinforcement learning research in the cognitive and brain sciences is often implicitly committed to the mechanistic interpretation. Here the opposite view is put forward: that accounts of reinforcement learning should apply at the rational level, unless there is strong evidence for a mechanistic interpretation. Implications of this viewpoint for reinforcement-based theories in the cognitive and brain sciences are discussed.

References

Feb 1, 1990·Cognition·C R Gallistel, R Gelman
Nov 1, 1973·Journal of Experimental Psychology·M E Dawson, M A Biferno
Apr 1, 1970·Journal of Experimental Psychology·P E Baer, M J Fuhrer
Oct 1, 1970·Journal of Experimental Psychology·D M Colgan
Mar 1, 1968·Journal of Experimental Psychology·G D Wilson
May 1, 1969·Journal of Experimental Psychology·W F Prokasy, C K Allen
Mar 1, 1981·Psychological Review·R S Sutton, A G Barto
Oct 1, 1980·Journal of Experimental Psychology. Animal Behavior Processes·R A Rescorla, D J Gillan
Mar 14, 1997·Science·W SchultzP R Montague
Nov 27, 1999·Science·M S JogA M Graybiel
Jun 9, 2000·Annual Review of Neuroscience·W Schultz, A Dickinson
Mar 1, 2002·Journal of Experimental Psychology. Animal Behavior Processes·Peter F Lovibond, David R Shanks
Aug 17, 2002·Cerebral Cortex·Frank A Middleton, Peter L Strick
Mar 12, 2003·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Nick Chater
Mar 13, 2003·Cerebral Cortex·Simon Killcross, Etienne Coutureau
Apr 30, 2003·Neuron·Samuel M McClureP Read Montague
May 23, 2003·Journal of Experimental Psychology. Human Perception and Performance·Nick Yeung, Stephen Monsell
Jan 1, 1959·Journal of Experimental Psychology·R H LINDLEY
May 1, 1965·Journal of Experimental Psychology·W H BRIDGER, I J MANDEL
Dec 4, 2003·Behavioural Brain Research·Etienne Coutureau, Simon Killcross
Feb 6, 2004·Psychological Review·Alison GopnikDavid Danks
Apr 17, 2004·Science·John O'DohertyRaymond J Dolan
Aug 28, 2004·Proceedings of the National Academy of Sciences of the United States of America·Charles R GallistelPeter Balsam
Oct 16, 2004·Science·Samuel M McClureJonathan D Cohen
Sep 20, 2005·Cognitive Psychology·Thomas L Griffiths, Joshua B Tenenbaum
Jun 17, 2006·Nature·Nathaniel D DawRaymond J Dolan
Jun 24, 2006·Trends in Cognitive Sciences·Aaron C CourvilleDavid S Touretzky
Jul 25, 2006·Nature Neuroscience·Genela MorrisHagai Bergman
Jul 28, 2006·Nature Neuroscience·Yael NivPeter Dayan
Aug 30, 2006·Journal of Experimental Psychology. Learning, Memory, and Cognition·Pierre PerruchetArnaud Destrebecqz
Aug 30, 2006·Neural Networks : the Official Journal of the International Neural Network Society·Peter DayanNathaniel D Daw
Jan 5, 2007·Journal of Experimental Psychology. Learning, Memory, and Cognition·Gordy PleyersVincent Yzerbyt
Feb 6, 2007·Trends in Cognitive Sciences·William A Cunningham, Philip David Zelazo
Apr 24, 2009·The Behavioral and Brain Sciences·Chris J MitchellPeter F Lovibond

❮ Previous
Next ❯

Citations

Jul 26, 2015·Neuroscience and Biobehavioral Reviews·Oren Kolodny, Shimon Edelman
Oct 13, 2009·Cognition·Nathaniel D Daw, Michael J Frank
Dec 2, 2015·Memory & Cognition·Momme von SydowBjörn Meder
Aug 22, 2015·Cognitive Science·Andrew HowesRichard L Lewis
Sep 8, 2010·Pain·Luana CollocaFabrizio Benedetti
Oct 27, 2015·PloS One·Nisheeth Srivastava, Paul Schrater
Jul 8, 2020·Psychonomic Bulletin & Review·Jana B JareckiMirjam A Jenny
Dec 21, 2020·Brain and Cognition·Joana CarvalheiroAna Seara-Cardoso
Feb 14, 2019·Frontiers in Robotics and AI·Günther Palm, Friedhelm Schwenker

❮ Previous
Next ❯

Related Concepts

Related Feeds

Allergy and Asthma

Allergy and asthma are inflammatory disorders that are triggered by the activation of an allergen-specific regulatory t cell. These t cells become activated when allergens are recognized by allergen-presenting cells. Here is the latest research on allergy and asthma.

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

© 2022 Meta ULC. All rights reserved