How attention can create synaptic tags for the learning of working memories in sequential tasks

PLoS Computational Biology
Jaldert O RomboutsPieter R Roelfsema

Abstract

Intelligence is our ability to learn appropriate responses to new stimuli and situations. Neurons in association cortex are thought to be essential for this ability. During learning these neurons become tuned to relevant features and start to represent them with persistent activity during memory delays. This learning process is not well understood. Here we develop a biologically plausible learning scheme that explains how trial-and-error learning induces neuronal selectivity and working memory representations for task-relevant information. We propose that the response selection stage sends attentional feedback signals to earlier processing levels, forming synaptic tags at those connections responsible for the stimulus-response mapping. Globally released neuromodulators then interact with tagged synapses to determine their plasticity. The resulting learning rule endows neural networks with the capacity to create new working memory representations of task relevant information as persistent activity. It is remarkably generic: it explains how association neurons learn to store task-relevant information for linear as well as non-linear stimulus-response mappings, how they become tuned to category boundaries or analog variables, depe...Continue Reading

References

Feb 1, 1989·Journal of Neurophysiology·S FunahashiP S Goldman-Rakic
Jun 15, 1993·Proceedings of the National Academy of Sciences of the United States of America·M Ahissar, S Hochstein
Feb 6, 1997·Nature·U Frey, R G Morris
Oct 23, 1997·Neural Computation·S Hochreiter, J Schmidhuber
Mar 28, 1998·Science·M P Kilgard, M M Merzenich
Jun 17, 1998·Proceedings of the National Academy of Sciences of the United States of America·S M Sherman, R W Guillery
Aug 8, 2001·Psychological Review·M Usher, J L McClelland
Jan 5, 2002·The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology·Y Jiang, M M Chun
Jul 23, 2002·Nature Neuroscience·Alexei A KoulakovJohn E Lisman
Oct 9, 2002·Nature Neuroscience·Ranulfo RomoCarlos D Brody
Oct 18, 2002·Neuron·Wolfram Schultz
Oct 18, 2002·Neuron·Peter Dayan, Bernard W Balleine
Nov 15, 2002·Nature·Alexei V EgorovAngel A Alonso
Jan 24, 2003·Nature·Tirin Moore, Katherine M Armstrong
Mar 4, 2003·Nature Reviews. Neuroscience·Ranulfo Romo, Emilio Salinas
Jul 12, 2003·Science·Kenji MatsumotoKeiji Tanaka
Jan 13, 2004·Neuron·Ranulfo RomoAntonio Zainos
Oct 16, 2004·Nature·P Read MontagueJonathan D Cohen
Feb 19, 2005·Science·Christian K MachensCarlos D Brody
Feb 22, 2005·Neuron·Stefano FusiL F Abbott
Aug 18, 2005·Neural Computation·Pieter R Roelfsema, Arjen van Ooyen
Nov 29, 2005·Science·Kazuyuki SamejimaMinoru Kimura
Dec 24, 2005·Proceedings of the National Academy of Sciences of the United States of America·Paul Miller, Xiao-Jing Wang
Jan 21, 2006·Journal of Neurophysiology·Okihide HikosakaHiroyuki Nakahara
Apr 25, 2006·Nature·Camillo Padoa-Schioppa, John A Assad
Jun 13, 2006·Nature Neuroscience·Chung-Chuan Lo, Xiao-Jing Wang
Jul 25, 2006·Nature Neuroscience·Genela MorrisHagai Bergman
Aug 29, 2006·Nature·David J Freedman, John A Assad
Dec 15, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Mark D HumphriesKevin N Gurney
Apr 10, 2007·Annual Review of Neuroscience·Jonathan D Wallis
Jun 5, 2007·Nature·Tianming Yang, Michael N Shadlen
Jun 30, 2007·Annual Review of Neuroscience·Wolfram Schultz
Jun 30, 2007·Annual Review of Neuroscience·Joshua I Gold, Michael N Shadlen
Feb 8, 2008·Neural Computation·Christopher ParisienChris Eliasmith

❮ Previous
Next ❯

Citations

Oct 7, 2015·Frontiers in Neural Circuits·Andrew Y Y Tan
Mar 6, 2015·PLoS Computational Biology·Jaldert O RomboutsPieter R Roelfsema
Jun 9, 2016·Cerebral Cortex·Chris van der TogtPieter R Roelfsema
Sep 30, 2016·Frontiers in Computational Neuroscience·Adam H MarblestoneKonrad P Kording
Jan 9, 2017·Trends in Cognitive Sciences·Thomas B ChristophelJohn-Dylan Haynes
Sep 26, 2015·PLoS Computational Biology·Greg JensenHerbert S Terrace
Oct 27, 2015·PLoS Computational Biology·Tobias BroschPieter R Roelfsema
Feb 17, 2018·Nature Reviews. Neuroscience·Pieter R Roelfsema, Anthony Holtmaat
Aug 16, 2018·Nature Reviews. Neuroscience·Pieter R Roelfsema, Anthony Holtmaat
Jan 13, 2019·Nature Communications·Mariann OemischThilo Womelsdorf
Aug 21, 2019·Frontiers in Computational Neuroscience·Jakob JordanAbigail Morrison
Aug 24, 2017·Scientific Reports·Devavrat VartakPieter R Roelfsema
Aug 1, 2018·Frontiers in Computational Neuroscience·Marco MartinolliAditya Gilra
Oct 21, 2020·Neural Computation·Wouter KruijneChristian N L Olivers
Sep 7, 2020·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Christian N L Olivers, Pieter R Roelfsema
Mar 7, 2020·Neuron·George A MashourStanislas Dehaene
Mar 9, 2021·Frontiers in Neuroscience·Shuangming YangBernabe Linares-Barranco
Jun 9, 2018·Current Opinion in Neurobiology·Adil G Khan, Sonja B Hofer
Jun 7, 2021·Neural Networks : the Official Journal of the International Neural Network Society·Xiaohan LinYuanyuan Mi
Aug 2, 2021·Seminars in Cell & Developmental Biology·Ronan ChéreauAnthony Holtmaat

❮ Previous
Next ❯

Software Mentioned

AuGMEnT ( MEmory Tagging )
Leabra
PBMW
AuGMEnt
SARSA
sTrace
LSTM
PBWM

Related Concepts

Related Feeds

Basal Forebrain- Circuits

Basal forebrain is a region in the brain important for production of acetylcholine and is the major cholinergic output of the CNS. Discover the latest research on circuits in the basal forebrain here.

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

Barrel cortex

Here is the latest research on barrel cortex, a region of somatosensory and motor corticies in the brain, which are used by animals that rely on whiskers for world exploration.

Related Papers

Trends in Cognitive Sciences
Pieter R RoelfsemaTakeo Watanabe
Frontiers in Synaptic Neuroscience
Rylan S LarsenBenjamin D Philpot
Annals of the New York Academy of Sciences
Barry GiesbrechtSøren Kyllingsbaek
Trends in Cognitive Sciences
Aaron Seitz, Takeo Watanabe
© 2022 Meta ULC. All rights reserved