Correlates of reward-predictive value in learning-related hippocampal neural activity.

Hippocampus
Murat Okatan

Abstract

Temporal difference learning (TD) is a popular algorithm in machine learning. Two learning signals that are derived from this algorithm, the predictive value and the prediction error, have been shown to explain changes in neural activity and behavior during learning across species. Here, the predictive value signal is used to explain the time course of learning-related changes in the activity of hippocampal neurons in monkeys performing an associative learning task. The TD algorithm serves as the centerpiece of a joint probability model for the learning-related neural activity and the behavioral responses recorded during the task. The neural component of the model consists of spiking neurons that compete and learn the reward-predictive value of task-relevant input signals. The predictive-value signaled by these neurons influences the behavioral response generated by a stochastic decision stage, which constitutes the behavioral component of the model. It is shown that the time course of the changes in neural activity and behavioral performance generated by the model exhibits key features of the experimental data. The results suggest that information about correct associations may be expressed in the hippocampus before it is dete...Continue Reading

References

Jan 1, 1992·Journal of Neurophysiology·T LjungbergW Schultz
Feb 1, 1989·Journal of Neurophysiology·S FunahashiP S Goldman-Rakic
Oct 1, 1988·The Pediatric Infectious Disease Journal·J Siegel
Jan 1, 1988·Biological cybernetics·E S ChornoboyA F Karr
Mar 1, 1981·Psychological Review·R S Sutton, A G Barto
Dec 1, 1994·Journal of Animal Science·B F Sappington, L Goldman
Aug 20, 1993·Science·M A Wilson, B L McNaughton
Jan 1, 1993·Annual Review of Psychology·L R SquireG Musen
Mar 14, 1997·Science·W SchultzP R Montague
Aug 5, 1997·Proceedings of the National Academy of Sciences of the United States of America·M R MehtaB L McNaughton
Jul 11, 1998·Journal of Neurophysiology·W Schultz
Oct 8, 1999·Behavioural Brain Research·H Eichenbaum
Mar 20, 2001·Neural Computation·R E Suri, W Schultz
Mar 22, 2001·Nature Reviews. Neuroscience·W Schultz
Oct 11, 2001·Proceedings of the National Academy of Sciences of the United States of America·E N BrownV Solo
Feb 8, 2002·Neuron·György Buzsáki
Nov 26, 2002·Trends in Neurosciences·David Attwell, Costantino Iadecola
Apr 30, 2003·Neuron·John P O'DohertyRaymond J Dolan
Apr 30, 2003·Neuron·Samuel M McClureP Read Montague
Jun 12, 2003·Behavioural Brain Research·Christian HölscherHanspeter A Mallot
Jun 14, 2003·Neural Computation·Anne C Smith, Emery N Brown
Jan 16, 2004·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Anne C SmithEmery N Brown
Mar 9, 2004·Nature Neuroscience·Dominic J BarracloughDaeyeol Lee
May 25, 2004·The Neuroscientist : a Review Journal Bringing Neurobiology, Neurology and Psychiatry·Samuel M McClureP Read Montague
Jun 11, 2004·Nature·Ben SeymourRichard S Frackowiak
Jul 6, 2004·Nature Neuroscience·Saori C TanakaShigeto Yamawaki
Oct 16, 2004·Nature·P Read MontagueJonathan D Cohen
May 5, 2005·Canadian Journal of Community Mental Health = Revue Canadienne De Santé Mentale Communautaire·Andrea Daley
Jun 15, 2005·Behavioral and Brain Functions : BBF·Yael NivPeter Dayan

❮ Previous
Next ❯

Citations

Mar 1, 2012·Biological Psychiatry·Mauricio R Delgado, Kathryn C Dickerson
Jun 19, 2015·NeuroImage·Dominic S FareriNim Tottenham
Jun 10, 2015·Cognitive, Affective & Behavioral Neuroscience·Kathryn C Dickerson, Mauricio R Delgado
Mar 14, 2014·Frontiers in Behavioral Neuroscience·Lisa BulganinBianca C Wittmann

❮ Previous
Next ❯

Software Mentioned

Matlabcode
Matlab

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Behavioural Brain Research
Christian HölscherHanspeter A Mallot
Neural Networks : the Official Journal of the International Neural Network Society
Adam Johnson, A David Redish
Current Opinion in Neurobiology
Adam JohnsonA David Redish
© 2021 Meta ULC. All rights reserved