Nov 9, 2018

Prefrontal cortex creates novel navigation sequences from hippocampal place-cell replay with spatial reward propagation

BioRxiv : the Preprint Server for Biology
Nicolas CazinPeter Ford Dominey

Abstract

As rats learn to search for multiple sources of food or water in a complex environment, they generate increasingly efficient trajectories between reward sites, across multiple trials. This optimization capacity has been characterized in the Traveling Salesrat Problem (TSP) (de Jong et al (2011). Such spatial navigation capacity involves the replay of hippocampal place-cells during awake states, generating small sequences of spatially related place-cell activity that we call “snippets”. These snippets occur primarily during sharp-wave-ripple (SWR) events. Here we focus on the role of replay during the awake state, as the animal is learning across multiple trials. We hypothesize that snippet replay generates synthetic data that can substantially expand and restructure the experience available to make PFC learning more optimal. We developed a model of snippet generation that is modulated by reward, propagated in the forward and reverse directions. This implements a form of spatial credit assignment for reinforcement learning. We use a biologically motivated computational framework known as ‘reservoir computing’ to model PFC in sequence learning, in which large pools of prewired neural elements process information dynamically throu...Continue Reading

  • References
  • Citations

References

  • We're still populating references for this paper, please check back later.
  • References
  • Citations

Citations

  • This paper may not have been cited yet.

Mentioned in this Paper

Place Cells
Prefrontal Cortex
Food
Environment
Site
Reverberation
Clinical Trials
Patient Navigation
Prefrontal Cortex (Walker)
Orientation (spatial)

About this Paper

Related Feeds

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.