Collecting reward to defend homeostasis: A homeostatic reinforcement learning theory

BioRxiv : the Preprint Server for Biology
Mehdi Keramati, Boris Gutkin

Abstract

Efficient regulation of internal homeostasis and defending it against perturbations requires complex behavioral strategies. However, the computational principles mediating brain’s homeostatic regulation of reward and associative learning remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behavior is modulated by the internal state of the animal. The theory proves that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further give a formal basis for temporal discounting of reward. It also explains how animals learn to act predictively to preclude prospective homeostatic challenges, and attributes a normative computational role to the modulation of midbrain dopaminergic activity by hypothalamic signals.

Related Concepts

Learning
Motivation
Physiological Aspects
Rewards
Challenge
Regulation of Biological Process
Dopaminergic Neurons
Definition
Regulation of Homeostatic Process

Related Feeds

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.

Amygdala and Midbrain Dopamine

The midbrain dopamine system is widely studied for its involvement in emotional and motivational behavior. Some of these neurons receive information from the amygdala and project throughout the cortex. When the circuit and transmission of dopamine is disrupted symptoms may present. Here is the latest research on the amygdala and midbrain dopamine.

Related Papers

Archives of Facial Plastic Surgery
G Richard Holt
American Journal of Transplantation : Official Journal of the American Society of Transplantation and the American Society of Transplant Surgeons
J S Taylor, A Spital
© 2021 Meta ULC. All rights reserved