DOI: 10.1101/499418Dec 17, 2018Paper

Discovery of Hierarchical Representations for Efficient Planning

BioRxiv : the Preprint Server for Biology
Momchil TomovSamuel Gershman

Abstract

We propose that humans spontaneously organize environments into clusters of states that support hierarchical planning, enabling them to tackle challenging problems by breaking them down into sub-problems at various levels of abstraction. People constantly rely on such hierarchical presentations to accomplish tasks big and small – from planning one’s day, to organizing a wedding, to getting a PhD – often succeeding on the very first attempt. We formalize a Bayesian model of hierarchy discovery that explains how humans discover such useful abstractions. Building on principles developed in structure learning and robotics, the model predicts that hierarchy discovery should be sensitive to the topological structure, reward distribution, and distribution of tasks in the environment. In five simulations, we show that the model accounts for previously reported effects of environment structure on planning behavior, such as detection of bottleneck states and transitions. We then test the novel predictions of the model in eight behavioral experiments, demonstrating how the distribution of tasks and rewards can influence planning behavior via the discovered hierarchy, sometimes facilitating and sometimes hindering performance. We find evid...Continue Reading

Related Concepts

Brain
Clinical Trials
Environment
Learning
Persons
Abstract Thinking Ability
Structure
Simulation
Research Study
Phd protein, Enterobacteria phage P1

Related Feeds

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.

Related Papers

Annals of the New York Academy of Sciences
H H Field
PLoS Computational Biology
Daniel E Acuña, Paul Schrater
Healthcare Financial Management : Journal of the Healthcare Financial Management Association
E A Kazemek
Health Management Quarterly : HMQ
R A Berman
© 2021 Meta ULC. All rights reserved