Using reinforcement learning to understand the emergence of "intelligent" eye-movement behavior during reading

Psychological Review
Erik D Reichle, Patryk A Laurent

Abstract

The eye movements of skilled readers are typically very regular (K. Rayner, 1998). This regularity may arise as a result of the perceptual, cognitive, and motor limitations of the reader (e.g., limited visual acuity) and the inherent constraints of the task (e.g., identifying the words in their correct order). To examine this hypothesis, reinforcement learning was used to allow an artificial "agent" to learn to move its eyes to read as efficiently as possible. The resulting patterns of simulated eye movements resembled those of skilled readers and suggest that important aspects of eye-movement behavior might emerge as a consequence of satisfying the constraints that are imposed on readers. These results also suggest novel interpretations of some contentious empirical results, such as the fixation duration costs associated with word skipping (R. Kliegl & R. Engbert, 2005), and theoretical assumptions, for example the familiarity check in the E-Z Reader model of eye-movement control (E. D. Reichle, A. Pollatsek, D. L. Fisher, & K. Rayner, 1998).

References

Oct 26, 1979·Science·K Rayner, J H Bertera
Jan 1, 1979·Vision Research·W Becker, R Jürgens
Jan 1, 1976·Vision Research·K Rayner, G W McConkie
May 1, 1991·Journal of Experimental Psychology. Human Perception and Performance·A W Inhoff
May 1, 1990·Journal of Experimental Psychology. Learning, Memory, and Cognition·J M Henderson, F Ferreira
Feb 1, 1989·The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology·A W InhoffK Rayner
Oct 1, 1989·Journal of the Optical Society of America. A, Optics and Image Science·T Ishida, M Ikeda
Feb 1, 1986·Journal of Experimental Psychology. Human Perception and Performance·A Treisman, J Souther
Aug 1, 1986·Perception & Psychophysics·A PollatsekD A Balota
Dec 1, 1986·Perception & Psychophysics·A W Inhoff, K Rayner
Jul 1, 1980·Psychological Review·M A Just, P A Carpenter
Mar 14, 1997·Science·W SchultzP R Montague
Jan 1, 1997·Vision Research·J M Wolfe, S C Bennett
Feb 5, 1998·Psychological Review·E D ReichleK Rayner
Nov 9, 1987·Physical Review Letters·C Chenais-Popovicsa O Willi
May 14, 1999·Experimental Brain Research·A Mokler, B Fischer
Jan 29, 2000·The European Journal of Neuroscience·Y Mouchetant-RostaingJ Pernier
Aug 1, 2000·Vision Research·R M McPeekK Nakayama
Dec 15, 2000·Vision Research·D Vergilino, C Beauvillain
Jan 6, 2001·Perception & Psychophysics·A W InhoffK L Shindler
Jun 5, 2001·Journal of Cognitive Neuroscience·R VanRullen, S J Thorpe
Nov 24, 2001·Vision Research·S N Yang, G W McConkie
Jan 18, 2002·Experimental Brain Research·John J Foxe, Gregory V Simpson
Sep 5, 2002·Vision Research·Gordon E LeggeBosco S Tjan
Nov 8, 2002·The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology·Alan KennedyStéphanie Ducrot
Oct 22, 2003·Vision Research·Hye-Won LeeAlberto Ortiz
Nov 19, 2003·Journal of Experimental Psychology. Learning, Memory, and Cognition·Barbara J Juhasz, Keith Rayner
Aug 11, 2004·Journal of Experimental Psychology. Human Perception and Performance·Keith RaynerErik D Reichle
Jun 1, 2005·Vision Research·Antje NuthmannReinhold Kliegl
Jun 11, 2005·Psychonomic Bulletin & Review·Reinhold Kliegl, Ralf Engbert
Nov 3, 2005·Psychological Review·Ralf EngbertReinhold Kliegl
Nov 3, 2005·Psychological Review·Scott A McDonaldRichard C Shillcock
Nov 3, 2005·Journal of Experimental Psychology. Human Perception and Performance·Albrecht W InhoffRalph Radach
Nov 18, 2005·Cognitive Psychology·Alexander PollatsekKeith Rayner

❮ Previous
Next ❯

Citations

Oct 29, 2008·Psychological Review·Gregory J Zelinsky
May 19, 2009·The Quarterly Journal of Experimental Psychology : QJEP·Keith Rayner
Jan 26, 2013·PloS One·Holly S S L Joseph, Simon P Liversedge
Nov 16, 2012·Attention, Perception & Psychophysics·Lihan ChenMichael J Wood
Feb 20, 2013·Acta Psychologica·Stéphanie DucrotBernard Lété
Nov 6, 2008·Brain : a Journal of Neurology·Susanne SchuettJosef Zihl
Dec 5, 2012·Journal of Experimental Psychology. Learning, Memory, and Cognition·Erik D Reichle, Denis Drieghe
Jul 12, 2011·Journal of Memory and Language·Daniel J Acheson, Maryellen C Macdonald
Oct 22, 2008·Neural Networks : the Official Journal of the International Neural Network Society·Patryk A Laurent
Jan 9, 2007·Trends in Cognitive Sciences·Michael K Tanenhaus, Mary Hare
Feb 26, 2013·Cognitive Science·Yanping LiuDing-Guo Gao
Dec 21, 2010·Wiley Interdisciplinary Reviews. Cognitive Science·Keith Rayner, Erik D Reichle
Nov 18, 2005·Cognitive Psychology·Alexander PollatsekKeith Rayner
Sep 24, 2013·Developmental Review : DR·Erik D ReichleKeith Rayner
Jun 2, 2009·Vision Research·Holly S S L JosephKeith Rayner
Jun 18, 2010·Psychological Science·Daniel SmilekJ Allan Cheyne
Aug 26, 2016·International Journal of Language & Communication Disorders·Katie EkbergCaitlin Grenness
Sep 1, 2017·The Quarterly Journal of Experimental Psychology : QJEP·Timothy J Slattery, Mark Yates

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.