Reinforcement learning for adaptive threshold control of restorative brain-computer interfaces: a Bayesian simulation

Frontiers in Neuroscience
Robert Bauer, Alireza Gharabaghi

Abstract

Restorative brain-computer interfaces (BCI) are increasingly used to provide feedback of neuronal states in a bid to normalize pathological brain activity and achieve behavioral gains. However, patients and healthy subjects alike often show a large variability, or even inability, of brain self-regulation for BCI control, known as BCI illiteracy. Although current co-adaptive algorithms are powerful for assistive BCIs, their inherent class switching clashes with the operant conditioning goal of restorative BCIs. Moreover, due to the treatment rationale, the classifier of restorative BCIs usually has a constrained feature space, thus limiting the possibility of classifier adaptation. In this context, we applied a Bayesian model of neurofeedback and reinforcement learning for different threshold selection strategies to study the impact of threshold adaptation of a linear classifier on optimizing restorative BCIs. For each feedback iteration, we first determined the thresholds that result in minimal action entropy and maximal instructional efficiency. We then used the resulting vector for the simulation of continuous threshold adaptation. We could thus show that threshold adaptation can improve reinforcement learning, particularly i...Continue Reading

References

Jan 16, 2004·Nature·Konrad P Körding, Daniel M Wolpert
Sep 2, 2005·Journal of Neural Engineering·Chung Tin, Chi-Sang Poon
Feb 28, 2008·Computational Intelligence and Neuroscience·A Cichocki, S Sanei
Oct 7, 2008·Lancet Neurology·Janis J Daly, Jonathan R Wolpaw
Jul 18, 2009·International Review of Neurobiology·Niels BirbaumerPedro Montoya
Dec 1, 2009·Brain Topography·Carmen Vidaurre, Benjamin Blankertz
Mar 23, 2010·NeuroImage·Benjamin BlankertzThorsten Dickhaus
Apr 13, 2010·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·Michela Balconi, Davide Crivelli
Mar 26, 2011·Journal of Neural Engineering·Carmen VidaurreBenjamin Blankertz
Apr 9, 2011·Journal of Neural Engineering·M Gomez-RodriguezM Grosse-Wentrup
Aug 11, 2011·IEEE Transactions on Neural Systems and Rehabilitation Engineering : a Publication of the IEEE Engineering in Medicine and Biology Society·Alexander KoenigRobert Riener
Oct 4, 2011·Biological Psychology·Eva Maria HammerAndrea Kübler
Jan 11, 2012·Brain : a Journal of Neurology·Ethan R BuchLeonardo G Cohen
Jun 13, 2012·Brain : a Journal of Neurology·Cathy M StinearWinston D Byblow
Jun 21, 2012·Journal of Neural Engineering·Moritz Grosse-Wentrup, Bernhard Schölkopf
Nov 6, 2012·Frontiers in Human Neuroscience·Tim Genewein, Daniel A Braun
Jan 15, 2013·Frontiers in Human Neuroscience·S LefebvreY Vandermeeren
Mar 16, 2013·Annals of Neurology·Ander Ramos-MurguialdayNiels Birbaumer
May 4, 2013·Journal of Neural Engineering·Eoin ThomasMaureen Clerc
May 18, 2013·Biomedical Engineering Online·David E ThompsonJane E Huggins
Oct 11, 2013·Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society·Mitsuaki TakemiJunichi Ushiba
Oct 22, 2013·Journal of Neural Engineering·Matthew J BryanRajesh P N Rao
Jan 1, 2011·Wiley Interdisciplinary Reviews. Cognitive Science·Robert A Jacobs, John K Kruschke

❮ Previous
Next ❯

Citations

Nov 26, 2015·Frontiers in Neuroscience·Mitsuhiro HayashibeDario Farina
Jun 1, 2016·Frontiers in Cellular Neuroscience·Vladislav Royter, Alireza Gharabaghi
Jul 30, 2016·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·Robert BauerAlireza Gharabaghi
Jul 31, 2016·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·Robert BauerAlireza Gharabaghi
Oct 30, 2016·Frontiers in Neuroscience·Alireza Gharabaghi
Feb 28, 2017·Journal of Neural Engineering·Noeline W PrinsAbhishek Prasad
May 18, 2018·IEEE Transactions on Neural Networks and Learning Systems·Mufti MahmudStefano Vassanelli
Oct 4, 2019·Clinical EEG and Neuroscience·Paweł Dobrakowski, Grażyna Łebecka
Oct 3, 2018·Journal of the Royal Statistical Society. Series C, Applied Statistics·Seongho Kim, Weng Kee Wong
Mar 30, 2017·Frontiers in Neuroscience·Robert Bauer, Alireza Gharabaghi
Apr 21, 2018·Frontiers in Neuroscience·Tian-Jian LuoChangle Zhou
Jun 18, 2019·Cerebral Cortex·Georgios NarosAlireza Gharabaghi
Jan 1, 2017·Brain Computer Interfaces·Dennis J McFarlandMuhammad Parvaz
Aug 1, 2020·Frontiers in Bioengineering and Biotechnology·Robert GuggenbergerAlireza Gharabaghi
Feb 16, 2021·Journal of Neural Engineering·Hadar Levi-Aharoni, Naftali Tishby

❮ Previous
Next ❯

Software Mentioned

Windows
Matlab R

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.