Decoding of human hand actions to handle missing limbs in neuroprosthetics

Frontiers in Computational Neuroscience
Jovana J Belić, A Aldo Faisal

Abstract

The only way we can interact with the world is through movements, and our primary interactions are via the hands, thus any loss of hand function has immediate impact on our quality of life. However, to date it has not been systematically assessed how coordination in the hand's joints affects every day actions. This is important for two fundamental reasons. Firstly, to understand the representations and computations underlying motor control "in-the-wild" situations, and secondly to develop smarter controllers for prosthetic hands that have the same functionality as natural limbs. In this work we exploit the correlation structure of our hand and finger movements in daily-life. The novelty of our idea is that instead of averaging variability out, we take the view that the structure of variability may contain valuable information about the task being performed. We asked seven subjects to interact in 17 daily-life situations, and quantified behavior in a principled manner using CyberGlove body sensor networks that, after accurate calibration, track all major joints of the hand. Our key findings are: (1) We confirmed that hand control in daily-life tasks is very low-dimensional, with four to five dimensions being sufficient to explai...Continue Reading

References

Jun 1, 1994·Electroencephalography and Clinical Neurophysiology·J R Wolpaw, D J McFarland
Jan 1, 1997·Journal of Computational Neuroscience·J F Soechting, M Flanders
Sep 2, 1998·Nature·C M Harris, D M Wolpert
Dec 4, 2001·Journal of Neurophysiology·C R MasonT J Ebner
Jun 8, 2002·Science·Dawn M TaylorAndrew B Schwartz
Feb 20, 2004·Journal of Neurophysiology·Erica J Weiss, Martha Flanders
Apr 28, 2004·Clinical Biomechanics·Andreas DaffertshoferPeter J Beek
Jun 24, 2004·Journal of Neurophysiology·Catherine E Lang, Marc H Schieber
Oct 16, 2004·Nature·Tomaso Poggio, Emilio Bizzi
Dec 9, 2004·Proceedings of the National Academy of Sciences of the United States of America·Jonathan R Wolpaw, Dennis J McFarland
Jul 14, 2006·Nature·Leigh R HochbergJohn P Donoghue
Jul 28, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Andrea d'AvellaFrancesco Lacquaniti
Dec 7, 2006·Biological cybernetics·M C CarrozzaC Cipriani
Feb 3, 2007·Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society·E Todorov, Z Ghahramani
Aug 31, 2007·Journal of Neurophysiology·Ping ZhouTodd A Kuiken
Mar 6, 2008·Nature Reviews. Neuroscience·A Aldo FaisalDaniel M Wolpert
Mar 29, 2008·Experimental Brain Research·James N IngramDaniel M Wolpert
May 30, 2008·Nature·Meel VellisteAndrew B Schwartz
Feb 13, 2009·JAMA : the Journal of the American Medical Association·Todd A KuikenKevin B Englehart
Feb 17, 2009·Current Biology : CB·Daniel A BraunCarsten Mehring
Apr 9, 2009·Nature Reviews. Neuroscience·Roland S Johansson, J Randall Flanagan
Apr 17, 2009·Journal of Neurophysiology·Francisco J Valero-CuevasEmanuel Todorov
Sep 2, 2009·Behavioural Brain Research·Daniel A BraunDaniel M Wolpert
Nov 13, 2010·PloS One·Aldo FaisalBruce Bradley
Mar 23, 2011·Journal of Biomechanics·Jason J Kutch, Francisco J Valero-Cuevas
Sep 8, 2012·Journal of Neurophysiology·Kornelius RáczFrancisco J Valero-Cuevas
Mar 12, 2013·IEEE Transactions on Neural Systems and Rehabilitation Engineering : a Publication of the IEEE Engineering in Medicine and Biology Society·J A BergS J Bensmaia
Feb 7, 2014·Science Translational Medicine·Stanisa RaspopovicSilvestro Micera
Aug 1, 2014·Journal of Neuroengineering and Rehabilitation·Nathanaël JarrasséAgnes Roby-Brami

❮ Previous
Next ❯

Citations

May 14, 2016·Journal of Anatomy·James P CharlesJohn R Hutchinson
Sep 8, 2017·IEEE Transactions on Neural Systems and Rehabilitation Engineering : a Publication of the IEEE Engineering in Medicine and Biology Society·Michele XiloyannisA Aldo Faisal
May 23, 2020·Journal of Neural Engineering·Elizaveta V OkorokovaSliman J Bensmaia
Dec 1, 2017·Nature Biomedical Engineering·Eva L DyerKonrad P Körding
Sep 29, 2020·Frontiers in Human Neuroscience·Shlomi Haar, A Aldo Faisal
Jun 8, 2021·Frontiers in Public Health·Jie LiangYurong Li

❮ Previous
Next ❯

Methods Mentioned

BETA
PCA

Software Mentioned

MatLab
CyberGlove

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

International Journal of Bioinformatics Research and Applications
Dominic NathanDean C Jeutter
Experimental Brain Research
James N IngramDaniel M Wolpert
Biological cybernetics
Mijail SerruyaJohn P Donoghue
Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society
Filipe BarrosoJosé L Pons
© 2021 Meta ULC. All rights reserved