Random Forest-Based Recognition of Isolated Sign Language Subwords Using Data from Accelerometers and Surface Electromyographic Sensors

Sensors
Ruiliang SuXu Zhang

Abstract

Sign language recognition (SLR) has been widely used for communication amongst the hearing-impaired and non-verbal community. This paper proposes an accurate and robust SLR framework using an improved decision tree as the base classifier of random forests. This framework was used to recognize Chinese sign language subwords using recordings from a pair of portable devices worn on both arms consisting of accelerometers (ACC) and surface electromyography (sEMG) sensors. The experimental results demonstrated the validity of the proposed random forest-based method for recognition of Chinese sign language (CSL) subwords. With the proposed method, 98.25% average accuracy was obtained for the classification of a list of 121 frequently used CSL subwords. Moreover, the random forests method demonstrated a superior performance in resisting the impact of bad training samples. When the proportion of bad samples in the training set reached 50%, the recognition error rate of the random forest-based method was only 10.67%, while that of a single decision tree adopted in our previous work was almost 27.5%. Our study offers a practical way of realizing a robust and wearable EMG-ACC-based SLR systems.

References

Jan 24, 2004·Perceptual and Motor Skills·Mary Flaherty
May 3, 2007·Annals of Biomedical Engineering·Xiaoyan LiAlexander S Aruin
Jan 1, 1993·IEEE Transactions on Neural Networks·S S Fels, G E Hinton
Jan 29, 2009·IEEE Transactions on Bio-medical Engineering·Vasiliki E Kosmidou, Leontios J Hadjileontiadis
Jan 7, 2010·IEEE Transactions on Neural Systems and Rehabilitation Engineering : a Publication of the IEEE Engineering in Medicine and Biology Society·Serge H RoyCarlo J De Luca
Feb 18, 2010·Image and Vision Computing·Liya Ding, Aleix M Martinez
Mar 23, 2012·IEEE Transactions on Bio-medical Engineering·Yun LiZ Jane Wang

❮ Previous
Next ❯

Citations

May 2, 2018·Technology and Health Care : Official Journal of the European Society for Engineering and Medicine·Hailong YuXiaoyang Guo
Nov 27, 2020·Journal of Rehabilitation and Assistive Technologies Engineering·Muhammad Raza Ul IslamShaoping Bai

❮ Previous
Next ❯

Methods Mentioned

BETA
feature extraction

Software Mentioned

MATLAB
SVM

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.

Related Papers

Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society
Yun LiJihai Yang
Zhonghua er bi yan hou tou jing wai ke za zhi = Chinese journal of otorhinolaryngology head and neck surgery
Jie ZhangDong-lan Chen
IEEE ... International Conference on Rehabilitation Robotics : [proceedings]
L A Rivera, G N DeSouza
© 2022 Meta ULC. All rights reserved