Real-Time EMG Based Pattern Recognition Control for Hand Prostheses: A Review on Existing Methods, Challenges and Future Implementation (original) (raw)

Intelligent EMG Pattern Recognition Control Method for Upper-Limb Multifunctional Prostheses: Advances, Current Challenges, and Future Prospects

IEEE Access

Upper-limb amputation imposes significant burden on amputees thereby restricting them from fully exploring their environments during activities of daily living. The use of intelligent learning algorithm for electromyogram-pattern recognition (EMG-PR) based control in upper-limb prostheses is considered an important clinical option. Though the existing EMG-PR prostheses could discriminate multiple degrees of freedom (DOF) limb movements, but their transition to clinically viable option is still being challenged by some confounding factors. Toward realizing a clinically viable multiple DOF prostheses, this article firstly explored the principles and dynamics of the existing intelligently driven EMG-PR based prostheses control scheme. Then, investigations on core issues including variation in muscle contraction force, electrode shift, and subject mobility affecting the existing EMG-PR prosthetic control scheme were reported. For instance, variation in muscle contraction force and subject mobility led to degradation in performance of the EMG-PR controlled prostheses with approximately 17.00% and 8.98% error values, respectively, which are still challenging issues among others. Thus, this study reports core issues and best practices with respect to intelligent EMG-PR controlled prosthesis, the major challenges in implementing adaptively robust control scheme and provides future research directions that may result in the clinical realization of intuitively dexterous multiple DOF EMG-PR based prostheses in the near future.

An implementation of movement classification for prosthesis control using custom-made EMG system

Serbian Journal of Electrical Engineering, 2017

Electromyography (EMG) is a well known technique used for recording electrical activity produced by human muscles. In the last few decades, EMG signals are used as a control input for prosthetic hands. There are several multifunctional myoelectric prosthetic hands for amputees on the market, but so forth, none of these devices permits the natural control of more than two degrees of freedom. In this paper we present our implementation of the pattern classification using custom made components (electrodes and an embedded EMG amplifier). The components were evaluated in offline and online tests, in able bodied as well as amputee subjects. This type of control is based on computing the time domain features of the EMG signals recorded from the forearm and using these features as input for a Linear Discriminant Analysis (LDA) classifier estimating the intention of the prosthetic user.

Real Time Control of Hand Prosthesis Using EMG

2016

Current solutions for below the elbow amputees include affordable prosthesis allowing only a single movement or highly expensive prosthesis allowing several gestures. In this project, our goal was to design a system that provides an inexpensive, multi-functional solution for the hand prosthesis problem. We construct a real-time, portable system based on the Myo armband and a 3D printed prosthesis and show that this framework can provide a good and inexpensive solution for below the elbow amputees of all ages.

Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees

A real-time pattern recognition algorithm based on k-nearest neighbors and lazy learning was used to classify, volun- tary electromyography (EMG) signals and to simultaneously con- trol movements of a dexterous artificial hand. EMG signals were superficially recorded by eight pairs of electrodes from the stumps of five transradial amputees and forearms of five able-bodied par- ticipants and used online to control a robot hand. Seven finger movements (not involving the wrist) were investigated in this study. The first objective was to understand whether and to which extent it is possible to control continuously and in real-time, the finger postures of a prosthetic hand, using superficial EMG, and a prac- tical classifier, also taking advantage of the direct visual feedback of the moving hand. The second objective was to calculate statistical differences in the performance between participants and groups, thereby assessing the general applicability of the proposed method. The average accuracy of the classifier was 79% for amputees and 89% for able-bodied participants. Statistical analysis of the data revealed a difference in control accuracy based on the aetiology of amputation, type of prostheses regularly used and also between able-bodied participants and amputees. These results are encour- aging for the development of noninvasive EMG interfaces for the control of dexterous prostheses.

Using EMG for Real-time Prediction of Joint Angles to Control a Prosthetic Hand Equipped with a Sensory Feedback System

All commercially available upper limb prosthesis controllers only allow the hand to be commanded in an open and close fashion without any sensory feedback to the user. Here the evaluation of a multi-degree of freedom hand controlled using a real-time EMG pattern recognition algorithm and incorporating a sensory feedback system is reported. The hand prosthesis, called SmartHand, was controlled in real-time by using 16 myoelectric signals from the residual limb of a 25-year old male transradial amputee in a two day long evaluation session. Initial training of the EMG pattern recognition algorithm was performed with a dataglove fitted to the contralateral hand recording joint angle positions of the fingers and mapping joint angles of the fingers to the EMG data. In the following evaluation sessions, the myoelectric signals were classified using local approximation and lazy learning, producing finger joint angle outputs and consequently controlling the prosthetic hand. Sensory informati...

Optimizing pattern recognition-based control for partial-hand prosthesis application

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference, 2014

Partial-hand amputees often retain good residual wrist motion, which is essential for functional activities involving use of the hand. Thus, a crucial design criterion for a myoelectric, partial-hand prosthesis control scheme is that it allows the user to retain residual wrist motion. Pattern recognition (PR) of electromyographic (EMG) signals is a well-studied method of controlling myoelectric prostheses. However, wrist motion degrades a PR system's ability to correctly predict hand-grasp patterns. We studied the effects of (1) window length and number of hand-grasps, (2) static and dynamic wrist motion, and (3) EMG muscle source on the ability of a PR-based control scheme to classify functional hand-grasp patterns. Our results show that training PR classifiers with both extrinsic and intrinsic muscle EMG yields a lower error rate than training with either group by itself (p<0.001); and that training in only variable wrist positions, with only dynamic wrist movements, or wit...

The Development of a Virtual Myoelectric Prosthesis Controlled by an EMG Pattern Recognition System Based on Neural Networks

Journal of Intelligent Information Systems, 2003

One of the major difficulties faced by those who are fitted with prosthetic devices is the great mental effort needed during the first stages of training. When working with myoelectric prosthesis, that effort increases dramatically. In this sense, the authors decided to devise a mechanism to help patients during the learning stages, without actually having to wear the prosthesis. The system is based on a real hardware and software for detecting and processing electromyografic (EMG) signals. The association of autoregressive (AR) models and a neural network is used for EMG pattern discrimination. The outputs of the neural network are then used to control the movements of a virtual prosthesis that mimics what the real limb should be doing. This strategy resulted in rates of success of 100% when discriminating EMG signals collected from the upper arm muscle groups. The results show a very easy-to-use system that can greatly reduce the duration of the training stages.

Upper Limb Prosthesis Using EMG Signal: Review

The International Journal Of Science & Technoledge , 2014

Time and frequency domain features of the surface electromyogram (EMG) signal acquired from multiple channels have frequently been investigated for use in controlling upper-limb prostheses. We propose the use of EMG signal whitening as a pre-processing step in EMG-based motion classification. Whitening decor relates the EMG signal and has been shown to be advantageous in other EMG applications including EMG amplitude estimation and EMG-force processing. Drawbacks of using whitening include its substantial added computation and memory requirements, the need to collect calibration data, and possible robustness issues in the presence of high frequency noise. This draw backs can be overcome by the degrees of freedom (DOFs). DOFs implements pattern recognition algorithms that use surface electromyography (EMG) signals show great promise as multi-DOF controllers. Unfortunately, current pattern recognition systems are limited to activate only one DOF at a time. This study introduces a novel classifier based on Bayesian theory to provide classification of simultaneous movements. This approach and two other classification strategies for simultaneous movements were evaluated using non amputee and amputee subjects classifying up to three DOFs, where any two DOFs could be classified simultaneously. Similar results were found for non-amputee and amputee subjects. The new approach, based on a set of conditional parallel classifiers was the most promising with errors significantly less than a single linear discriminant analysis (LDA) classifier or a parallel approach. The low error rates demonstrated suggest than pattern recognition techniques on surface EMG can be extended to identify simultaneous movements, which could provide more life-like motions for amputees compared to exclusively classifying sequential movements. The current statistics includes average of 18,496 upper-extremity amputations every year, compared to 113,702 of the lower extremity. Of those, only 1900 are above the wrist. Among upper-limb amputees, typically fewer than half wear prosthetic arms. An estimated number of 541,000 Americans were living with some form of upper limb loss in 2005 and this number is projected to more than double with an aging and growing population by 2050.

EMG-Controlled Transradial Prostheses - An Investigation into Machine Learning Techniques

International Journal of Computer Applications

The electromyogram (EMG) signals recorded from the surface of skeletal muscles are stochastic in nature and exhibit repeatable patterns for similar muscle activations. Therefore, machine learning algorithms can be used to learn their patterns and identify the movement intent even in the absence of an actual limb. The EMG signals are recorded from the residual muscles/muscle sites after amputation (acquired or congenital) and a representative set of features is extracted. The feature data are passed on to a machine learning algorithm for training and later use in real-time for controlling a prosthetic device. Numerous features of the EMG signal based on its amplitude, spectral contents, and stochastic nature have been proposed. Similarly, various dimensionality reduction techniques, as well as, classification algorithms have also been used. In this study, we provide in-depth analyses of different features of the EMG signals and classification algorithms along with the effect of dimensionality reduction on the classification accuracy. The surface EMG data recorded from the forearm muscles of twelve able-bodied volunteers was used to extract six different feature sets (fourteen individual features). The feature data with/without dimensionality reduction was used to train and test three different classification algorithms, i.e., the linear discriminant analysis (LDA), support vector machines (SVM), and artificial neural networks (ANN). Our extensive study showed that the feature set consisting of the EMG amplitude, spectral, and stochasticity information provided the highest classification accuracy with a linear classifier, i.e., the LDA.

Classification of EMG signals to control a prosthetic hand using time-frequesncy representations and Support Vector Machines

2010

Myoelectric signals (MES) are viable control signals for externally-powered prosthetic devices. They may improve both the functionality and the cosmetic appearance of these devices. Conventional controllers, based on the signal's amplitude features in the control strategy, lack a large number of controllable states because signals from independent muscles are required for each degree of freedom (DoF) of the device. Myoelectric pattern recognition systems can overcome this problem by discriminating different residual muscle movements instead of contraction levels of individual muscles. However, the lack of long-term robustness in these systems and the design of counterintuitive control/command interfaces have resulted in low clinical acceptance levels. As a result, the development of robust, easy to use myoelectric pattern recognition-based control systems is the main challenge in the field of prosthetic control. This dissertation addresses the need to improve the controller's robustness by designing a pattern recognition-based control system that classifies the user's intention to actuate the prosthesis. This system is part of a cost-effective prosthetic hand prototype developed to achieve an acceptable level of functional dexterity using a simple to use interface. A Support Vector Machine (SVM) classifier implemented as a directed acyclic graph (DAG) was created. It used wavelet features from multiple surface EMG channels strategically placed over five forearm muscles. The classifiers were evaluated across seven subjects. They were able to discriminate five wrist motions with an accuracy of iii iv 91.5%. Variations of electrode locations were artificially introduced at each recording session as part of the procedure, to obtain data that accounted for the changes in the user's muscle patterns over time. The generalization ability of the SVM was able to capture most of the variability in the data and to maintain an average classification accuracy of 90%. Two principal component analysis (PCA) frameworks were also evaluated to study the relationship between EMG recording sites and the need for feature space reduction. The dimension of the new feature set was reduced with the goal of improving the classification accuracy and reducing the computation time. The analysis indicated that the projection of the wavelet features into a reduced feature space did not significantly improve the accuracy and the computation time. However, decreasing the number of wavelet decomposition levels did lower the computational load without compromising the average signal classification accuracy. Based on the results of this work, a myoelectric pattern recognition-based control system that uses an SVM classifier applied to time-frequency features may be used to discriminate muscle contraction patterns for prosthetic applications.