Abstract
A novel method of mirror motion recognition by rehabilitation robot with multi-channels sEMG signals is proposed, aiming to help the stroked patients to complete rehabilitation training movement. Firstly the bilateral mirror training is used and the model of muscle synergy with basic sEMG signals is established. Secondly, the constrained L
Introduction
The number of patients with nerve damage caused by strokes has increased year by year in the world, which seriously affects their ability to take care of themselves and imposes a heavy burden on families and society. In the past 20 years, a number of rehabilitation robot systems have emerged to help doctors and patients with rehabilitation training [1, 2, 3]. They can monitor the rehabilitation process, and can adjust parameters and training programs according to the patient’s condition, by many intelligent assistance systems and sensors [4, 5].
The surface electromyography (sEMG) signal is an electrical signal. It is formed by the spatio-temporal superposition effect of the action potential on the skin surface when muscle system moves under the control of the nervous system. There is a significant linear mapping between sEMG amplitude and muscle strength [6]. Comparing with other signals, the sEMG is ahead of limb movement which can compensate for the hysteresis of motion signals effectively. At the same time the sEMG signals collected by different subjects under the same conditions have higher similarity. For example, Kiguchi [7] used a neurofuzzy matrix modifier with EMG to make the controller suitable for most users. Vahab Khoshdel [8] took sEMG as force sensors to estimate the exerted force, so the controller is not affected by dynamical models of robot and patients, and designed a adaptive fuzzy system to estimate the uncertainty. Guo [9] took Detrended Fluctuation Analysis, Root Mean Square, Muscular Model and Weight Peaks as feature extraction methods, took Support Vector Machine and Neural Networks as classifiers, and got the recognition accuracy rate 88.7% for Neural Networks and 85.9% for Support Vector Machine.
Clinical researches have shown that rehabilitation training with exercise intention is more effective for neurological reconstruction and function recovery in patients [10]. But for stroke patients (especially those in the early stage of rehabilitation), the contraction ability and strength of the muscle from affected limb are very small, and the corresponding sEMG signals are very weak. It is difficult to judge the patient’s motion intention with the sEMG signals of the affected limb, but the sEMG signals from healthy limb can respond the limb movement intention very well. Because the muscles of the upper limbs are coordinate, the symmetry movement is more stable than the asymmetric movement and the frequency and phase of the two-upper limbs’ movement will be synchronized. Therefore, the bilateral mirror rehabilitation training method can be used to control rehabilitation robot. In order to make the robot follow the movement of the limb movement, the first step is to recognize the posture accurately.
Muscle synergy is a theory that is used for dimension reduction in muscle coordination, it has been shown to form the basis of complex muscle coordination patterns involved in activities such as kicking, swimming, jumping of frogs postural standing and human arm movements [11]. NMF is a kind of decomposition method proposed by Lee et al. [12]. It can decomposed the given data into two non-negative matrices, and it is widely used for pattern recognition and hyperspectral unmixing [13]. Israely [14] used a single set of muscle synergies to express movements in different directions, which is implemented by NMF (non-negative matrix factorization). Ma [6] also used NMF to map muscle synergy model to realize the proportional control of hand and wrist. Compared with PCA (Principal Component Analysis) [15] and ICA (Independent Component Analysis), the reconstruction process is closer to a whole with clear physics significance [16]. Moreover, the NMF decomposition result not only has some sparsity for non-negative matrices, but also can suppress the adverse effects caused by external changes to feature extraction in a certain extent [17, 18, 19]. However, these studies have no constraints on NMF algorithm, which makes the coordination separation incomplete and affects the recognition effect.
Extreme Learning Machine (ELM) as a single hidden layer feed-forward neural network learning algorithm developed in recent years [20]. It is simple to implement, with extremely fast learning speed and less human intervention. It has been applied in the fields of time series prediction and pattern recognition, and so on [21, 22]. Unlike conventional ELM, SVD-ELM effectively avoids the failure of calculating matrix inversion due to matrix singular, during the process of computing output weight [22, 23, 24].
In this paper, the sEMG signals of the limbs moving are collected and the muscle coordination model is established. Combined with the characteristics of NMF, constrained L
Muscle synergy model
Muscle synergy, that is, when a subject is moving his body, the central nervous system (CNS) will send a set of commands to muscles. Some researchers studied that CNS could build complex motor patters by coordinating musculature and a set of muscle is defined as muscle synergy. A single muscle which belongs to many synergy sets can determine global muscle activation patterns by weighted combinations. For a certain ongoing or upcoming limb movement, the CNS groups will produce a combined moment to perform the desired action [11]. Therefore, it could be assumed that
Therefore, the level of muscle activity
where the number of muscles is
From Eq. (1),
where
NMF Foundation. The essence of non-negative matrix factorization is a technique of matrix decomposition and projection. The basic principles are as follows:
For non-negative matrix
where:
They are smaller than the original matrix
The NMF algorithm can be used to decompose the muscle synergy, which not only satisfies its formal requirements, but also has non-negative decomposition results. It is a more superior advantage which explains the mechanism of the human nervous system. That is, the nervous system emits a either excites or suppressed nerve signal and the value of it is non-negative. So we can used Eq. (3) to deal with Eq. (2), and get the
Constrained L
Corresponding cost function of Eq. (2) is:
where
The corresponding iterative algorithm is:
where “.*” and “./” represent the multiplication and division of the corresponding elements respectively; “
Design of Improved ELM Based on TSVD. For different samples
Then the SLFNs model is:
where
So Eq. (8) can be written as
where
The input weight in ELM can be selected randomly, so the SLFNs can be obtained simply as the least squares solution of
That is
Then the least squares solution with minimum 2 norm of output weight is
where
For unconstrained least squares problem
as the condition in matrix
So it could applying singular value decomposition on matrix
and calculate optimal regularization parameters by GCV (Generalized Cross-Validation) by
Then apply TSVD to calculate the generalized inverse of
and the output weight
So the algorithm used in this paper is:
Step 1. Collect the sEMG signals
Sampling Point Selection for sEMG. There are 5 degrees of freedom in our upper limb rehabilitation robot system, that is shoulder abduction, shoulder flexion and extension, elbow flexion and extension, wrist flexion and extension and wrist rotation. In actual rehabilitation training, it can provide rehabilitation training for 5 upper limb joints. In this paper, three common proximal joint movements are selected, that is elbow joint motion, shoulder forward flexing, shoulder abduction, and two common upper limb movements, lifting trousers and eating, are mentioned too. The actual movement is shown in Fig. 1.
In order to realize the function of recognition, the characteristics of the sEMG signals under these postures are discussed. The muscle which is responsible for providing the force of the movement is called the active muscle. During the movement of the upper limb, the biceps and triceps are the active muscles for elbow flexing, and the deltoid is the active muscles for shoulder movement. The brachioradialis is one of the active muscles for wrist rotation. Therefore, the ideal signal acquisition points are the muscles of the biceps, triceps, deltoid and brachioradialis, which are used in the experiments. The specific measurement position and the rehabilitation robot are shown in Fig. 2.
Graphs of each motion. (a) elbow joint motion; (b) shoulder forward flexing; (c) shoulder abduction; (d) lifting trousers; (e) eating.
Experiments of data selection.
Conditions for sEMG Signal Sampling. Before the sampling information about age, gender, weight and health status of subjects should be asked. Make sure they were notified what to do, clean the skin of the subjects carefully with alcohol, and the subjects are relaxed without vigorous exercise before. Two conditions should be followed by subjects. Firstly, the subjects need to remain as natural as possible before the experiments and strenuous exercise should not be taken. Secondly, in order to avoid the sudden change of muscle strength which could interfere with the subsequent analysis of the sEMG signal characteristics, it is necessary to ensure that the subjects move naturally, that is, the active muscle isometric contraction is not performed.
Motion Classification Experiment. First of all, the original data is collected this paper, part of them is shown in Fig. 3 for shoulder forward flexing (Fig. 1b). A total of 125 sets of experimental data for 5 types of actions, including 25 sets of each type of action are ready for the classification experiment. These data are the active segments of the signal that have been divided by the intelligent acquisition tool, and the length is 8000 points per channel. According to the sEMG signal characteristic analysis process, each set of data is transformed into a neural network model established by the 8-dimensional feature vector input ELM learning algorithm. Since the input dimension is not more, the number of hidden layer is set to 20.
The PCA was adopted as a comparison algorithm. The PCA method selects the feature dimension mainly by calculating the cumulative contribution rate of the principal, and the principal of the top ten in each channel and its contribution rate according to the test data are shown in the following Table 1.
Contribution rate of components of PCA
The original signals collected from four channels.
Comparison of different testing results of extraction methods.
It can be seen from Table 1 that the contribution rate of the first two principal elements of each channel is above 89%. So the PCA feature dimension is also 2
The data under each type of action is randomly selected from 15 groups as training set and 10 groups as test set. The feature extraction method proposed in this paper is compared with the PCA and full-action features of input data. The training results are shown that no mater the training results of this paper or the PCA or the full-action are the 100%. It shows that the model has the same initial condition and if the testing results are better, the algorithm is better.
From the testing results in Fig. 4, the correct extraction rate of the feature extraction algorithm proposed in this paper is 95%, which is higher than 90% of the PCA. At the same time, the method of full-action feature is not ideal whose accuracy is only 66%. The input of the ELM is the low-dimensional feature vector extracted L
One of the most important premises for better results of mirror rehabilitation motion is the recognition method. A new method is proposed by combining L
Footnotes
Acknowledgments
This research is supported by the Natural Science Foundation of Liaoning Province, China (20170540641), (20170520386), (20180540143), and National Natural Science Foundation of China (71672117).
