Abstract
BACKGROUND:
With the population aging, post-stroke patients suffering from hemiplegia are also rapidly increasing. It is essential to provide valid rehabilitation methods for hemiplegia patients. Mirror therapy is an effective rehabilitation method and is widely applied in many rehabilitation robots.
OBJECTIVE:
The aim of this paper is to present a path planning method to guarantee the robot’s motion performance during mirror therapy.
METHODS:
The kinematic framework of the proposed rehabilitation system is detailed, then the reference motion path of the manipulator is calculated according to kinematic transformation. The concept of manipulability is introduced to describe the motion performance of the manipulator. Based on the above work, a path planning method based on A* algorithm is proposed to quantitatively analyze and optimize the motion performance of the manipulator.
RESULTS:
Preliminary experiments with the proposed rehabilitation system are conducted to verify the proposed path planning method. The characteristics of the proposed method are analyzed through two typical situations. The results showed that the proposed method can build a new path for manipulator, which can ensure the robot’s motion performance and is highly consistent with the reference path.
CONCLUSION:
The results showed that the manipulator could achieve the task with acceptable error, which indicates the potential of the proposed path planning method for mirror therapy.
Introduction
Stroke is a disease of the central nervous system caused by partial loss of brain function [1]. It is the leading cause of death [2] and can also lead to high rates of disability [3]. However, after conventional rehabilitation treatment, only 5%
A common task in robot rehabilitation training is to plan a path from the initial pose to the target pose. Obstacle avoidance path planning refers to planning a path from the initial pose to the target pose under the condition of given obstacles, therefore the robot can pass all obstacles safely and without collision [10]. Berg et al. [11] proposed a path planning method for dynamic environments, which takes all the prior information of both static and dynamic elements in the environment into account, and it efficiently updates the solution when changes to either are observed. Kala et al. [12] proposed a path planning method by combining A* algorithm and Fuzzy Inference. The A* algorithm is used on a probability-based map and the Fuzzy Inference System (FIS) is used on lower level planning. All generated paths are optimal in terms of path length and smoothness. The method proposed by Jan et al. [13]can not only search for the optimal path in various terrains. Furthermore, the method can be easily extended to dynamic path planning in 3-D space among multiple robots.
This paper proposes a path planning method for manipulator in upper limb mirror therapy rehabilitation. The paper is constructed as follows. The research status of path planning method of multi-DOF robot is introduced in Section 1. In Section 2, tasks and problems of the path planning method are proposed. In Section 3, the structure of the proposed upper limb rehabilitation system is introduced, and the kinematic modeling of VR handle, VR helmet, system base and manipulator tip is analyzed. In order to ensure the continuity of joint angles, a verification method is proposed. In Section 4, the reference path is calculated and the path planning method is proposed based on the reference path. In Section 5, experiments under two typical situations are conducted and the experimental results are analyzed. Finally, the conclusions of this paper are briefly discussed.
Problem description
Task description
The basic procedure of mirror therapy is to make sure the symmetrical movement of the affected limb and unaffected limb while blocking vision of affected limb. Visual and motor coordination leads to the perception that the affected limb is fully functional. The perception induces cortical reorganization with positive motor recovery [14]. Traditionally, a mirror is used to block view of the affected limb, therefore the patient can only see his/her unaffected limb and the mirror image of the unaffected limb. However, actual mirrors cannot display all directions. Besides, it is difficult to ensure symmetry of limbs movement when the affected limb moves with the assistance of the therapist.
The limits of moving performance of the robot
Many modern devices are used in mirror therapy [15]. Among them, VR devices have rich training scenes, low development costs and high accuracy, which is very suitable for the collection of unaffected limb data and the display of rehabilitation scenes. The characteristics of the manipulator made it suitable for assisting the movement of the affected limb instead of the therapist. It should be noticed that most VR developer software is based on the left-handed coordinate system; however, robot kinematic models are based on the right-handed coordinate system. Therefore, it is necessary to calculate the conversion relationship between VR devices and robots. Besides, it is necessary to calculate and guarantee the motion performance of the manipulator during mirror therapy rehabilitation because manipulator has limited working space.
The task is usually to find the shortest path between the starting point and the end point in a typical path planning method. However, mirror therapy is a trajectory-based rehabilitation training, the movement of both sides of the patient needs to be as symmetrical as possible to achieve the rehabilitation effect. If the typical path planning method is adopted, the new path will be quite different from the original path and will not be efficient. Therefore, the new path should be highly consistent with the reference path if the motion performance of the manipulator is good.
Establishment and analysis of the kinematical model
General description of the rehabilitation system
The rehabilitation system is designed to assist patients in mirror therapy rehabilitation. The system consists of a 6-DOF robot and a series of VR devices. The patient equipped with the manipulator will receive virtual reality scenes in the VR headset, such as picking fruit and opening the refrigerator door. During the training, the patient completes the task with the unaffected limb. Then the manipulator drives the patients’ affected limb to reproduce the symmetrical path of the unaffected limb. The motion path is mirrored according to the patients’ position. Therefore, the kinematics calculation is needed to obtain the reference path of the manipulator. All analyses assumed that the left limb is the affected limb
Reference frames in the rehabilitation system
As shown in Fig. 1, the studied rehabilitation system has the following frames:
Robot base coordinate system (BCS) {V}:
Structure and reference frames of the rehabilitation system.
The symmetrical pose of the affected limb can be described by six parameters:
Assuming UCS pose in VCS is [
where
where
Poses are transformed to MCS to achieve the symmetry of motion path, which can be expressed as follows:
where
We can get transformation matrix
After we get the reference pose of the manipulator in BCS, it is necessary to ensure the continuity of the robot posture. The range of posture angle is [
The condition of Eq. (9) is expressed as follows:
The above methods can make sure robot joint angles are continuous without being affected by the overflowing posture data.
According to the task description of mirror recovery in Chapter II, the manipulator needs to reproduce the symmetrical path with restricted motion performance. In order to evaluate the motion performance, the variable to describe motion performance of the multi-DOF manipulator is needed. The physical meaning of manipulability is a comprehensive measure of the omnidirectional mobility of a robot. It can be used to measure the overall flexibility of the robot. Yoshikawa defined manipulability as follows [17]:
where
In order to quantitatively describe the robotics’ motion performance, the variable
where
A* (a-star) algorithm is the most effective direct search method for shortest path in static road network, which is widely used in the problem of optimal path solution [18]. It adds heuristic information related to the task, which can lead the search into the most promising direction. The core of the A* algorithm is the design of the valuation function. The valuation function is used when selecting the best successor nodes, successor node which has a minimum
where
According to the characteristics of robot path planning, the following improvements is added to the standard A* algorithm: We set up three lists, set
Before calculating
Repeat the following process until the distance between target position and current position is less than
Select If Set the position closest to the current position in the reference path to Generate IF Remove this Pick IF Clear
At the end of the loop, the data in
In order to verify the effectiveness of the proposed path planning method, we designed experiments that simulate the real mirror therapy rehabilitation process. After the subjects put on the VR helmet, they receive a certain order to finish a task, such as picking up fruit, or opening the door of a refrigerator in a virtual reality environment (Fig. 2). After finishing the mission with the VR handle held by their unaffected limb, the manipulator will reproduce the mirrored path with the affected limb. During the experiment, data such as the robotic tip’s poses and joint angles are recorded, processed, and analyzed. The experimental rehabilitation system mainly consists of an UR5 6DOF robot and Samsung VR devices.
A healthy male subject during the tests.
The tip pose of the manipulator should be calculated with robot joint angles and D-H parameters to evaluate the proposed method, then we can get the maximum manipulability
Sample the data during the movement of the manipulator. The data format is set as follows: sample time, joint angles, the pose of TCS in BCS,
The maximum manipulability of the manipulator in the sample is
As shown in Fig. 3, the red curve is defined as the change trends in manipulability value after the path planning method is added and the blue curve is the change trends in manipulability value before the path planning method is added. After setting
The manipulability value of the robotic tip over time.
The improvement of robot motion performance is also shown in Figs 4–6. A few seconds after
The 
The 
The 
Figure 7 shows the distance between poses from the reference path and the corresponding poses from the new path. Instead of generating the shortest path from start position to stop position, the new path coincides with the reference path when the manipulability
The distance of the corresponding point over time.
The manipulability value of the robotic tip over time.
In Figs 9–11, the reference path and the new path are highly fitted in three directions, and the coordinate difference is always small. The phase difference caused by the characteristics of path planning method is fixed at 0.2 s.
The 
The 
The 
According to the experimental results, the addition of performance constraints improves the motion performance of the manipulator. When the manipulator tip gets close to lower motion performance poses, the path planning method would generate a new path which can restrict the motion performance. In addition, in order to ensure the characteristics of a trajectory-based task, this method can ensure a high consistency of old and new paths when the manipulability
The rehabilitation system with the proposed path planning method has been tested in the experimental study, and the results showed that the manipulator could achieve the task with acceptable error, which indicates the following conclusions. Firstly, the proposed path planning method for the manipulator can enhance its motion performance. Secondly, the new path is highly coincident with the reference path when the motion performance meets the requirements. Thirdly, the proposed path planning method has the potential to be applied to different devices for mirror therapy. The proposed rehabilitation system is furthermore a potential device to enhance human mobility.
Footnotes
Acknowledgments
This work was supported by the National Key Research and Development Program of China [Grant No. 2018YFC2001600] and the National Natural Science Foundation of China [Grant No. 61973205].
Conflict of interest
None to report.
