Lessons learned from conducting a pragmatic,randomized,crossover trial on robot-assisted gait training in children with cerebral palsy (PeLoGAIT)

Abstract

PURPOSE:

To investigate the effectiveness of outpatient robot-assisted gait training (RAGT) in ambulatory children with spastic cerebral palsy.

METHODS:

Children were randomized to two different intervention sequences within a pragmatic crossover design. They performed five weeks of RAGT (3 sessions per week) and five weeks of usual care (UC). Dimension E of the Gross Motor Function Measure-88 (GMFM E) as the primary outcome as well as Dimension D (GMFM D), and timed walking tests were assessed before and after each treatment sequence and after a 5-week follow-up.

RESULTS:

The trial was stopped early because of recruitment problems. We included 16 children with a mean age of 11.3 years (6.0–15.3 years). GMFM E median (IQR) change scores were $-$ 0.7 ( $-$ 2.8 to 3.5) after RAGT and 0 ( $-$ 2.4 to 2.4) after UC. Neither GMFM E nor any secondary outcome measure changed significantly after RAGT or UC, nor were any period, follow-up, or carry-over effects observable.

CONCLUSIONS:

RAGT as a single intervention was not effective in improving walking abilities in the included children. It should be embedded in a holistic treatment approach, as it cannot cover all aspects relevant to gait. Furthermore, children’s personalized rehabilitation goals should be carefully monitored with individualized measurement instruments.

Keywords

Child cerebral palsy robotics walking crossover design randomized controlled trial

1. Introduction

Cerebral palsy (CP) is one of the most common physical disabilities, which affects about 2–3 children per 1,000 live births in Western countries [1]. It involves multiple dimensions of health. Children with CP are often restricted regarding independent mobility and daily walking activity, with one in three not being able to walk [2]. Thus, improving gait function in these children is often one of the main goals of the families and the rehabilitation team [3, 4]. Pediatric neurorehabilitation addresses this goal with various impairment-based approaches (i.e., focusing on the body structures and functions of the International Classification of Functioning, Disability and Health: Children and Youth Version (ICF-CY)) and more task-specific approaches (i.e., focusing on the activity component of the ICF-CY) [5]. A meta-analysis showed a substantial effect of different task-specific gait training interventions on walking speed in children with CP [5]. Additionally, Zwicker et al. found positive results on various parameters of the body function (e.g., step length, cadence, and gait speed) and the activity component of the ICF-CY (e.g., Gross Motor Function Measure-88 (GMFM-88) Dimension D and E) when summarizing the evidence of several systematic reviews on different kinds of treadmill training in children with neuromotor disorders [6].

New robotic rehabilitation technologies have revolutionized the neurorehabilitation field during the last 15 years and have increasingly been implemented in the clinical setting [7]. They facilitate prolonged active training duration with more repetitions in a consistent movement pattern and provide an attractive and entertaining training opportunity due to the implementation of serious games. Further, the training parameters are automatically recorded and allow for a better comparison of training intensity across different centers. One of these rehabilitation robots is the driven gait orthosis Lokomat ${}^{\@setsize{\scriptsize}{8pt}{\viipt}{\@viipt}\textregistered}$ (Hocoma AG, Volketswil, Switzerland), which enables robot-assisted gait training (RAGT) for children starting at an early age of approximately five years [8]. The Lokomat automates gait therapy on a treadmill by two actuated leg orthoses which are available in pediatric and adult sizes [8, 9]. These orthoses are individually adapted to the patient’s legs and are attached with cuffs, while the patient is secured using a dynamic bodyweight support system with a harness providing partial bodyweight support. The Lokomat offers many possibilities for variations of training parameters, such as leg joints’ range of motion, gait speed, amount of bodyweight support, and guidance force [10]. Such modern technology raises high expectations in parents of children with CP regarding gains in their child’s walking abilities and the development of a gait pattern comparable to that of non-disabled children [3]. However, it is often a challenge for the therapy team to meet these expectations appropriately, as scientific evidence in this area shows large deficits. Although studies have provided evidence on the Lokomat’s feasibility and safety in pediatric populations [8, 11], information on the optimal frequency and duration of such interventions as well as the intensity and dosage of the training parameters is sparse. A recent systematic review concluded that no specific delivery modes for RAGT in children exist and that evidence of its effectiveness is still weak and inconsistent [12]. A primary reason for the weak evidence is that most published results were derived from uncontrolled single case studies or case series [8, 13, 14, 15, 16, 17] and only a few randomized controlled trials (RCT) have been published [18, 19, 20, 21, 22]. However, performing an RCT in rehabilitation is challenging. Most of these RCTs showed some methodological limitations. Limitations included the randomization procedure [18, 19], inconsistencies between inclusion criteria and included patient sample [18], a large dropout rate [19], and severe statistical flaws [20, 21].

When we started our RCT in 2009, only the results of the first uncontrolled single case studies and case series studies were available. As we were interested in the effects of RAGT as it is performed in our rehabilitation center, we applied a pragmatic trial design [23]. This study design evaluates the effects of an intervention under the usual everyday real-life conditions in which it is applied, by keeping aspects such as eligibility criteria of the included patient population, outcome measures, flexibility of intervention, or therapists’ expertise as close as possible to everyday life conditions [24]. Accordingly, we chose a 5-week period of RAGT, as this conforms to the duration and frequency of RAGT as it is usually provided in the outpatient setting of our center. We further chose to apply a crossover design, which enables each child to receive both treatments in a random order. As each patient can act as his or her control, and variation within a person is usually less than between patients, the treatment effect can be estimated more precisely. With that, it requires only about half the number of patients needed in a parallel group design [25]. As pediatric neurorehabilitation is generally faced with low case numbers, a reduction in sample size is a favorable factor in this research field. We, therefore, accepted possible disadvantages of the crossover design like carry-over or period effects and longer study duration for the participants and addressed these statistically.

Thus, this research project aimed to investigate the effectiveness of RAGT on improvements of functional gait parameters in ambulatory children with CP in a pragmatic, randomized crossover trial. We hypothesized that a 5-week period of RAGT on the Lokomat in an outpatient setting would be superior concerning the improvement in gait function when compared to a 5-week phase of standard treatment in children with a bilateral spastic CP within a crossover design with a randomized treatment sequence.

After a study duration of more than eight years (compared to planned four years), we decided to stop the trial mainly due to severe recruitment difficulties which we could not overcome despite several measures that were taken in the course of the trial. In this article, we report on the results of the 16 patients we included until study termination. Further, we address the lessons learned from our study, on the one hand from the content side regarding the Lokomat intervention, and on the other hand regarding methodological choices that potentially influenced study enrollment.

2. Methods

The study was designed in accordance with the Declaration of Helsinki [26] and the extensions of the CONSORT (Consolidated Standards of Reporting Trials) statement for non-pharmacologic treatment interventions [27] and pragmatic trials [28]. It was approved by the Ethics Committee Zurich and registered on ClinicalTrial.gov (NCT00887848).

Written informed consent and assent was obtained from all the legal guardians and the child by the study coordinator (C.A.) before participation.

2.1 Design and setting

The methods of this study are outlined in detail in the published study protocol [23]. In short, the study was designed as a pragmatic, randomized, crossover trial. It was carried out in the outpatient setting of the Swiss Children’s Rehab of the University Children’s Hospital Zurich in Affoltern am Albis (Switzerland). Later, the Pediatric Therapy Center of the Reha Rheinfelden (Switzerland) was added as a second recruiting center.

2.2 Participants

Children aged 6 to 18 years with a bilateral spastic CP and a Gross Motor Function Classification System (GMFCS) levels II–IV who were able to walk at least 14 meters with or without walking aids were eligible for study participation. They had to be able to follow instructions and communicate pain or discomfort. Exclusion criteria were neuro- or orthopedic surgery on the lower extremity or trunk within the last six months, having participated in another Lokomat training regimen within the previous six months as well as a change in concomitant drug therapy within the last four weeks before or during the study period. Further, children showing contraindications as outlined in the Lokomat manufacturer’s manual were excluded.

2.3 Randomization

Children were randomized to two different pre-specified sequences of interventions. The two interventions were RAGT as treatment (T) on the Lokomat on an outpatient basis and usual care as control (C) in the home environment of the child. A child could be randomized to a T/C sequence (TC-group) or a C/T/C sequence (CTC-group). Randomization into the two groups was performed using a minimization method with a random factor of 0.9. Minimization facilitates balancing even small groups in terms of selected patient factors at all stages of a trial. We included the factors severity of impairment (GMFCS-levels II and III/IV), age (6–11 years and 12–18 years) and Botulinum Toxin A-treatment in the preceding six months (present and absent). Concealed allocation was ensured by storing the independently generated randomization list off-site and requesting information about children’s group allocation by phone or e-mail.

Figure 1.

Overview of the outcome measures and the measurement time points per group. Children randomized to the CTC-group with the intervention sequence usual care/robot-assisted gait training (RAGT)/usual care were measured at four different time points within 16 weeks. Children randomized to the TC-group underwent the intervention sequence RAGT/usual care and were measured at three different time points within 11 weeks. Differences regarding intervention time and numbers of measurement time points were deliberately chosen to reduce the burden on children and families as much as possible.

2.4 Intervention

2.4.1 Usual care (C)

Usual care typically consisted of one to two individual sessions of physiotherapy per week. Each session lasted 30 to 45 minutes. Additionally, hippotherapy, circuit training, or occupational therapy could be elements of standard treatment. These therapies, which were individually customized to the needs of the child, were mostly implemented in the school setting or in the child’s home environment. Usual care treatment did not specifically address gait training but instead consisted of elements addressing the leg joints’ range of motion, muscle tone reduction, balance, activities of daily living, etc., using the ICF-CY as planning and treatment framework. Responsibility, planning, and content of the C-treatment were entirely in the hand of the child’s therapist in the home environment. Information about the type, duration, and frequency of all therapies was documented in a logbook by the parents.

2.4.2 RAGT (T)

RAGT on the Lokomat was applied three times per week over five consecutive weeks with a maximum of 45 minutes of effective walking time per session. RAGT sessions were executed according to published recommendations [10] by trained and experienced therapists who were used to working with children. Serious games and other available motivating strategies were used to increase children’s adherence to the training. Body-weight support, gait speed, training duration, as well as guidance force of the Lokomat were individually adjusted according to the child’s abilities and modified within training sessions and during the course over time. Standard therapies as described under usual care could be continued during the RAGT period, but should not include specific walking training. Type and dosage of concomitant treatment were recorded in a logbook.

The duration of study participation and number of assessment time points varied based on group allocation between 11 weeks with three assessment time points (TC-group) and 16 weeks with four assessment time points (CTC-group) (see Fig. 1).

2.5 Outcome measures

2.5.1 Primary outcome measure

We selected the percentage score of the dimension E of the GMFM-88 (GMFM E) as the primary outcome measure. The GMFM E assesses walking, running, and jumping [29] and consists of 24 items, which are scored on a 4-point ordinal scale. The test was performed without walking aids, regardless of the children’s GMFCS-level. A GMFM-certified therapist instructed and rated the child. The psychometric properties of the total GMFM-88 are well explored in children with CP [30]. Concerning the GMFM E, there is limited positive evidence for the responsiveness [31].

2.5.2 Secondary outcome measures

We used the percentage score of the dimension D of the GMFM-88 (GMFM D) to assess the standing ability. The GMFM D consists of 13 items, which were tested and scored in the same way as described for GMFM E. There is also limited positive evidence for its responsiveness [31], while reliability seems to be high [32].

Further, a 6-minute walking test (6MinWT) was performed on a 30-meter long corridor with poles at each end [33]. Evidence for its test-retest reliability is moderate, the minimum detectable change (MDC) is 61.9, 64.0, and 47.4 m for children with a GMFCS level I, II, and III, respectively [34]. Its responsiveness has not been established in children with CP so far [31].

Gait speed was assessed with the 10-meter walking test at self-selected (10MWTss) and fast (10MWTfast) speeds. Children walked on a 14-meter long track with orthoses and walking aids usually used in daily life. Each test was performed twice and the time needed for the middle 10 meters was measured with a stopwatch. Evidence for test-retest reliability of the 10MWTfast is moderate in children with CP [31] and MDCs of 1.7, 4.3, and 17.7s were reported for GMFCS level I, II, and III, respectively [34].

Further, measures of body function (range of motion, modified Ashworth scale, and manual muscle tests of the lower extremities) were evaluated for descriptive purposes [35, 36]. All measurements were performed by trained physiotherapists who were experienced in working with children and who followed standardized written instructions. Assessors were not blinded regarding children’s assessment time point.

Figure 2.

Overview of the study protocol and the statistical analyses. CTC1, baseline assessment in CTC-group; TC1, baseline assessment in TC-group; CTC2, intermediate assessment in CTC-group; TC2, intermediate assessment in TC-group; CTC3, end assessment in CTC-group; TC3, end assessment in TC-group; CTC4, follow-up assessment in CTC-group; $\Delta$ C1, change during usual care in CTC-group; $\Delta$ C2, change during usual care in TC-group; $\Delta$ C3, change during follow-up in CTC-group; $\Delta$ T1, change during robot-assisted gait training in TC-group; $\Delta$ T2, change during robot-assisted gait training in CTC-group.

2.6 Sample size and power calculation

For sample size calculation, we used the PASS Power Analysis and Sample Size software program (NCSS, LLC, Kaysville, USA) with a Minimum Important Clinical Difference (MCID) of 3.7%-points in the GMFM E that was reported by Wang et al. [37] and a standard deviation of 6.8%-points, which was derived from our data [13]. With a power of 80% and a significance level of 5%, it indicated a sample size of 30 to be sufficient for a 2 $\times$ 2 crossover design. We increased this number to 34 to allow for a predicted dropout rate of about 10%.

2.7 Statistical analysis

The statistical analyses were carried out with SPSS 24 (IBM Corporation, New York, USA). Datasets of all study participants were analyzed on an intention-to-treat basis. Descriptive statistics are presented for the clinical characteristics of the study participants and the quantification of the T- and C-intervention. Treatment effects, period effects as well as follow-up effects of the two treatment interventions were analyzed with Wilcoxon signed-rank tests for paired samples, with the treatment effect being our primary endpoint. Wilcoxon rank sum tests for unpaired samples were used to determine whether carry-over effects were present [25]. Ninety-five percent confidence intervals are presented with a two-tailed level of significance set at $\alpha<$ 0.025 for treatment and follow-up effects, and $\alpha<$ 0.05 for period and carry-over effects. Additionally, we calculated effect sizes based on the $z$ values of the nonparametric Wilcoxon rank sum tests as $r=Z\div\sqrt{N}$ and interpreted $r\geqslant$ 0.1 as small, $r\geqslant$ 0.3 as moderate, and $r\geqslant$ 0.5 as large effect [38, 39]. An illustration of all applied statistical tests is given in Fig. 2.

3. Results

Due to severe recruitment difficulties and the already prolonged study duration, the study coordinator and the sponsor (H.v.H.) unanimously decided to close the trial early. Until trial termination, 16 children and adolescents with a bilateral spastic CP completed the study, without any dropouts. Descriptive characteristics of the study participants are presented in Table 1.

Table 1
Descriptive characteristics of the study participants ( $n=$ 16)

	TC-group	CTC-group	Total
Gender ( $n$ )
Male	6	7	13
Female	2	1	3
GMFCS-level ( $n$ )
II	5	4	9
III	2	3	5
IV	1	1	2
Age (years)	11.4 (6.0–15.1)	11.2 (6.1–15.3)	11.3 (6.0–15.3)
Height (cm)	146 (118–178)	142 (110–174)	144 (110–178)
Weight (kg)	41 (24–67)	43 (18–81)	42 (18–81)
Walking aids in everyday life ( $n$ )
None	5	4	9
Walker	2	2	4
PA	1	1	2
Wheelchair	0	1	1
Physiotherapy during usual care period
Sessions/week	2 (1–3)	2 (1–3)	2 (1–3)
Minutes/week	90 (45–135)	90 (45–135)	90 (45–135)
Range of motion ( ${}^{\circ}$ )
Hip flexion			119 (90–140)
Hip extension			$-$ 2 ( $-$ 20–15)
Knee flexion (in 90 ${}^{\circ}$ hip flexion)			145 (110–165)
Knee extension (in 0 ${}^{\circ}$ hip flexion)			$-$ 2 ( $-$ 20–15)
Ankle dorsiflexion (in 90 ${}^{\circ}$ knee flexion)			5 ( $-$ 20–25)
Ankle plantarflexion			45 (20–65)

The number of observations ( $n$ ) is presented for nominal and ordinal variables. Interval scaled variables are presented as mean and (range). TC-group, group with treatment-control sequence; CTC-group, group with control-treatment-control sequence; GMFCS, Gross Motor Function Classification System; PA, personal assistance.

Three children belonging to the TC-group had received Botulinum Toxin-A treatment into muscles of the lower extremities within six months before their study participation.

Regarding the ICF-CY body function level, the median modified Ashworth score of all children was 0 with an interquartile range (IQR) of 1. With a median of 3 (IQR: 1), children’s muscle strength was moderate. The sagittal range of motion values of the lower extremities are listed in Table 1.

Participants’ treatment adherence was high. Except for one child, who performed 10 RAGT sessions, all others completed at least 14 of 15 sessions. Descriptive parameters regarding dosage and intensity of the RAGT sessions are listed in Table 2.

Table 2

Characteristics of the robot-assisted gait training (RAGT) dosage parameters (averaged over all training sessions per person)

	Mean	Standard deviation	Minimum-Maximum
RAGT session ( $n$ )	14.3	1.2	10	–15
Gait speed [m/s]	1.4	0.1	0.5	–2.3
Bodyweight support [%]	27	0.8	0	–78
Guidance force [%]	94	4	55	–100
Session duration [min:sec]	39:45	4:50	15:52	–47:00
Distance walked per session [m]	935	159	129	–1’636
Distance walked in total [m]	13’519	3’641	2’508	–19’843

Table 3

Scores and change scores at different time points, treatment effects and effect sizes of primary and secondary outcome measures

		RAGT period				Usual care period
	$n$	Median T1	Median T2	Change score		Median T1	Median T2	Change score		Treatment effect ( $p$ )	Effect size (r)
				Median	IQR			Median	IQR
GMFM E [%]	16	53.5	55.6	$-$ 0.7	$-$ 2.8–3.5	56.3	57.6	0	$-$ 2.4–2.4	0.91	$-$ 0.02
GMFM D [%]	16	79.5	79.5	0	$-$ 2.6–2.6	75.6	79.5	0	$-$ 2.6–7.1	0.46	$-$ 0.13
6MinWT [m]	14	353	354	11	$-$ 13–31	366	353	$-$ 0.5	$-$ 12–14	0.22	0.23
10WMWTfast [m/s]	13	1.3	1.4	0.1	0.0–0.2	1.4	1.3	0.1	$-$ 0.1–0.3	0.70	0.08
10MWTss [m/s]	16	0.9	1.0	0	0.0–0.1	1.0	0.9	0	$-$ 0.1–0.1	0.76	$-$ 0.05

RAGT, robot-assisted gait training; GMFM D/E, dimension D/E of the Gross Motor Function Measure-88; 6MinWT, 6-minute walk test; 10MWTfast, 10-meter walk test fast speed; 10MWTss, 10-meter walk test self-selected speed.

Figure 3.

Individual effects of robot-assisted gait training (RAGT) and usual care on Gross Motor Function Measure dimension E (GMFM E) change scores. The order of the bars reflects the chronological sequence of the treatment. GMFCS, Gross Motor Function Classification Level.

In addition to the RAGT sessions, children attended on average 125 min $\pm$ 148 min (0–540 min) of physiotherapy during the T-intervention, and four children also continued with their hippotherapy sessions (41 min $\pm$ 85 min; 0–300 min). During the C-intervention, physiotherapy added up to 282 min $\pm$ 256 min (0–1’020 min) and seven children attended hippotherapy (63 min $\pm$ 82 min; 0–225 min).

3.1 Primary outcome measure

Results regarding the primary outcome are described in Table 3. GMFM E percentage scores did not significantly increase after the RAGT or after the usual care period. Neither a treatment effect nor a period, follow-up, or carry-over effect was observable ( $p=$ 0.91/0.61/0.75/0.40, respectively). The effect size did not indicate any effect either. Figure 3 illustrates children’s individual GMFM E change scores after RAGT and usual care.

3.2 Secondary outcome measures

Results of the secondary outcomes are described in Table 3. None of the secondary outcome measures indicated a significant treatment effect. Effect sizes did not suggest any effect except for the 6MinWT, which showed a small effect. No period, follow-up, or carry-over effects were observed in any of the secondary outcome measures.

4. Discussion

We investigated the effectiveness of RAGT on improving walking abilities in ambulatory children with bilateral spastic CP. For this, we used a crossover design with randomized treatment sequences. We stopped the trial early, i.e., after more than eight years, when only 16 of the intended 30 patients (34 including dropouts) finished the protocol, due to recruitment difficulties.

We hypothesized that a 5-week phase of RAGT would be superior regarding the improvement of walking abilities when compared to standard treatment with conventional physiotherapy for the same duration. The included participants covered a broad spectrum of our inclusion criteria regarding age, GMFCS-levels, and walking abilities. After about half of the intended number of patients finished the protocol, we could not confirm this hypothesis. While the lower power may have hampered statistically significant changes, the effect sizes of the primary and secondary outcome measures were not promising.

Existing evidence on the effectiveness of RAGT is weak and inconsistent [12]. Only four RCTs on RAGT with the Lokomat in children with CP have been published. Druzbicki et al. found no effects on kinematic and temporospatial gait parameters after four weeks with 20 sessions of RAGT in children with GMFCS levels II and III [19]. Peri et al. compared different protocols of gait training interventions with RAGT and task-oriented physiotherapy in 44 children with GMFCS level I–III [22]. While spatiotemporal and kinematic gait parameters did not change in any of the protocols, GMFM E scores improved significantly after 40 RAGT sessions over ten weeks, as well as after 40 physiotherapy sessions with standardized gait targeting exercises for the same period. Improvements (RAGT $+$ 3.5%, gait exercises $+$ 3.2%) exceeded the minimal important clinical difference in both groups. The GMFM D also improved considerably in both groups (RAGT $+$ 3%, gait exercises $+$ 5%), while the 6MinWT increased only in the RAGT group ( $+$ 21 m). However, these results did not reach statistical significance, and no differences between the intervention protocols were present. Surprisingly, the protocols with mixed interventions (a combination of 20 RAGT and 20 conventional gait therapy sessions over 4 or 10 weeks) did not reveal any significant changes at all.

In contrast to the studies described above, the two RCTs conducted by Wallard et al. (both seem to include a similar sample of 30 children with spastic CP, GMFCS-level II) found significant improvements in diverse kinematic parameters on the lower and upper extremities as well as in GMFM D and E scores after 20 sessions of RAGT [20, 21]. However, these two studies prompt various questions regarding the randomization and concealment of the allocation sequence procedure, the statistical analyses, and the standardization of the therapeutic interventions. Further, the clinical relevance of significant improvements in kinematic parameters of only a few degrees is at least questionable. The lower-level design studies on RAGT in children, which did not include a control group, yielded inconsistent results regarding improvement in gait speed, gait endurance, and gross motor function [12].

The results of our study imply that RAGT on an outpatient basis showed no effects on the investigated walking abilities in ambulatory children with bilateral spastic CP. Besides the statistically insignificant results, the effect sizes, except those of the 6MinWT, did not indicate any positive results either. Taking our findings and experiences conducting the trial over the past years into consideration, we have several points to address. Some aspects refer to a conceptual level regarding developing insights into the contents of a rehabilitation process based on the approach of the ICF-CY. Other aspects allow more profound methodological insights into working with a pragmatic trial design in general as well as in this particular patient group and setting.

Half of the children in our study had previous RAGT experience and completed their second or third RAGT phase. Because of our limited sample size, we could not investigate whether this previous RAGT experience influenced the outcomes. However, Schroeder et al. found that repetition of RAGT negatively correlates with improvement in GMFM scores [40].

Further, evidence exists indicating that the development of gross motor function in children with CP may vary in countries with different health services systems [41, 42]. In Switzerland, as in many other western European countries and Canada, children with CP are embedded in a timely and constant rehabilitation regime. Thus, children in our study already received a relatively large amount of therapy before their study participation. Our study results could indicate that in such situations, RAGT is not intensive or active enough to promote further improvement in these children.

Concerning the RAGT intervention itself, we tried to follow a pragmatic approach as much as possible. As methods and principles of RAGT application and the accompanying software changed over the last eight years, we always aimed to apply the current state-of-the-art training strategies when performing RAGT. For example, we continually implemented the latest Lokomat software and serious games and adjusted the training parameters individually to promote active participation in each child. In regular practice, we do not opt for an isolated Lokomat training in our center but always combine it with physiotherapy and sports therapy lessons, focusing on the same individualized goals within a multidisciplinary rehabilitation approach. These goals are defined in advance together with the children and parents to cover the areas that are most relevant to each family and thus mostly concern the activity and participation component of the ICF-CY.

For the trial, we selected the GMFM E as our primary outcome, because the GMFM was considered the gold standard for the evaluation of gross motor function in children with CP. However, in retrospect, it was not the most optimal choice for several reasons. Children with a GMFCS-level III and IV will be able to score only a few points at most. A substantial change in this group of children is not to be expected as the test was performed barefoot and without walking aids (according to standard practice in our center). Furthermore, a pragmatic study approach should reflect the personalized rehabilitation goals as best as possible. Thus, an individualized measurement instrument should be used as a primary outcome. Such measures will ensure that intervention studies examine results relevant to both the child and family as well as the rehabilitation team. For this purpose, for example, the Goal Attainment Scale (GAS) or the Canadian Occupational Performance Measure (COPM) may be a promising option, as the measures quantify the achievement of goals in a standardized way, while these goals can be individually set for each child [43, 44, 45, 46]. Both tools could be a feasible option as outcome measures in pediatric rehabilitation research [47]: In a recent study, 69% of the children with CP who had performed a clinical RAGT intervention had achieved their goals formulated with the GAS [48]. The COPM was successfully applied as an outcome measure in the RAGT study of Schroeder et al., where patient-selected participation goals showed clinically meaningful improvements [17]. Furthermore, the COPM score improvements in this study – unlike the GMFM changes – were not correlated with age, GMFCS-level, or the number of previous RAGT periods.

Our training protocol prescribed three RAGT sessions per week throughout five weeks – a frequency and duration that our team had considered clinically adequate and feasible on an outpatient basis. A 4–5 week period of 15–20 RAGT sessions also conforms to what is usually financed in children with CP by the health insurances in Switzerland. However, Peri et al. had adopted 40 therapy sessions within ten weeks in their groups with significant and clinically meaningful improvements, while their group with a mixed protocol of 20 RAGT and 20 physiotherapy sessions over four weeks did not improve [22]. The four-week RAGT intervention of Druzbicki et al. did not result in a positive effect either [19]. The duration of the applied RAGT period could be a crucial factor for the potential of improvement in these children.

A crucial methodological lesson learned from this trial involves the recruitment of study children. Although we took various actions to increase the number of participating children (prolonged trial duration, broadened eligibility criteria, expansion from a mono- to a bi-center trial), we had to recognize that achieving the calculated sample size within the next one to three years would have been unattainable. Due to our intention to explore the effectiveness of RAGT as a single intervention compared to a usual care approach (when we started our study, it was standard practice to compare single therapy interventions with one another), we decided not to conduct this study in our regular inpatient setting. In our rehabilitation center, children stay in the inpatient setting for many weeks and attend various therapy sessions and school, as it is the only rehabilitation center specifically for children in Switzerland. Offering only RAGT over several weeks instead of a whole rehabilitation treatment package would not have been acceptable under these conditions, neither for the families nor for the treatment team. Although we also treat children on an outpatient basis in our center, this fact, in retrospect, turned out to be one of the reasons that we were only able to recruit half of the anticipated children. Most families preferred to arrange the RAGT period during their child’s school holidays, to limit the burden on the child as much as possible. The geographically decentralized location of our center also brought considerable travel expenses for many families. These issues reduced the number of participants from the anticipated ten children to maximally two to three per year. We expanded the mono- to a bi-center trial after five years, enlisting the support of the Pediatric Therapy Center of the Rehabilitation center in Rheinfelden, the only other center with a pediatric Lokomat in Switzerland. Unfortunately, despite the local study coordinator’s high motivation and effort, no single child could be recruited in this second center.

To avoid such problems, recruitment should focus as much as possible on the patient population that is referred to the center for the intervention under study, thus representing everyday clinical practice. In this way, logistical challenges, planning efforts, and resources of participating and executing parties can be kept within a better manageable and foreseeable range. Moreover, the research question can be answered within the context it originated from and not in a more artificial situation.

Unfortunately, discontinuation and nonpublication of RCTs conducted in children have a high prevalence, with difficulties in patient recruitment being the most commonly mentioned reason [49]. Nevertheless, it is also crucial to publish results of such a trial for several reasons. In addition to providing at least an indication regarding the effectiveness of the intervention studied, researchers can share valuable information about the problems they were faced with when designing and conducting their study and the lessons that have been learned [50].

In general, it should be considered that design choices towards a more pragmatic or explanatory study design may affect validity, generalizability, precision, and feasibility [51]. Currently, the PRECIS-2 tool, which was developed to support researchers in designing trials, would be a helpful instrument to make informed decisions about the trials’ position on the pragmatic-explanatory continuum [52].

We opted for a crossover design because it was regarded as the optimal study design for small patient groups when the study protocol was established. Recognizing the lessons mentioned above as well as the present disadvantages of this design (longer trial duration, potential carry-over and period effects, higher drop-out rates, sophisticated statistical analyses) [53], other study designs, as n-of-1 trials, single case methodology designs, or observational designs, could be considered as possible alternatives to the chosen crossover design.

5. Conclusions

The results of our study indicate that 15 sessions of RAGT within five weeks are not effective in improving walking abilities in ambulatory children with CP. Our study adds to the limited evidence of RAGT in children with CP. However, the results of the current study must always be interpreted acknowledging that we could only include half of the targeted number of participants. We applied RAGT as a single intervention compared to usual care, in line with the methodological point of view when designing the study. Our results must therefore also be interpreted in this light. Currently, clinical recommendations are to embed its application in a holistic treatment with other therapies [10].

An inpatient approach, offering the possibility of higher RAGT dosages as an add-on therapy element within an individualized holistic treatment package – as it is common practice in our center – may be a more promising, although still challenging strategy to investigate the effect on walking abilities in children with CP living in Switzerland. Further high-level design studies are on the way [54], and until the publication of their results, we have to monitor each child carefully during a RAGT intervention to determine whether benefits are present that justify the efforts and costs of this highly specialized treatment approach.

Footnotes

Acknowledgments

We want to thank the children and their families for their effort in participating in this trial. Further, our thanks go to Julia Balzer, Berit Saupe, Irmi Schneider, Reto Cozzio, Corinna Gerber, Tabea Aurich, Judith Graser, Petra Hebeisen, Victoria Weps, Sandra Ricklin, and all the ETH master students at the Swiss Children’s Rehab for their help regarding the execution of assessments and training. We would also like to thank Corinne Messerli and the physiotherapists of the Pediatric Therapy Center of the Reha Rheinfelden for their willingness to work with us on this project. We further acknowledge the Zurich Center for Neuroscience (ZNZ) and the Children’s Research Center of the University Children’s Hospital Zurich (CRC). This trial was partly funded by the Mäxi-Foundation (Switzerland), the Donation UBS AG (by order of a client), and the Stiftung Cerebral (Switzerland). Trial registration number: NCT00887848.

Conflict of interest

The authors have no conflict of interest to report.

References

Rosenbaum

, Paneth

, Leviton

, Goldstein

, Bax

, Damiano

, et al. A report: The definition and classification of cerebral palsy April 2006. Dev Med Child Neurol2007; 49: 8–14. doi: 10.1111/j.1469-8749.2007.tb12610.x.

Novak

, Hines

, Goldsmith

, Barclay

. Clinical prognostic messages from a systematic review on cerebral palsy. Pediatrics2012; 130: e1285–312. doi: 10.1542/peds.2012-0924.

Beveridge

, Feltracco

, Struyf

, Strauss

, Dang

, Phelan

, et al. “You gotta try it all”: Parents’ experiences with robotic gait training for their children with cerebral palsy. Phys Occup Ther Pediatr2015; 35: 327–41.

Vargus-Adams

, Martin

. Domains of importance for parents, medical professionals and youth with cerebral palsy considering treatment outcomes. Child Care Health Dev2011; 37: 276–81. doi: 10.1111/j.1365-2214.2010.01121.x.

Moreau

, Winter

, Bjornson

, Hobbs

, Soileau

, Lahasky

. Effectiveness of rehabilitation interventions to improve gait speed in children with cerebral palsy: Systematic review and meta-analysis. Phys Ther2016; 96: 1938–54. doi: 10.2522/ptj.20150401.

Zwicker

, Mayson

. Effectiveness of treadmill training in children with motor impairments: An overview. Pediatr Phys Ther2010; 22: 361–77. doi: 10.1097/PEP.0b013e3181f92e54.

Tefertiller

, Pharo

, Evans

, Winchester

. Efficacy of rehabilitation robotics for walking training in neurological disorders: A review2011; 48: 387–416. doi: 10.1682/JRRD.2010.04.0055.

Meyer-Heim

, Borggraefe

, Ammann-Reiffer

, Berweck

, Sennhauser

FFH

, Colombo

, et al. Feasibility of robotic-assisted locomotor training in children with central gait impairment.pdf. Dev Med Child Neurol2007; 49: 900–6. doi: 10.1111/j.1469-8749.2007.00900.x.

Colombo

, Joerg

, Schreier

, Dietz

. Treadmill training of paraplegic patients using a robotic orthosis. J Rehabil Res Dev2000; 37: 693–700.

10.

Aurich

, Warken

, Graser

, Ulrich

, Borggraefe

, Heinen

, et al. Practical Recommendations for Robot-Assisted Treadmill Therapy (Lokomat) in Children with Cerebral Palsy: Indications, Goal Setting, and Clinical Implementation within the WHO-ICF Framework. Neuropediatrics2015; 46: 248–60. doi: 10.1055/s-0035-1550150.

11.

Borggraefe

, Klaiber

, Schuler

, Warken

, Schroeder

, Heinen

, et al. Safety of robotic-assisted treadmill therapy in children and adolescents with gait impairment: A bi-centre survey. Dev Neurorehabil2010; 13: 114–9. doi: 10.3109/17518420903321767.

12.

Lefmann

, Russo

, Hillier

. The effectiveness of robotic-assisted gait training for paediatric gait disorders: Systematic review. J Neuroeng Rehabil2017; 14: 1. doi: 10.1186/s12984-016-0214-x.

13.

Meyer-Heim

, Ammann-Reiffer

, Schmartz

, Schaefer

, Sennhauser

, Heinen

, et al. Improvement of walking abilities after robotic-assisted locomotion training in children with CP. Arch Dis Child2009; 94: 615–20.

14.

Borggraefe

, Meyer-Heim

, Kumar

, Schaefer

, Berweck

, Heinen

. Improved gait parameters after robotic-assisted locomotor treadmill therapy in a 6-year-old child with cerebral palsy. Mov Disord2008; 23: 280–3.

15.

Borggraefe

, Schaefer

, Klaiber

, Dabrowski

, Ammann-Reiffer

, Knecht

, et al. Robotic-assisted treadmill therapy improves walking and standing performance in children and adolescents with cerebral palsy. Eur J Paediatr Neurol2010; 14: 496–502. doi: 10.1016/j.ejpn.2010.01.002.

16.

Borggraefe

, Kiwull

, Schaefer

, Koerte

, Blaschek

, Meyer-Heim

, et al. Sustainability of motor performance after robotic-assisted treadmill therapy in children: An open, non-randomized baseline-treatment study. Eur J Phys Rehabil Med2010; 46: 125–31.

17.

Schroeder

, Homburg

, Warken

, Auffermann

, Koerte

, Berweck

, et al. Prospective controlled cohort study to evaluate changes of function, activity and participation in patients with bilateral spastic cerebral palsy after Robot-enhanced repetitive treadmill therapy. Eur J Paediatr Neurol2014; 18: 502–10.

18.

Smania

, Bonetti

, Gandolfi

, Cosentino

, Waldner

, Hesse

, et al. Improved gait after repetitive locomotor training in children with cerebral palsy. Am J Phys Med Rehabil2011; 90: 137–49. doi: 10.1097/PHM.0b013e318201741e.

19.

Druzbicki

, Rusek

, Snela

, Dudek

, Szczepanik

, Zak

, et al. Functional effects of robotic-assisted locomotor treadmill therapy in children with cerebral palsy. J Rehabil Med2013; 45: 358–63. doi: 10.2340/16501977-1114.

20.

Wallard

, Dietrich

, Kerlirzin

, Bredin

. Robotic-assisted gait training improves walking abilities in diplegic children with cerebral palsy. Eur J Paediatr Neurol2017; 21: 557–64.

21.

Wallard

, Dietrich

, Kerlirzin

, Bredin

. Effect of robotic-assisted gait rehabilitation on dynamic equilibrium control in the gait of children with cerebral palsy. Gait Posture2017; 11: 55–60.

22.

Peri

, Turconi

, Biffi

, Maghini

, Panzeri

Morganti

, et al. Effects of dose and duration of Robot-Assisted Gait Training on walking ability of children affected by cerebral palsy. Technol Heal Care2017; 9: 671–81.

23.

Ammann-Reiffer

, Bastiaenen

CHG

, Meyer-Heim

, van Hedel

HJA

. Effectiveness of robot-assisted gait training in children with cerebral palsy: A bicenter, pragmatic, randomized, cross-over trial (PeLoGAIT). BMC Pediatr 2017; 17. doi: 10.1186/s12887-017-0815-y.

24.

Thorpe

, Zwarenstein

, Oxman

, Treweek

, Furberg

, Altman

, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. J Clin Epidemiol2009; 62: 464–75.

25.

Senn

. Cross-over Trials in Clinical Research. 2nd ed. Chichester: John Wiley & Sons Ltd.; 2002.

26.

World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. JAMA2013; 310: 2191–4.

27.

Boutron

, Moher

, Altman

, Schulz

, Ravaud

. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: Explanation and elaboration. Ann Intern Med2008; 148: 295–309.

28.

Zwarenstein

, Treweek

, Gagnier

, Altman

, Tunis

, Haynes

, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008; 337.

29.

Russell

, Rosenbaum

, Cadman

, Gowland

, Hardy

, Jarvis

. The gross motor function measure: A means to evaluate the effects of physical therapy. Dev Med Child Neurol1989; 31: 341–52.

30.

Lundkvist Josenby

, Jarnlo

G-B

, Gummesson

, Nordmark

. Longitudinal construct validity of the GMFM-88 total score and goal total score and the GMFM-66 score in a 5-year follow-up study. Phys Ther2009; 89: 342–50. doi: 10.2522/ptj.20080037.

31.

Ammann-Reiffer

, Bastiaenen

CHG

, de Bie

, van Hedel

HJA

. Measurement properties of gait-related outcomes in youth with neuromuscular diagnosis: A systematic review. Phys Ther2014; 94: 1067–82. doi: 10.2522/ptj.20130299.

32.

Bjornson

, Graubert

, McLaughlin

. Test-retest reliability of the gross motor function measure in children with cerebral palsy. Pediatr Phys Ther2000; 12: 200–2.

33.

American Thoracic Society. ATS statement: Guidelines for the six-minute walk test. Am J Respir Crit Care Med2002; 166: 111–7. doi: 10.1164/rccm.166/1/111.

34.

Thompson

, Beath

, Bell

, Jacobson

, Phair

, Salbach

, et al. Test-retest reliability of the 10-metre fast walk test and 6-minute walk test in ambulatory school-aged children with cerebral palsy. Dev Med Child Neurol2008; 50: 370–6. doi: 10.1111/j.1469-8749.2008.02048.x.

35.

Fosang

, Galea

, McCoy

, Reddihough

, Story

. Measures of muscle and joint performance in the lower limb of children with cerebral palsy. Dev Med Child Neurol2003; 45: 664–70. doi: 10.1111/j.1469-8749.2003.tb00868.x.

36.

Hislop

, Montgomery

. Daniels’ and Worthinghams Muskeltests – Manuelle Untersuchungstechniken. 7th ed. München: Urban und Fischer Verlag; 1999.

37.

Wang

H-Y

, Yang

. Evaluating the responsiveness of 2 versions of the gross motor function measure for children with cerebral palsy. Arch Phys Med Rehabil2006; 87: 51–6. doi: 10.1016/j.apmr.2005.08.117.

38.

Cohen

. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale: Lawrence Erlbaum Associates; 1988.

39.

Fritz

, Morris

, Richler

. Effect size estimates: Current use, calculations, and interpretation. J Exp Psychol Gen2012; 141: 2–18. doi: 10.1037/a0024338.

40.

Schroeder

, Von Kries

, Riedel

, Homburg

, Auffermann

, Blaschek

, et al. Patient-specific determinants of responsiveness to robot-enhanced treadmill therapy in children and adolescents with cerebral palsy. Dev Med Child Neurol 2014; 1–8. doi: 10.1111/dmcn.12564.

41.

Hanna

, Rosenbaum

, Bartlett

, Palisano

, Walter

, Avery

, et al. Stability and decline in gross motor function among children and youth with cerebral palsy aged 2 to 21 years. Dev Med Child Neurol2009; 51: 295–302. doi: 10.1111/j.1469-8749.2008.03196.x.

42.

Smits

D-W

, Gorter

, Hanna

, Dallmeijer

, Van Eck

, Roebroeck

, et al. Longitudinal development of gross motor function among Dutch children and young adults with cerebral palsy: An investigation of motor growth curves. Dev Med Child Neurol2013; 55: 378–84. doi: 10.1111/dmcn.12083.

43.

Kiresuk

, Sherman

. Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Ment Heal J1968; 4: 443–53.

44.

Turner-Stokes

. Goal attainment scaling (GAS) in rehabilitation: A practical guide. Clin Rehabil2009; 23: 362–70.

45.

Law

, Baptiste

, McColl

, Opzoomer

, Polatajko

, Pollock

. The canadian occupational performance measure: An outcome measure for occupational therapy. Can J Occup Ther1990; 57: 82–7.

46.

Willis

, Nyquist

, Jahnsen

, Elliott

, Ullenhag

. Enabling physical activity participation for children and youth with disabilities following a goal-directed, family-centred intervention. Res Dev Disabil2018; 77: 30–9. doi: 10.1016/j.ridd.2018.03.010.

47.

Cusick

, Intyre

SMC

, Novak

, Lannin

, Lowe

. A comparison of goal attainment scaling and the Canadian occupational performance measure for paediatric rehabilitation research 2006; 9: 149–57. doi: 10.1080/13638490500235581.

48.

van Hedel

HJA

, Severini

, Scarton

, O’Brien

, Reed

, Gaebler-Spira

, et al. Advanced robotic therapy integrated centers (ARTIC): An international collaboration facilitating the application of rehabilitation technologies. J Neuroeng Rehabil2018; 15: 30. doi: 10.1186/s12984-018-0366-y.

49.

Pica

, Bourgeois

. Discontinuation and nonpublication of randomized clinical trials conducted in children. Pediatrics2016; 138: e20160223–e20160223. doi: 10.1542/peds.2016-0223.

50.

Khan

, Hills

. Can we trust the results of trials that are stopped early? BJOG An Int J Obstet Gynaecol2006; 113: 766–8. doi: 10.1111/j.1471-0528.2006.00972.x.

51.

Nieuwenhuis

, Irving

, Oude Rengerink

, Lloyd

, Goetz

, Grobbee

, et al. Pragmatic trial design elements showed a different impact on trial interpretation and feasibility than explanatory elements. J Clin Epidemiol2016; 77: 95–100. doi: 10.1016/j.jclinepi.2016.04.010.

52.

Loudon

, Treweek

, Sullivan

, Donnan

, Thorpe

, Zwarenstein

. The PRECIS-2 tool: Designing trials that are fit for purpose. BMJ2015; 350. doi: 10.1136/bmj.h2147.

53.

Mills

, Chan

, Wu

, Vail

, Guyatt

, Altman

. Design, analysis, and presentation of crossover trials. Trials2009; 10: 1–6. doi: 10.1186/1745-6215-10-27.

54.

Wiart

, Rosychuk

, Wright

. Evaluation of the effectiveness of robotic gait training and gait-focused physical therapy programs for children and youth with cerebral palsy: A mixed methods RCT. BMC Neurol2016; 16: 86. doi: 10.1186/s12883-016-0582-7.

Lessons learned from conducting a pragmatic,randomized,crossover trial on robot-assisted gait training in children with cerebral palsy (PeLoGAIT)

Abstract

PURPOSE:

METHODS:

RESULTS:

CONCLUSIONS:

Keywords

1. Introduction

2. Methods

2.1 Design and setting

2.2 Participants

2.3 Randomization

2.4.1 Usual care (C)

2.4.2 RAGT (T)

2.5 Outcome measures

2.5.1 Primary outcome measure

2.5.2 Secondary outcome measures

2.7 Statistical analysis

3. Results

Table 1 Descriptive characteristics of the study participants ( n = 16)

3.2 Secondary outcome measures

4. Discussion

5. Conclusions

Footnotes

Acknowledgments

Conflict of interest

References

Table 1
Descriptive characteristics of the study participants ( $n=$ 16)