Abstract
Since imitation and joint attention are both important abilities for young children and since children with autism spectrum disorder show a range of problems in these domains, imitation and joint attention are important targets for intervention. In this study, we examined the possibility of promoting imitation and joint attention by means of a training programme specifically designed for low-intensity, non-residential treatment. Two matched groups of 18 children each participated in the study. The experimental group, receiving the training programme, improved significantly more on joint attention than the group receiving only treatment as usual. Only the experimental group obtained a significantly higher imitation score during the post-test compared to the pre-test. This study shows that it is possible to promote joint attention with a low-intensity treatment programme. The results concerning imitation are more modest. Future replications should involve measures of stability and generalization.
Introduction
In the first year of their life, before children are able to talk, they already communicate with their caregivers in a social, non-verbal way. Two abilities playing a prominent role in achieving this are imitation and joint attention. Imitation, defined as copying a model’s gestures, actions or words, seems to be present early in life (Heimann, 2002; Meltzoff and Moore, 1977; but see Anisfeld, 1996). In the infant, mutual imitation supports the continuation of mother–infant interaction (Kugiumutzakis, 1999). Imitation is also a strong means of communication in the interaction with peers: preverbal children will easily establish contact by imitating the play of the others (Nadel, 2002; Nadel-Brulfert and Baudonnière, 1982). By means of imitation, deferred imitation and recognition of being imitated, children increasingly gain experience about other people and the world, and gradually, they become aware of the mental states of other people, such as their intentions (Meltzoff and Moore, 1999, 2002). The early ability to imitate has also been linked to later language development: Charman et al. (2000) reported that object imitation at 20 months significantly predicted expressive language at 44 months in a group of typically developing children. In addition, Young et al. (2011) showed that increases in bodily, vocal and simple object imitation between 12 and 24 months were significantly related to expressive language and social engagement. In sum, imitation both serves a social and a learning function (Ingersoll, 2008).
In young children with autism spectrum disorder (ASD), the ability to imitate is usually more or less impaired (Williams et al., 2004). Especially non-meaningful gestures and novel object manipulations without an additional sensory effect seem to be difficult for children with ASD (Roeyers et al., 1998). An imitation impairment already discriminates infants who will later be diagnosed with ASD from infants without the disorder as early as 12 or 18 months of age (Robins et al., 2001; Young et al., 2011). The imitation problems in autism seem, however, to reflect a specific developmental delay rather than an absolute deficit: Sometimes simple imitation tasks do not discriminate between children with and without ASD, and older children with ASD have been reported to imitate (Charman and Baron-Cohen, 1994; Libby et al., 1997; Morgan et al., 1989). In addition, the growth trajectory of imitation between 12 and 36 months in children with ASD seems to parallel that of children without the disorder, albeit at a lower level (Young et al., 2011). It has been hypothesized that early imitation problems of children with ASD may lead to a weaker development of later social-communicative skills (Rogers and Pennington, 1991). Indeed, the presence of imitation seems to be predictive of more positive outcomes in children with ASD: Similar to typically developing children, a positive association has been found between imitation and subsequent language and play development in children with ASD (Charman et al., 2003; Stone et al., 1997; Stone and Yoder, 2001).
Next to imitation, a second pivotal skill in the early social-communicative development of infants is joint attention. Joint attention is the triadic coordination of attention between the child, a second person and a third event, object or person (Bakeman and Adamson, 1984). It implies more than just co-looking: both parties are aware of the focus of attention of the other person and therefore experience the mutuality of attention (Tomasello, 1995). In general, a distinction is made between imperative joint attention (or request), which serves an instrumental function, and declarative joint attention, which has the social function of sharing an interest in something with someone. In addition, a child can initiate (active) joint attention or follow the joint attention bid (passive joint attention) of someone else. In normal development, joint attention initially emerges in the form of gaze following (passive) in the second half of the first year of life (Butterworth, 1995; Corkum and Moore, 1998), or even earlier (Hoehl et al., 2009; Hood et al., 1998; but see Farroni et al., 2000). Shortly thereafter, by the age of 9 to 12 months, infants also actively try to involve others in bouts of joint attention, by gaze alternation, pointing and/or vocalizing (Tomasello, 2001). Sharing attention offers the child a possibility to share experiences and emotions with another person, meanwhile building and maintaining a relationship with that person. In addition, several authors have found a longitudinal association between early joint attention skills and later language and theory of mind (Markus et al., 2000; Morales et al., 1998; Tomasello and Farrar, 1986). For instance, Charman et al. (2000) found a significant association between joint attention skills at 20 months and theory of mind at 44 months. More recently, De Schuymer et al. (2011) reported longitudinal associations between gaze following at 9 and 14 months, initiating joint attention and behavioural requests at 14 months and receptive and expressive language at 30 months, both in typical and preterm children.
It is generally accepted that joint attention is, to a certain extent, impaired in children with ASD (see Bruinsma et al., 2004, and for reviews, see Charman, 1998). However, much depends on the form and the function of the behaviour and on the degree to which the child monitors and regulates the attention of the other person. For instance, declarative joint attention seems more impaired than imperative joint attention (e.g. Mundy et al., 1986, 1994; Sigman and Ruskin, 1999; Stone et al., 1997). The absence of pointing and showing discriminates infants with ASD from typically developing infants, already at their first birthday (Osterling and Dawson, 1994). Furthermore, an 18-month-old infant lacking declarative joint attention and symbolic play has a very high chance of being diagnosed with ASD (Baron-Cohen et al., 1992). Declarative, but not imperative, joint attention has been associated with ASD symptom severity (Mundy et al., 1994), concurrent language abilities (Bono et al., 2004; Charman et al., 2003; Dawson et al., 2004; Sigman and Ruskin, 1999) and social competence with peers (Meek et al., 2012).
In sum, imitation and joint attention are both present quite early in typical development, are both impaired or delayed in young children with ASD and seem to be positively associated with later development, both in typically developing children and children with ASD. Therefore, both abilities have been suggested to be important treatment goals in ASD (e.g. Ingersoll, 2008; Kasari et al., 2010; Mundy and Crowson, 1997; Poon et al., 2012; Rogers, 1999).
Several comprehensive programmes developed for young children with autism include imitation as an important treatment goal (e.g. the Walden Toddler Program; McGee et al., 2000). Once established, imitation is often used as a means to teach the children other skills. Ingersoll (2008) distinguished this learning function of imitation from its social function. She stressed that treatment of children with autism should also explicitly address this social function, since children who learn to imitate in a structured situation do not generalize this to spontaneous imitation in other settings (Whiten and Brown, 1998). However, it seems that spontaneous imitation in a social context is more strongly related to social reciprocity and symbolic play than imitation in a structured context, although both forms of imitation are related to vocabulary development (Ingersoll and Meyer, 2011).
Like imitation, joint attention (in different forms and functions) is often included as a treatment target in comprehensive treatment programmes, such as the Early Start Denver Model (Rogers and Dawson, 2009). In addition, several studies have reported results of more specific interventions, where joint attention was targeted as an isolated skill or one of a limited number of skills (e.g. Drew et al., 2002; Kasari et al., 2006). Although it is recommended to directly target joint attention in autism interventions in order to obtain an increase in joint attention behaviour (Mundy, 1995; Whalen and Schreibman, 2003), a recent review by White et al. (2011) suggests that joint attention can also increase when not directly targeted (e.g. as a collateral outcome in play interventions). This may be especially the case for responding to joint attention (Meindl and Cannella-Malone, 2011). Successful teaching or promoting of joint attention often occurs in the context of play, combining a developmental approach with behavioural techniques, such as reinforcement (White et al., 2011). Meindl and Cannella-Malone (2011) report that a large number of studies have used tangible reinforcers or access to preferred activities to teach initiation of joint attention. They note that this may result in requests instead of declarative joint attention behaviour, and instead recommend the use of social attention or social interaction as the main reinforcer.
In addition to the evidence that imitation and joint attention can, to a certain extent, be taught to or promoted in young children with ASD, there are also indications that the effect of these interventions may expand to other social-communicative abilities and language skills (Ingersoll and Schreibman, 2006; Jones et al., 2006; Kasari et al., 2008; Whalen et al., 2006). Therefore, following international tendencies, during the last decade, the importance of stimulating these abilities has been recognized in Belgium as well.
In Flanders (the Dutch-speaking part of Belgium), preschoolers with ASD often go to regular schools, unless they have a (severe) intellectual disability. In addition to their regular education, they are treated in non-residential, multidisciplinary rehabilitation centres. This treatment usually takes 3–5 h per week. Given the benefits of early diagnosis and intervention for both the children with ASD and their families (e.g. Corsello, 2005; Filipek et al., 1999; Wetherby et al., 2004), and given the pivotal role of imitation and joint attention in development, we developed a small-scale intervention programme with a focus on both imitation and joint attention, tailored to the needs and possibilities of these rehabilitation centres. During the past decade, several effective intervention programmes have been described (see White et al., 2011 for an overview of joint attention programmes, and Ledford and Wolery, 2011 for an overview of imitation programmes). However, we had several reasons for developing a new intervention programme. First, most of the internationally available treatment programmes for ASD involve many more hours per week and are designed for children who do not attend school. Second, some of the treatments used in previous research were not commercially or freely available or required a specific and time-consuming training. Third, we found no programme available that explicitly targeted imitation and joint attention in a limited number of sessions, and that could be done by general professionals. Therefore, we decided to develop new intervention sessions, taking into account both the practical situation in Flanders and the recommendations from international research. Our primary research goal was to test whether it is possible to promote imitation and joint attention in preschoolers with ASD in a limited time frame, with a relatively low treatment intensity.
Methods
Participants
A total of 48 children participated in the study. They were recruited through 10 local rehabilitation centres. The inclusion criteria for the study were as follows: having a chronological age between 3 and 7 years, a mental age below 7 years and a basic language understanding (sufficient to understand simple requests and instructions). The maximum mental age of 7 years was chosen because the intervention and its materials were most suited for preschoolers’ developmental levels. In addition, since imitation and joint attention seem to improve with increasing chronological and mental age, the need for imitation and joint attention training is the most urgent in or before the preschool years. All children had a diagnosis of ASD (either autism or pervasive developmental disorder–not otherwise specified (PDD-NOS) according to Diagnostic and Statistical Manual of Mental Disorders (4th ed., text rev.; DSM-IV-TR; American Psychiatric Association (APA), 2000) criteria). These diagnoses were not confirmed by the researchers but made by experienced multidisciplinary teams in the community. All parents signed an informed consent prior to the participation of their children. The children were matched pairwise on pre-test imitation/joint attention score (accepted range (AR) from +5 to −5 points), age (AR from +6 to −6 months) and full-scale IQ (FSIQ; AR from +5 to −5 points). In addition, we tried to match groups as well as possible on language age and gender. IQ and language age were abstracted from the children’s records. IQ of the children was assessed by the community teams by means of the Wechsler Preschool and Primary Scale of Intelligence–Revised (WPPSI-R; Wechsler, 1989, Flemish norms by Vander Steene and Bos, 1997), and language age was assessed by the community teams by means of the Flemish version of the Reynell Developmental Language Scales (RDLS, Flemish version by Schaerlaekens et al., 1993) and/or the Schlichting Test for Language Production (Schlichting et al., 1998). IQ and diagnostic assessment were done by the community teams within the year prior to the start of the intervention (mean time interval = 9.05 months, standard deviation (SD) = 3.28). Language assessment was done on average 6.55 months (SD = 3.79) before the start of the intervention. We estimated the child’s language age at the start of the intervention by calculating language age at the time of the language assessment/chronological age at the time of language assessment × chronological age at the time of pre-testing. Of each pair of children, one child was randomly assigned to the experimental group, and the other was included in the control group. In order to make sure that the experimental group was spread evenly over the participating centres, we controlled for centre during randomization. This was done by, as much as possible, assigning every other child from the same centre to the experimental group, resulting in about half of the children in every centre receiving the intervention. The majority of the therapists involved in the study treated both children in the intervention group and children in the control group. Parents were not explicitly told the group membership of their child, but they were informed of treatment status and possible progress after the study ended. However, since a substantial number of parents regularly followed the treatment sessions of their children, it was not possible to keep these parents completely blind for treatment content. Three children did not finish the entire training. In two children, the video of the pre- or post-test did not allow for reliable coding. An additional child obtained a ceiling score on the pre-test. These six children were not included in the final sample. In addition, the six children who were matched pairwise to these children were also excluded from the sample. Details about the 36 remaining children are shown in Table 1. Independent samples t-tests confirmed that the groups did not differ on the pre-test characteristics (all p > .50, except for verbal IQ (VIQ) with a p > .30).
Participant characteristics.
SD: standard deviation; FSIQ: full-scale IQ; VIQ: verbal IQ; PIQ: performance IQ; JA: joint attention.
Procedure
After the children were assigned to their groups, a research assistant pre-tested them at the rehabilitation centre. The procedure of this pre-test is described below. During this appointment, the child’s usual therapist (psychologist, speech-language therapist or special educationalist) received the training package. This package consisted of the written training sessions, the materials needed for the exercises and an extensive manual for the trainer, in which the rationale for the training was explained, possible problems were explored and guidelines for the trainer’s behaviour and degrees of scaffolding were provided. The trainers were encouraged to contact the first author in case of questions. Most of the trainers also tried out previous versions of the training and/or attended a 1-day seminar on imitation and joint attention given by the first author. As soon as possible after the pre-test, trainers started the intervention with the child. The goal was to deliver two 30-min sessions per week to the child, although this was not always achieved due to issues such as absence or illness of the trainer. The missed sessions were never skipped but always postponed, resulting in a mean pre–post interval of 4.5–5 months, instead of the 3.5–4 months we estimated in advance. The sessions replaced two sessions of the regular treatment of the child. The children in the control group continued with their regular treatment. Since children receive comparable hours of treatment in the different rehabilitation centres and since all centres had children in the experimental as well as the control group, both groups of children received very similar amounts of treatment (i.e. 3–5 h per week, of which about 1 h of the specific imitation/joint attention training for the children in the experimental group). Given that established intervention models such as Applied Behaviour Analysis (e.g. Lovaas, 1987) or Treatment and Education of Autistic and related Communication Handicapped Children (TEACCH; Schopler et al., 1984) are not widespread enough in Flanders to serve as comparison treatment and due to other methodological (same amount of treatment and same therapists in both groups), practical (no possibilities to increase the number of treatment hours in both groups) and ethical reasons (no forced waiting list), we judged that this design would be the most appropriate one in the current conditions, yielding the most valid and reliable results. After the last session was completed, the child’s imitation and joint attention skills were assessed by a research assistant naïve to group membership of the child, following the same protocol that was used during the pre-testing. Control children were post-tested after a comparable time interval (see Table 1 for details).
Pre–post assessment
Although there are several protocols available for testing imitation and/or joint attention, to our knowledge, they all measure only part of the abilities we targeted in the intervention, or they cannot be scored in sufficient detail to allow for a measure of short-term change. Therefore, we designed a new pre–post assessment, combining and adapting existing methods. The tasks were aimed at assessing a wide range of imitation and joint attention abilities, both elicited and spontaneous. The assessment was always conducted in a quiet room at the child’s rehabilitation centre, with experimenter 1 and the child sitting at a table, facing each other. A second experimenter was present to videotape the interaction and to activate the toys used for eliciting declarative joint attention. The assessment was semi-standardized, meaning that the experimenter always conducted the tasks in the same way and with the same materials, but that some adjustments in timing and order of the tasks were allowed when needed. Table 2 summarizes the items administered during the test, as well as the scoring criteria. The tests were administered and simultaneously scored by three trained research assistants, naïve to group membership. Each test was videotaped, so that scoring could be verified afterwards. A total of 11 test protocols were scored by all three coders (based on the video). Inter-rater reliability, expressed in kappa (Cohen, 1960), varied between .60 and .93 for the joint attention scores and between .72 and .85 for imitation scores. These are good to excellent scores (Cohen, 1960). The number of spontaneous imitations could not be scored reliably. This was mainly due to the difficulty of describing unequivocal coding rules that applied to the large variety of imitated actions.
Pre–post items and scoring criteria.
Max: maximal score that could be obtained during one test.
Recommended order of the items: free play with blocking (3 times) and teasing (3 times), gaze following 1, initiating requests 1, initiating declarative 1, following requests 1, gaze following 2, initiating requests 2, initiating declarative 2, following requests 2, gestural imitation, verbal imitations, object imitation, symbolic imitation.
The intervention
The intervention was developed over a time-course of several years. During the development of the training, there were two large process evaluations. These evaluations involved the trainers filling in a form for each session and an overall evaluation. The intervention was evaluated on feasibility, degree of difficulty, appeal, duration, variation, completeness and trainer support. In addition, by means of open-ended questions, we invited the trainers to provide us with as much feedback as possible. After every evaluation, the training was adapted to meet as many of the comments and questions as possible (e.g. changing the order of the sessions and exercises within the sessions, making exercises more enticing to the child and suggesting other materials). The current intervention consists of 24 sessions, each lasting about 30 min. Every session includes imitation as well as joint attention exercises. The sessions gradually increase in difficulty, based on the spontaneous development of both typically developing children and children with ASD. Gestural and vocal imitation and object imitation are presented alternately, in order to keep the child motivated, with a particular focus on the social function of imitation. Symbolic imitation is promoted in the last few sessions, but only for children who obtained a sufficiently high level of procedural imitation. Joint attention tasks evolve from following and initiating requests to following and eventually initiating declarative joint attention. However, because initiating joint attention is the most difficult behaviour to elicit and the possibilities to elicit it are usually quite short (e.g. an unexpected event), the possibility to initiate joint attention is included in most of the sessions. In all joint attention exercises, the reward is as natural and as social as possible. An overview of the abilities targeted in the 24 sessions is provided in Table 3. However, many of the tasks and games allowed for the stimulation of other abilities as well. This was also explicitly mentioned in the descriptions. The exercises involve a combination of behavioural and developmental techniques, such as modelling familiar acts in the first sessions and gradually moving on to more unfamiliar or novel actions (Responsive Imitation Training; Ingersoll et al., 2007; Ingersoll and Schreibman, 2006), following the child’s lead (Pivotal Response Training; Koegel and Koegel, 2006), embedding the exercises in typical activities (Incidental Teaching; McGee et al., 1999) and an emphasis on reciprocity (Responsive Teaching; Mahoney and Perales, 2003). A lot of attention is paid to motivating the children, for instance, by designing exercises that can be done with different materials (paint, pencils, crayons, play-dough etc.), depending on the child’s preference, by making the activities rewarding by themselves (e.g. mixing colours in a specific order and then being allowed to paint with it), by imitating the child and encouraging the child to model an action, by embedding the imitation of actions that are less rewarding by themselves within a favourite board game and by using a variety of reinforcers such as social (praise, adapted to preference and tolerance of the child), tangible (stickers) and natural consequences (access to preferred toys or activities). Examples of the exercises and games are provided in Table 4. Finally, we built in a fair amount of flexibility in timing, amount of support provided to the child, interaction style, amount of repetition, materials and so on, in order for the therapists to adapt the training to the needs and interests of each child and to make sure these experienced therapists would also feel comfortable with the training themselves. Together with the intervention sessions, the trainers received general instructions on the goal of the intervention, where for every skill, the hierarchy of possible support given and possible reinforcement were described. This is summarized in Table 5.
Intervention: overview of skills addressed in different sessions.
Intervention: examples of games/tasks.
Intervention: overview of general instructions.
Treatment as usual
The control group received the treatment as usual. Recently, a survey was conducted in the Flemish centres treating young children with autism (Van der Paelt et al., 2012). The most frequently mentioned treatment goals were communication, social skills, language, play and motor skills. Imitation was mentioned as a treatment goal in only 6% of the respondents, and joint attention in only 2%. No specific programmes targeting imitation and/or joint attention were used. In this study, the therapists delivering the treatment to the control group were explicitly asked not to use exercises or techniques from the intervention package and not to change the focus and goals of the treatment as usual based on their knowledge of the intervention package. They were explained the reasons for not doing so, and they were given the option to use the intervention, or parts of it, after the post-testing of the control group was done.
Data analysis
In addition to the item scores displayed in Table 2, two composite scores were calculated. The Total Joint Attention score is the sum of the scores on reaction to ambiguous behaviour, gaze following, initiating requests and initiating declarative joint attention (see Table 2 for a description of these tasks). Following requests was left out of this total score, since a majority of the children obtained a maximal score on this item (23 out of 36 children on pre-test). Since we wanted all items to contribute equally to the total score, we summed the proportional scores (score of the child/maximal score of the item) instead of the absolute values. Consequently, this joint attention test score has a maximum value of 4. Similarly, a Total Imitation score was computed as a sum of gestural, vocal and object imitation, the number of actions imitated during symbolic imitation and the number of vocalizations imitated during symbolic imitation (see Table 2). Again, we calculated and summed the proportional scores of the five imitation variables, resulting in a maximum value of 5.
To answer the question whether the experimental group has made more progress than the control group, we performed repeated measures analyses of variance (ANOVAs) with pre–post score as the within-subjects factor and group as the between-subjects factor. However, since the control group also received autism-specific treatment, we additionally analysed progress for each group separately. This was done by paired-samples t-tests. Given that Bonferroni and related corrections strongly increase the chance of making Type II errors and that the Bonferroni method is primarily designed for testing the general null hypothesis (for an overview of these arguments, see Nakagawa, 2004; Perneger, 1998), and since in our study we test specific hypotheses and the chance of making Type II errors is already high due to our small and heterogeneous sample and due to small to medium expected effect sizes, we decided not to perform a correction for multiple testing. Finally, we also explored which subject characteristics possibly contributed to the child’s progress. This was done by Pearson’s correlations.
Results
Did the experimental group make more progress than the control group?
The group × pre–post interaction factor was significant for the Total Joint Attention score, indicating that the experimental group made more progress than the control group (F(1, 34) = 9.341, p < .01). Within the specific joint attention tasks, this was especially the case for gaze following (F(1, 34) = 6.507, p < .05) and initiating requests (F(1, 34) = 3.976, p < .05). Initiating declarative joint attention significantly decreased in both groups between pre- and post-test (F(1, 34) = 6.629, p < .05).
No significant group × pre–post interaction was found on the domain of imitation. There was, however, a main effect of time, with a significant pre–post gain for both groups combined, for Total Imitation, object imitation and number of imitated actions during symbolic imitation (F(1, 34) = 16.635, p < .001; F(1, 34) = 5.073, p < .05; and F(1, 34) = 15.667, p < .001, respectively). See Table 6 for exact scores and results of the ANOVAs.
Pre–post scores, results of the repeated measures ANOVAs and effect sizes (
JA: joint attention
p ≤ .05
p < .01
p < .001.
Did each group make progress?
The experimental group showed a significant gain in the Total Joint Attention score (t(17) = −2.066, p ≤ .05). This was also seen on the item scores of gaze following, initiating requests and spontaneous declarative joint attention (t(17) = −2.848, p < .05; t(17) = −2.404, p < .05; and t(17) = −2.093, p ≤ .05, respectively). Children who received the targeted intervention also had significantly higher Total Imitation scores after the training, compared to before (t(17) = −3.976, p < .001). This was largely due to an improvement in the number of symbolic imitation actions (t(17) = −3.169, p < .01).
The children in the control group had a lower joint attention score on the post-test compared to the pre-test (t(17) = 2.252, p < .05), but this was largely due to the significant decrease in their initiating declarative joint attention (t(17) = 2.263, p < .05). The other joint attention scores for the most part remained stable. The control group showed no significant improvement on the Total Imitation score (t(17) = −1.860, p = NS), but they did, however, obtain higher scores on the second testing for object imitation and number of symbolic imitation actions (t(17) = −2.600, p < .05 and t(17) = −2.470, p < .05, respectively).
Which participant characteristics may contribute to progress?
To explore the relation between child characteristics and individual progress, we calculated Pearson correlations between the children’s age, verbal mental age, FSIQ, VIQ, performance IQ (PIQ) and imitation and joint attention pre-test score on the one hand, and their progress in imitation and joint attention (expressed as a difference score between post- and pre-test) on the other. In the experimental group, VIQ was significantly positively correlated with progress in imitation (r = .767, p < .05). There were no other significant correlations.
In addition, we explored the progress of subgroups of children based on their FSIQ or age. In the experimental group, the children with an average FSIQ (85–115; n = 8) on average improved .52 points on joint attention and .61 points on imitation. The children with a mild intellectual disability (FSIQ = 50–70; n = 7) improved on average .31 points on joint attention and .32 points on imitation. This difference was not significant (F(2, 12) = .409,
Discussion
Since imitation and joint attention are both important abilities for young children and since children with ASD have well-documented problems on these domains, imitation and joint attention are important targets for intervention. In this study, we examined the possibility of promoting imitation and joint attention by means of a training programme specifically designed for low-intensity, non-residential treatment. In the intervention, special attention was given to the social role of imitation. Joint attention was directly targeted, and inasmuch as possible rewarded in a social and natural way.
The training seemed to be especially successful in promoting joint attention. Not only did the children in the training group show a substantial improvement in joint attention skills, this improvement was also significantly larger than in the control group. Gaze following and requesting seemed to be most responsive to this treatment. This corresponds with the typical development of children with ASD, where gaze following and initiating requests seem to be the least impaired in older, more able children (Charman, 1998; Warreyn et al., 2007). It may also have been easier to learn these skills, since there was almost always some instrumental reward following the behaviour of the child, mostly obtaining a desired object (either by requesting or by following gaze to see where the object was hidden). Perhaps the most difficult to teach is initiating declarative joint attention, since this requires the initiative of the child and serves a social, not instrumental, function. Previous studies also show more substantial and more stable intervention effects for responding (or following) joint attention behaviour compared to initiating, and for requesting compared to declarative behaviour (e.g. Hwang and Hughes, 2000; Kasari et al., 2010). At first sight, our training did not seem very successful in promoting declaratives, since this behaviour decreased significantly from pre- to post-treatment. However, it is very likely that the children did show less elicited declarative behaviour the second time because they were not surprised anymore by the suddenly appearing objects (used to elicit declaratives). If we had used new objects for the post-test, their reaction may have been more enthusiastic. In addition, the increased number of spontaneous (non-elicited) declaratives in the experimental group does suggest a positive training effect.
The results concerning imitation progress were modest: the training group did not show more improvement than the control group. However, the children receiving the training did show a significantly higher Total Imitation score at the post-test compared to the pre-test, while the Total Imitation score of the control children remained stable. The control children, on the contrary, also showed improvement on some aspects of imitation. Although we could not control for the contents of the treatment as usual that the control children received, a recent survey conducted in Flanders showed that this is not very often an explicit treatment target (Van der Paelt et al., 2012). The progress the control group made on the domain of imitation may therefore reflect a side effect of the treatment as usual, or the natural development of these children. The observation that the experimental group, in contrast to the control group, had a significantly higher Total Imitation score at the post-test compared to the pre-test may suggest that the intervention was somewhat effective in promoting imitation. However, since the group × pre–post interaction was not significant, we cannot conclude that it was more effective than treatment as usual.
Since every training session included imitation as well as joint attention exercises and since improvement in one domain may lead to (collateral) improvement in the other (e.g. Whalen et al., 2006), it is not possible to disentangle the effects of the imitation exercises from those of the joint attention exercises. Both abilities may not be independent. However, in our study, pre- and post-scores of imitation and joint attention did not correlate significantly (pre-score: r = −.044, p = NS; post-score: r = .206, p = NS), neither did the children’s progress in the two abilities (experimental group: r = .310, p = NS; control group: r = −.254, p = NS).
We found few interrelations between child characteristics and progress. The positive correlation between VIQ before the training and imitation improvement is consistent with previous research. However, while imitation is usually seen as a positive predictor for later language development, this study shows that the influence may also be applicable in the opposite direction. There were no substantial correlations between age and improvement and, apart from the above mentioned, between IQ and improvement. In addition, we found that children in the average FSIQ group and children in the mild intellectual disability group benefited equally much from the intervention, as did the older children compared to the younger children. Given the limited number of children these analyses were performed on, we must acknowledge the possibility that the absence of significant age and IQ effects is due to a limited power. However, the correlations found between age and IQ on the one hand and imitation and joint attention improvement on the other hand were weak (all r < .30) and the effect sizes were small. This suggests that the training may be useful for the entire age range and IQ range studied (4–7 years, FSIQ = 50–103), although replication with a larger sample is recommended. Based on our findings, we cannot recommend the intervention to children with IQs above average, since there were no such children included in our sample. Nevertheless, if these children also show impairments in imitation and joint attention, we see no contraindications to use the intervention with these children on an individual basis. Given the positive results of the study, a Dutch transcript of the training session and instructions is available upon request and has been informally distributed in rehabilitation centres. It will also become commercially available.
Limitations
In this study, we were not able to assess the stability of the children’s progress. There was also no assessment of generalization to other persons or situations. We chose to include parent questionnaires in the pre–post measures, but our attempts to do so resulted in questionable data. Given that we were not able to keep all parents blind to group allocation of their child (the most obvious reason for that is that some parents regularly follow the treatment sessions of their child), it was impossible to ask parents for an unbiased evaluation of their child’s social-communicative skills. In addition, in previous pilots of the intervention, we noticed that asking parents to fill in one or more questionnaires resulted in a significant loss of participants. Therefore, this time, in order to obtain an adequately large sample, we also allowed children in the intervention if their parents did not want to fill in questionnaires. However, since the trainer (the child’s own therapist) and the tester (a research assistant) were two independent persons and the trainer was not present at post-testing, we do have some indication that the learned abilities were generalized to interactions with at least one other person. A second limitation of the study was the absence of control over the treatment of the control group. Since it would not be ethical to deprive the control children of their regular treatment, we limited ourselves to asking about treatment goals. The most frequently named goals were imitation, communication, basic social skills and behaviour management. Allowing the regular treatment to continue did, however, teach us that our training can be a valuable addition to the currently available programmes. Third, we did not confirm the children’s ASD diagnoses with the Autism Diagnostic Interview–Revised (ADI-R) (Rutter et al., 2003) or the Autism Diagnostic Observation Schedule (ADOS; Lord et al., 1999). However, all children had a community diagnosis made by an experienced multidisciplinary team according to DSM-IV-TR criteria. In addition, since both groups had ASD, it was not necessary to discriminate the groups by means of ADI-R/ADOS data. However, the lack of ADI-R/ADOS data also did not allow us to match both groups for levels of symptom severity, or to investigate the relation between autism severity and the progress the children made. Since symptom severity is not often assessed in common practice in Flanders, no other measures for these variables were available. Fourth, the current sample is not very large, probably limiting the statistical power of the analyses. In addition, as described above, 12 of the initial 48 children were not included in the sample, resulting in a relatively high attrition rate. Finally, we included no formal measure of treatment fidelity in this study. Again, during piloting of previous version of the intervention package, we noticed that due to time constraints, therapists were likely to drop out of the study if they were required to fill in documents or answer questions about their understanding and application of the training sessions and background. By corresponding with the trainers by phone and by email, by delivering the most specific materials and by explicitly asking for feedback, we were confident that the trainers followed our instructions for delivery of the intervention quite well.
A final consideration we need to make is whether, although statistically significant, the changes observed in the experimental group are clinically significant. On average, they improved .34 on the Total Joint Attention score and .52 on the Total Imitation score. This refers to an increase of 23% and 17%, respectively, compared to the pre-test score. In terms of actual behaviour, the children in the intervention group increased their number of elicited joint attention acts from 6.53 to 8.41 (+1.88), their number of spontaneous declarative joint attention acts from .89 to 1.72 (+ .83) and their number of correct imitations from 34.11 to 41.12 (+7.01). The time frame in which the joint attention acts were coded was about 10 min, and the time frame for imitation acts was also about 10 min. Given these numbers, we believe that this increase, especially in joint attention behaviour, is clinically relevant.
Conclusion
Altogether, we believe that the results of this study are promising. We have shown that it is possible to promote joint attention in a quite limited number of sessions, over a rather short period of time. The results concerning imitation were less pronounced: although the experimental group showed a significant improvement on this domain, the improvement was not significantly larger than that in the control group. Since health care puts more and more emphasis on evidence-based, cost-effective treatment, we believe that the proposed approach makes a valuable contribution to treatment of children with ASD. Future research examining long-term effects, generalization and possibly other treatment goals is desirable.
Footnotes
Acknowledgements
The authors wish to thank the centres, children and therapists for their participation and valuable feedback, and Sig vzw for their help in recruiting. The work of the authors was supported by the ESF COST Action BM1004 Enhancing the Scientific Study of Early Autism (ESSEA)
Funding
During the time of this research, the first author (P.W.) was supported by grants from the Marguerite-Marie Delacroix Foundation and VVA, the Flemish Parent Association.
