Abstract
Pediatric traumatic brain injury (TBI) research depends on comparisons of profiles and outcomes between brain-injured individuals and groups consisting either of injured controls (e.g., orthopedic injuries, OI) or uninjured, typically developing children recruited from the community (community controls, CC). Children with OI are thought to provide optimal comparisons for individuals with TBI because they share injury-related experiences and pre-morbid characteristics; however, a study by Mathias and colleagues (2013) 1 in adults has called into question the added value of injury control groups in TBI research. The comparability of these control groups has not been established in young children. Seventy-two children with OI and 84 CC aged between 18 and 60 months were compared on a range of demographic variables, developmental and medical history, pre-injury behavioral and adaptive profiles, as well as on measures of adaptive functioning, behavior, family functioning, post-concussive symptoms, and cognition (intellectual functioning, verbal abilities, executive functioning, social cognition) 6 months after the OI. There were no statistically significant differences between the OI and CC groups on any of the variables tested, whether they related to pre-injury or post-injury characteristics. The findings are applicable to studies seeking to identify appropriate control groups in the context of preschool TBI research, and suggest no clear advantage in recruiting OI controls based on the variables studied and the methodology used. However, further work is necessary to verify additional factors and outcomes relevant to pediatric TBI research, as well as to compare outcomes between these two groups at more acute stages (i.e., prior to 6 months post-injury).
Introduction
C
Related to this issue, there is a debate as to what type of control group offers the best comparative approach for accurately reporting mTBI outcomes, and controls for potential pre-morbid problems and the medical experience. Non-injured children recruited from the community (“community controls” [CC] or “typically developing controls”) are most often used in pediatric mTBI studies, notably because they are numerous, accessible, and less costly to recruit. In addition, they are thought to be representative of population-level functioning and standardized test norms, 1 and offer the opportunity to compare children with TBI with the peers they are likely to be contrasted with in daycare, school, recreational, and community settings. OI control groups, on the other hand, have the advantage of being more comparable with those with mTBI at an experience-level because they go through similar medical processes (e.g., presentation to the Emergency Department, radiological exams, minor medical interventions, medication for pain, stress, etc.). 12 Children who sustain OI are also thought to present similar pre-morbid (e.g., attention problems, behavior) characteristics to those who incur mTBI, which may place them at similar risk for sustaining injury. 11,18,19 Demographic factors (e.g., socioeconomic status, congested living) and parenting practices (e.g., parental alcohol misuse, psychiatric history, unsupervised play) may also increase the risk of accidental injuries. 20 –22 However, despite studies reporting elevated pre-morbid attention and behavioral problems in children who sustain brain injury, 23 –25 there is little direct evidence showing that the prevalence is comparable to that of other injury groups.
In one of the largest studies of pediatric mTBI outcome to date, Babikian and colleagues found that when the effects of pre-injury risk factors and general injury experience are controlled for by comparing children with mTBI with an “other injury” control group, there was no evidence of long-term cognitive impairment in the mTBI group. 10 However, children with mTBI did show performance differences when compared with a non-injury control group, suggesting a general injury rather than a brain injury-specific effect. This and other studiese.g.,12,26,27 support the idea that injured control groups are the most methodologically sound choice for pediatric mTBI research.
Mathias and colleagues revisited the TBI control group debate in an adult population by directly investigating the comparability of community and OI control groups aged 18–80 years across a range of demographic, background, psychosocial, and cognitive variables, and found no statistically significant group differences other than on rate of alcohol use, which did not correlate with common variables of interest in TBI research. 1 The authors concluded that there appears to be no clear advantage in recruiting an injury control group in adult TBI research. It is possible, however, that the comparability of adult control groups does not extend to pediatric populations, as factors of influence are likely to be different. For instance, children are more subject to environmental influences such as parental education and family functioning than are adults. Children also typically have greater inter-individual variability in functioning because of normal variations in developmental trajectories and reliance on more diffuse cognitive and social brain network. 28 Differences between the two types of control groups may also be lessened in adults because of the greater adherence of adults to societal norms and expectations, and their increased ability to regulate and compensate for potential behavior or pre-morbid problems.
Children who sustain TBI before the age of 6 (i.e., preschoolers) represent a particular portion of the TBI population in which the choice of control group is especially relevant to study. First,TBI during this period is highly prevalent, with birth cohort data indicating an annual TBI rate of 1.85 per 100 children aged 0 to 5 years, compared with rates of <1.17 in other pediatric age groups. 29 Second, children of this age who sustain injury are likely to be highly vulnerable to adverse outcomes because any disruption in the acquisition or consolidation of rapidly emerging skills has the potential to set them back from typical developmental trajectories. 30,31 Third, preschoolers have short developmental histories in comparison with older pediatric age groups and adults and therefore less is known about their pre-morbid status. To date, researchers have used either CC or OI groups exclusively in their comparisons of preschoolers who sustain TBI with control participants. Whether they have favored CC 32,33 or opted for OI 34 groups, analyses have tended to show adequate matching on standard demographic variables such as age and socioeconomic status. However, these basic comparisons do not inform on other potential areas of dissimilarity between groups, such as behavior, family functioning, or cognition.
The objective of this study was therefore to address the question of optimal control group selection in pediatric TBI research, with a particular focus on those that are the most vulnerable, i.e., children under 5 years of age. Specifically, we aimed to compare OI controls with CC between the ages of 18 and 60 months on a range of variables relevant to development and to TBI, including demographics, developmental and medical history, behavior and adaptive functioning, family factors, post-concussive symptoms, global cognition, and aspects of social cognition and executive functioning.
Methods
Participants
As part of a prospective, longitudinal study on the consequences of early TBI, two groups of control participants were recruited and compared: 72 children who sustained OI were identified at an tertiary urban Emergency Department and 84 typically developing children were recruited from the community (CC). Inclusion criteria for the OI group were (a) age at injury between 18 and 60 months; (b) limb trauma leading to a final diagnosis of simple fracture, sprain, contusion, or unspecified trauma to an extremity. The CC were aged between 24 and 66 months in order to be of comparable age to the OI at post-injury assessment time-points. The following exclusion criteria were applied for all participants; (a) diagnosed congenital, neurological, developmental, psychiatric, or metabolic condition; (b) less than 36 weeks of gestation; (c) prior TBI; and (d) non-fluent in French or English.
Procedure
This study was approved by the Sainte-Justine Hospital Research Ethics Board. Recruitment of children who sustained OI took place in the Emergency Department at Sainte-Justine Hospital between 2011 and 2015. A research nurse approached potentially eligible participants. Once they agreed to participate, the research coordinator mailed a consent form and a pre-injury questionnaire booklet along with a sociodemographic questionnaire. The primary caregiver (90% mothers) was asked to answer the questionnaire based on their child's functioning prior to the injury. Six months later, children with OI were invited to the laboratory for a cognitive assessment and the primary caregiver completed the same questionnaire booklet (without the sociodemographic questions) along with a questionnaire pertaining to post-concussive symptoms.
The CC were recruited in daycare centers by research assistants. Given the absence of injury, the CC were tested right after recruitment, and the primary caregiver (89% mothers) completed all the questionnaires.
Measures
1. Questionnaires
2. General intellectual functioning
Global intellectual functioning and verbal abilities were measured for all participants. Children between 24 and 30 months at the time of the assessment were evaluated using the Cognitive and Language subscales from the Bayley Scales of Infant Development (Bayley-III), 42 and children older than 31 months completed the Wechsler Preschool and Primary Scale of Intelligence (WPPSI-III). 43 The Bayley-III Cognitive composite and the Global Index of the WPPSI-III were used as indicators of general intellectual functioning, whereas the language composite of the Bayley-III and verbal IQ from the WPPSII-III were used to reflect verbal abilities. Percentile ranks are reported, allowing direct comparison of the two cognitive tools.
3. Social cognition
False belief understanding. 44,45 Children are presented a peep-through picture book with deceptive elements (e.g., what appears to be an eye peeping through turns out to be a spot on a snake's back) to measure false belief understanding, a subcomponent of theory of mind. They are then asked to recall their own initial false belief about what they saw and to predict another person's false belief. Scores vary between 0 and 2.
Discrepant desires and Desires tasks. 45 –47 Depending on their age, children completed one of two developmentally appropriate tasks measuring desires reasoning, a subcomponent of theory of mind. Those aged 24 to 35 months were administered a task during which they must choose between two foods, one typically liked by children (e.g., cookies) and one that is generally less preferred (e.g., celery). Then, the experimenter expresses a preference for the children's non-preferred food and asks for another food item. The goal of the task is to assess whether children will answer egocentrically or will consider the experimenter's preferred food. A total of four food combinations are presented, for a maximum of four points. Children aged 36 months and older completed a measure of their understanding of how fulfilled and unfulfilled desires might affect a character's feelings in a story. The stories describe a character's search for a desired object and at the end of the story, children are asked to speculate whether the character is happy or sad. Six stories are presented, for a maximum score of 6 points.
4. Executive functions
Tower of Hanoi (planning). 48 Children were administered Welsh's simplified version of this classic planning task. Three different sized disks must be moved among three pegs to recreate a goal configuration in a minimum number of moves by always placing a small disk over a larger one. Children were asked to recreate six towers, for a maximum of 6 points.
Delay of gratification (inhibition). 49 Children must make a series of choices as to whether they want a smaller immediate reward or a larger delayed reward. Awards are crackers, coins, and stickers presented in small plastic containers. For example, the child must choose between a cracker to eat now, or six crackers to eat later “when all games are completed and you will return home.” One point is awarded every time the child selects the delayed reward for a maximum of 9 points.
Spin the pots (working memory). 50 Depending on their age, children are presented with 8–12 visually distinct boxes and 6–10 stickers. Stickers are placed in the boxes and children are encouraged to search for them. The boxes are rotated from one trial to the next so that the child must keep in mind where they have searched and found stickers previously. The task ends when the child has found all the stickers or when the maximum number of spins has been reached (12, 16, or 20 spins for respectively 8, 10, and 12 boxes). A final score is calculated as the proportion of stickers found to the total number of spins required to find all stickers.
Conflict scale (cognitive flexibility). 51 This task consists of four levels of increasing difficulty (Categorization/Reverse Categorization, Dimensional Change Card Sort (DCCS)–Separated, DCCS–Integrated, and DCCS–Advanced), and children begin the task at the appropriate level for their age. Children are asked to categorize items, either plastic animals or cards, according to a rule, and if they succeed on 5 trials out of 6, the rule is changed. For example, children are instructed to sort cards according to color (red or blue). Then, the experimenter announces that they will stop playing the “color game” and now play the “shape game.” Children must then sort cards according to shape (star or truck). There are 12 trials per level, for a maximum of 48 points.
Shape stroop (inhibition). 52,53 First, children are shown six cards depicting three fruits (three large and three small fruits). Children are asked to identify each fruit (e.g., “Show me the big apple”). Then, children are shown three cards, each depicting a small fruit embedded in a large fruit, and ask to point to each small fruit. A score out of 3 possible points is calculated.
Statistical analyses
All analyses were conducted using IBM SPSS Statistic Version 21 (SPSS Inc., Chicago, IL). Independent sample t tests were conducted for all continuous variables and chi-square (X 2) tests were conducted for all categorical variables. To be considered different, the group difference had to have a p value of <0.05 on the outcome variables. Additionally, effect sizes were calculated using Cohen's d for continuous data and Cramer's V for categorical data. Available-case analyses were performed, such that sample sizes ranged between 58 and 72 for the OI, and between 64 and 84 for the CC. Data were missing when the parents did not complete the questionnaire booklet, the cognitive assessment could not be performed due to lack of cooperation, or when participants from the OI group dropped out before the 6-month post-injury time-point.
Results
As displayed in Table 1, the OI and CC groups did not differ in terms of their age at assessment, socioeconomic status, parental education, gender, handedness, language, or ethnicity.
CC, community controls; CI, confidence interval; OI, orthopedic injuries; SD, standard deviation; SES, socioeconomic status.
In addition, there was no difference between the two groups in terms of developmental and medical history (Table 2). When presence of medical conditions was considered, only those that were exhibited by at least two participants in the sample were reported. Eye, ear, nose, and throat problems, gastrointestinal problems, and pulmonary problems were retained in the analyses, and the frequency was comparable in the two groups.
Pregnancy complication include gestational diabetes, preeclampsia, bleeding, placental abruption, placenta previa, anemia, Rh incompatibility, and infection.
Birth complication include abnormal presentation, prolonged labor, umbilical cord compression, cesarean, and assisted birth with forceps or ventouse.
Birth disorders include jaundice, cyanosis, fœtal distress, breathing difficulties, and hypoglycemia.
CC, community controls; CI, confidence interval; OI, orthopedic injuries; SD, standard deviation.
As can be seen in Table 3, children in the two groups did not differ on behavioral (ABAS and CBCL) or family characteristics (FAD, DAS, and PSI), as reported by the primary caregiver. These results were observed when analyzing both pre-injury and post-injury characteristics for the OI group. Only the difference for pre-injury (p = 0.08, d = 0.29) and post-injury (p = 0.05, d = 0.33) ABAS Conceptual scores approached statistical significance, though effect sizes were small. Because the ABAS Conceptual scale approached statistical significance, we verified the sub-scores and no significant group differences were found for the Communication, Functional Academics, or Self-Direction subscales (p > 0.05). No group differences were found on any of the CBCL subscales and total scores.
CBCL t scores are reported. T scores above 65 are considered “borderline,” and T scores above 70 are “in the clinical range.”
ABAS-GAC, Adaptive Behavior Assessment System-Global Adaptive Composite; CBCL, Child Behavior Checklist; CC, community controls; CI, confidence interval; DAS, Dyadic Adjustment Scale; FAD, Family Assessment Device; OI, orthopedic injuries; PSI-PD, Parenting stress index-parental distress; PSI-PCDI, Parenting stress index-Parent Child Dysfunction Interaction; SD, standard deviation.
Finally, cognitive measures and PCS ratings were obtained 6-month post-injury for the OI, and immediately after recruitment for the CC (Table 4). As expected, neither group reported elevated post-concussive symptoms and no group differences were found, whether in the last week or the past 6 months. When the OI and CC were compared in terms of their cognitive performance, they did not differ in terms of general intellectual functioning, verbal abilities, executive functions, or theory of mind.
CC, community controls; CI, confidence interval; OI, orthopedic injuries; PCS-I, Post-concussive Symptom Interview; SD, standard deviation.
Discussion
The aim of this study was to directly compare CC (or “typically developing”) and OI controls aged between 18 and 60 months on a range of variables relevant to early development and to pediatric TBI research. Contrary to the formulated hypothesis, the two groups did not differ on any variable tested, indicating similar demographic profiles (age, education, SES, gender, language, ethnicity, handedness), development (birth weight, Apgar, age at first words and first steps), medical history (pregnancy characteristics, birth disorders, medical problems, medication), behavior (internalizing and externalizing problems), adaptive functioning, family factors (family functioning, parental stress, relationship adjustment), concussion-like symptoms (PCS-I), cognition (IQ, verbal abilities, executive functioning), and social cognition (theory of mind). The results align with those of Mathias and colleagues who also compared these two types of control groups in a sample of adults between 18 and 79 years and found similarities between them across demographic (age, education, SES, gender), medical (medication use, medical diagnoses), psychosocial (fatigue, pain, depression, social support, concussion-like symptoms, community integration), and cognitive (IQ, motor and information processing speed, memory, verbal fluency, test effort) factors. 1 To our knowledge, the current study is the first to compare these control groups on pre-morbid functioning ratings and to conduct comparisons directly between OI and CC in children. Despite the numerous comparisons, no statistically significant group difference was found, and between-group effect sizes were small across all measures. Only pre-injury and post-injury measures of conceptual adaptive behavior (ABAS), which refers to communication, functional academics, and self-direction skills, approached statistical significance. Taken together, our results suggest no meaningful differences between OI and CC groups in a group of children aged between 18 and 60 months.
The findings of the current study further call into question the putative advantages of orthopedic versus community control groups. Because this study included some pre-injury questionnaires in the OI group, it is novel in suggesting that, contrary to the stated higher pre-morbid risk factors for sustaining injury in the OI group, 11,18,19 CC and OI start off with similar behavioral and adaptive functioning and do not differ on a range of demographic and developmental indicators that have potential relevance to the study of pediatric TBI. The data also suggest that despite experiencing trauma-related medical consultation and follow-up, the two groups do not differ on symptom outcome, behavior, adaptive functioning, family functioning, cognition, or social cognition 6 months after the orthopedic injury. Given the comparability of OI and CC, future TBI research could benefit from important cost savings and ease of recruitment by using CC. Nevertheless, our understanding of injury mechanisms is still in its early stages and recent work suggests that concomitant peripheral injuries can modify the outcomes and the pathobiology of TBI. 54 A comparison group of orthopedically injured individuals might help to control for these mechanisms that are not well understood at the moment.
Despite supporting the findings of Mathias and colleagues in adults, the results of this study should be construed in light of the particularities of the developmental period studied and caution should be exercised in generalizing the comparability of the two control groups to older pediatric stages. 1 Our sample consisted of preschoolers, aged between 18 and 60 months and, as the youngest members of society, preschoolers present the shortest developmental histories. As such little is known of their exact cognitive, social, and behavioral make-up. Children with known developmental, psychological, neurological, or other medical pathophysiology were excluded from the study, but it is possible that some individuals will go on to develop or be diagnosed with conditions (e.g., attention deficit hyperactivity disorder, learning disabilities, language delay) at older ages and this may later affect the comparability of the two groups. Moreover, there is evidence that children with developmental disability are more likely to sustain injury. 55 Future studies in older children and adolescents should verify whether the findings of this study extend upward through development and should carefully monitor the occurrence of developmental disabilities in populations of interest.
The data should also be interpreted alongside study limitations. Although the outcomes assessed are numerous and present a wide range of domains of functioning, they are limited to those included in the larger prospective study, and as such do not constitute a complete neuropsychological or psychosocial assessment. In addition, outcome was only evaluated at 6-months post-injury (for the OI group) and therefore the findings do not preclude the possibility that the two groups may have differed on outcome at more acute stages given the possible impact of pain, fatigue, post-traumatic stress, and other medical interventions in the OI group in the shorter term (acute–3 months). Attention, processing speed, reaction time, perceptual skills, and motor abilities may all be relevant to pediatric TBI populations and functioning in these domains should be compared in future studies. Given the young age of the participants, other individual and family variables may also be of interest, such as child temperament and parent psychological factors (e.g., anxiety and depression) in their parents. Finally, the participants in the study were compared on a measure of post-concussive symptoms given the high relevance of such a measure to studies of mTBI; however, there is currently no validated PCS questionnaire for infants, toddlers, or preschoolers. In the absence of any age-appropriate measure, the PCS-I was used, 41 (validated for youth 5 to 18 years of age). Future work developing and applying more developmentally appropriate scales of PCS in young children may reveal alternate findings.
Conclusion
Preschool children (i.e., 18–60 months of age) with OI present with demographic, developmental, medical, and pre-morbid behavioral and adaptive profiles comparable to those of control children recruited from community settings. They are also comparable on measures of adaptive functioning, behavior, family functioning, concussive-like symptoms, global cognition, executive functioning, and social cognition (theory of mind) when tested 6 months after injury. The findings are applicable to studies seeking to identify appropriate control groups in the context of pediatric TBI research and suggest no clear advantage of community versus injured controls in the youngest developmental age group, although further work should verify this conclusion in other domains of functioning, at more acute assessment time-points, and in older children. Also, the true comparability of the two control groups should be tested with respect to clinical groups of children with TBI across the range of severities and with respect to other cognitive outcome variables relevant to TBI research, such as attention, reaction time, and working memory.
Footnotes
Acknowledgments
This study was supported by the Canadian Institutes of Health Research (MOP11036 to M.H.B). Thank you to the LION study members and the ED team for their collaborative efforts.
Author Disclosure Statement
No competing financial interests exist.
