Abstract
BACKGROUND:
Adults with chronic traumatic brain injury (TBI) may experience long-term deficits in multiple cognitive domains. Higher-order functions, such as verbal memory, are impacted by deficits in the ability to acquire verbal information.
OBJECTIVE:
This study investigated the effects of a neuroplasticity-based computerized cognitive remediation program for auditory information processing in adults with a chronic TBI.
METHODS:
Forty-eight adults with TBI were randomly assigned to an intervention or control group. Both groups underwent a neuropsychological assessment at baseline and post-training. The Intervention group received 40 one-hour cognitive training sessions with the Brain Fitness Program.
RESULTS:
The intervention group improved in performance on measures of the Woodcock-Johnson-III Understanding Directions subtest and Trail Making Test Part-A. They also reported improvement on the cognitive domain of the Cognitive Self-Report Questionnaire.
CONCLUSIONS:
The present study demonstrated that a neuroplasticity-based computerized cognitive remediation program may improve objective and subjective cognitive function in adults with TBI several years post-injury.
Keywords
Introduction
Approximately 5.3 million people in the United States currently live with a chronic disability as a result of a traumatic brain injury (TBI; CDC, 2015; Faul & Coronado, 2015; Frieden et al., 2015; Ma et al., 2014). Chronic TBI-related deficits often include impairments in cognition, behavior, emotion, and motor functions (CDC, 2015; Dikmen et al., 2017). Cognitive deficits are the hallmark of a brain injury and constrain employment options and the ability to perform everyday functions (Ponsford et al., 2014; Sherer et al., 2002; Toglia, 1991). Impairments in speed of information processing, attention, and working memory are the most commonly reported cognitive deficits experienced after TBI (Finnanger et al., 2013; Kwak et al., 2020; Slavoaca et al., 2020; Stocchetti & Zanier, 2016).
The main principles of cognitive rehabilitation for persons suffering from TBI are to restore lost cognitive functions and develop compensatory skills to overcome cognitive deficits to improve everyday functioning (Anderson et al., 2010; Cicerone et al., 2006). Restorative approaches toward cognitive rehabilitation are designed to restore cognitive deficits by targeting the training toward systematic engagement of a specific function. Plasticity-based training techniques incorporate strategies for restoration of function by targeting neuromodulatory processes that support plasticity, strengthen processes of working memory and attention, and suppress neurological distractors that degrade the quality of incoming sensory information and interfere with learning and memory (Anderson et al., 2014; Dikmen et al., 2017; Merzenich, 2013; Nahum et al., 2013). Such interventions rely on the notion that neuroplastic change may be stimulated through focused training exercises that aid in the neuroplastic repair of associated neurological circuitry that has been damaged (Dams-O’Connor & Gordon, 2010). Effective interventions facilitate alterations in the structural connectivity of the brain via top-down, Hebbian principles of network plasticity (Hebb, 1949), whereby compensation for lesions occurs through the repetitive activation of nearby tissue, which strengthens damaged synapses that are simultaneously activated (Merzenich et al., 2014; Nahum et al., 2013). Through repetitive training, learning is enhanced and enriched to increase the gains of cognitive rehabilitation.
Over the last 30 years, numerous studies have demonstrated, with strong evidence, that holistic and targeted cognitive rehabilitation strategies can be used to improve functional impairments experienced by adults with a TBI (Ben-Yishay & Diller, 1993; Cicerone et al., 2005; Cicerone et al., 2019; Cicerone et al., 2011; Kumar et al., 2017; Wilson, 1997). Specifically, adults with TBI have benefited from cognitive interventions that target restoration of attention (Cantor et al., 2014; Couillet et al., 2010; Pero et al., 2006), working memory (Richter et al., 2015; Vallat-Azouvi et al., 2009), learning and memory (Goverover et al., 2010; Lesniak et al., 2020; O’Brien et al., 2007; Stringer & Small, 2011), and executive functions (Jacoby et al., 2013; Levine et al., 2011; Vas et al., 2011).
Recently, computer-based cognitive interventions have been shown to be particularly useful, as they allow for a more flexible and personalized experience for the user, can be more cost effective than traditional face-to-face training programs, and can be used in both inpatient and outpatient clinics or, oftentimes, at home (Kueider et al., 2012). Lebowitz et al. (2012) demonstrated the feasibility of a computerized cognitive training programs for individuals with TBI who completed the intervention at home and reported improvements in cognitive functioning. Other studies have also provided evidence for the utility of targeted computerized cognitive training in TBI, where improvements have been demonstrated in attention (Zickefoose et al., 2013) and working memory (Akerlund et al., 2013; Bjorkdahl et al., 2013; Fernández López & Antolí, 2020; Fetta et al., 2017), learning and memory (Fernandez et al., 2012; Li et al., 2013; Tam & Man, 2004), and executive functions (Bogdanova et al., 2016; De Luca et al., 2014).
The ability to efficiently take in and process new information from the environment is particularly problematic after TBI, as the speed at which one processes information directly impacts one’s ability to successfully execute higher-order cognitive functions, such as attention, memory, and executive functions (Asikainen et al., 1999; DeLuca et al., 2000; Salthouse, 1996). Computerized cognitive interventions that target processing speed involve tasks that increase in speed and complexity over time, building on components of the task that were previously learned to increase the users capacity for processing more and increasingly complex information over time, ultimately enhancing one’s ability to succeed in complex environments (Schooler & Mulatu, 2001). Studies of the efficacy of speed of processing training have demonstrated that the improvement of these skills may transfer to other cognitive domains and to the abilities required to perform everyday functions (Ball et al., 2007; Edwards et al., 2002; Edwards et al., 2005).
Since speed and efficiency of auditory processing affects the acquisition of verbal information, the present study examines the effects of a neuroplasticity based computerized cognitive training system that targeted auditory processing on verbal attention and working memory as well as measures of executive functioning in adults with a chronic TBI. We hypothesize that adults with TBI who undergo the intervention will demonstrate objective improvements in auditory processing speed and verbal attention and working memory as well as subjective improvements in functional ability when compared adults with TBI who do not undergo the cognitive intervention.
Method
Participants
Forty-eight adults who suffered from a mild (n = 15), moderate, (n = 5), or severe (n = 28) TBI between 1 and 38 years (M = 9.95±10.27) prior to enrollment were recruited to participate in the study. Participants were 52%male, 69%Caucasian, and between the ages of 24–69 (M = 44.52±12.71) at the time of enrollment, with 9–21 years of education (M = 15.90±2.58), and based on scores from the Wechsler Test of Adult Reading (WTAR, Wechsler, 2001), the estimated premorbid intelligence quotient ranged from 63–127 (M = 110.08±13.81). Of the 48 participants included in the study, 20 were included in the intervention group, and 28 were included in the non-intervention control group. Between-group demographic and injury characteristics are reported in Table 1. Injury severity was determined through medical record review and classified according to the American Congress of Rehabilitation Medicine (Kay et al., 1993) and Mayo Classification System for TBI Severity (Malec et al., 2007) criteria relating to initial Glasgow Coma Scale (GCS; Teasdale & Jennett, 1974) score, duration of loss of consciousness (LOC), and duration of posttraumatic amnesia (PTA), as mild (GCS = 13–15, LOC < 30 minutes, PTA < 24 hours), moderate (GCS = 9–12, LOC = 30 minutes – 24 hours, PTA = 1–7 days), or severe (GCS < 9; LOC > 24 hours; PTA > 1 week).
Between-group demographic and injury characteristics at baseline
Between-group demographic and injury characteristics at baseline
MVA = motorized vehicle accident. BL = baseline. WTAR (SS) = Wechsler Test of Adult Reading standard score (M = 100±15). TSI = time since injury. FU = follow-up. Cramers V≥0.10, 0.30, and 0.50 and Cohen’s |d|≥0.20, 0.50, and 0.80 are considered small, moderate, and large effects, respectively (Cohen, 1988).
To be included in the study, all participants were adults between the ages of 18 and 70 years with a diagnosed TBI that occurred at least one-year prior to enrollment and no current alcohol or drug use disorder based on the Michigan Alcoholism Screening Test (Selzer, 1971) and Drug Abuse Screening Test (Skinner, 1982a, 1982b), currently taking benzodiazepines, neuroleptics, or psychostimulants due to their potential effects on cognition or any history of schizophrenia or bipolar disorder. Participants were recruited from rehabilitation, neurology, and neuropsychology outpatient clinics within the New York City metropolitan area. Participants received fifty dollars in compensation for each cognitive assessment. Additionally, participants in the intervention group received a mass transit card for the length of their participation in the study to reimburse them for travel to participate in the cognitive training.
A short battery of neuropsychological assessments was completed at each visit and included standard, clinical measures of premorbid intelligence, attention and working memory, processing speed, and executive function.
Attention and working memory
Verbal attention and working memory were assessed using the Understanding Directions (UD) subtest of the Woodcock Johnson–3rd edition, Tests of Achievement battery (WJ-III; Woodcock et al., 2001), which requires the participant to point to objects in a picture after listening to instructions of increasing linguistic complexity that indicate which objects to select. This task provides a good measure of listening ability in real-world situations with similar complexity. Total raw score was calculated based on the number correct responses across all trials.
Visual attention and working memory was assessed using parts A and B of the Trail Making Test (TMT; Reitan & Wolfson, 1993). For the TMT part A, participants connect circles with numbers in ascending order as quickly as possible, and for part B, participants connect circles with numbers and letters by switching between them in an alphanumeric fashion. Performance was based on the number of seconds to complete each task, such that a lower score indicates better performance.
Processing speed
Auditory processing speed was measured using the Paced Auditory Serial Addition Test (PASAT; Gronwall, 1977), for which participants are required to sum the last pairs from a random series of numbers from 1 to 9 that are presented via audio recording. Performance was based on the total number of correct responses on the PASAT with a 3- and 2-second inter-stimulus interval over the 60 trials for each speed (Rao et al., 1991).
Executive function
Executive function was measured using the computerized version of the Wisconsin Card Sorting Test (WCST; Heaton et al., 1993), which is a good measure of mental flexibility, set shifting, and hypothesis testing. The WCST requires participants to sort cards according to four target cards based on rules that change over time, and feedback as to whether each response is correct or incorrect is provided. Performance on the WCST was based on the number of perseverative errors made following a rule change.
Subjective outcome measures
In addition to the neuropsychological assessments, the three self-report questionnaires were included as measures of subjective functioning and completed at each visit.
Functional ability
The Cognitive Self-Report Questionnaire (CSRQ; Spina et al., 2006) includes 25 statements related to cognitive, social, and hearing ability, and the participant was asked to rate the degree to which each item describes their ability over the last two weeks on a scale from 1-almost always to 5–hardly ever; if the statement is not applicable, the participant may rate it as such (score of 0). Higher raw scores on the CSRQ-25 indicate greater perceived difficulties.
Depression
The Beck Depression Inventory-II (BDI-II; Beck et al., 1996) is a well-validated (Wang & Gorenstein, 2013) and widely used measure of depression. It consists of 21 multiple choice items that assess mood and other symptoms associated with depression that have occurred over the course of the last two weeks, and a higher score indicates more severe symptoms.
Anxiety
The Beck Anxiety Inventory (BAI; Beck & Steer, 1993) is a 21-item measure of anxiety, where participants were asked to rate how much they have been bothered by symptoms related to anxiety over the past 7 days on a scale from 0–not at all to 3–severely. A higher score indicates more severe symptoms.
Cognitive intervention
The computerized cognitive intervention used for this study was the Brain Fitness Program (BFP) version 2.0.1b (Posit Science, San Francisco, CA), now known as the Focus on Auditory Processing program, which is designed to improve speed of auditory information processing and has been shown to be effective for the long-term maintenance of enhanced cognitive functioning and structural integrity in healthy older adults (Anderson et al., 2014; Mahncke et al., 2006; Smith et al., 2009; Styliadis et al., 2015). The BFP is comprised of six 15-minute training modules that involve central discrimination of frequency-modulated sweeps, discrimination of confusable syllables, recall of sequences of confusable syllables, matching pairs of confusable syllables, reconstruction of sequences of verbal instructions, and identification of details in a verbally presented story. Each exercise is designed to increase the speed of auditory and visual information processing through the systematic reduction of the inter-stimulus interval or stimulus duration during a series of progressively more difficult auditory information processing tasks, which are continuously adjusted in level of difficulty to maintain an 80%correct response rate (Zelinski et al., 2011). Four modules were completed during each 60-minute training session, and participants completed 3-4 training sessions each week over the course of 12 weeks, totaling 40-hours of training. As the intervention involves both visual and auditory modalities, participants were provided with noise-canceling headphones to wear during the training, and a research assistant was present during each session to ensure that appropriate participation and effort were put forth by the participant during the exercises.
Procedure
Approval was obtained from the NYU Langone Health Institutional Review Board prior to beginning the study. All participants were screened for eligibility before enrollment and gave written informed consent prior to participation. A quasi-randomized technique was used for group assignment. Over the course of 13 weeks following the baseline assessment visit, participants in the intervention group came to the laboratory to complete the 40 one-hour cognitive training sessions, and participants in the non-intervention control group were contacted weekly by telephone and asked how much time they spent participating in cognitively stimulating activities, such as reading, completing puzzles, or exercising over the previous week. The intervention group completed the follow-up assessment within two weeks of completing the intervention. The control group completed the follow-up assessment 13 weeks following the initial assessment.
Statistical analysis
Baseline demographic and injury characteristics were analyzed with an independent t-test or Fisher’s exact tests, and Cohen’s d or Cramer’s V estimates of effect size were reported for all comparisons. Independent t-tests were also used to confirm that no differences existed in scores on the cognitive or self-report measures between two groups at baseline. Cohen’s d is reported as an estimate of effect size for all between group comparisons of baseline functioning along with 95%confidence intervals.
Two-way (between-subjects factor: intervention vs. control group; within-subjects factor: baseline vs. follow-up scores) analysis of variance with repeated measures (RM-ANOVA) was used to detect group-by-time interactions for scores on cognitive and self-report measures, with a Huynh-Feldt correction (Huynh & Feldt, 1976) applied for violations of sphericity. Additionally, percent of change (%Δ) between the baseline scores and follow-up scores within each group were calculated by dividing the difference between follow-up and baseline scores by the baseline score and multiplying the result by 100. Statistical significance was thresholded at an α= .05. Partial eta-squared (ηp2) effect size estimates are reported with all RM-ANOVA results. Estimates of effect size are interpreted according to the conventions outlined by Cohen (1988). All statistical analyses were performed using Stata 16.1 (StataCorp LLC, College Station, TX, USA, 2020).
Results
The intervention and control groups did not differ in demographic or injury variables (Table 1), and no significant differences were found in objective or subjective measures of function between the two groups at baseline (Table 2).
Between-group performance on measures of objective and subjective function at baseline
Between-group performance on measures of objective and subjective function at baseline
Difference scores reflect Intervention –Control scores. WJ-III UD = Woodcock-Johnson III Tests of Achievement Understanding Directions subtest. TMT A/B = Trail Making Test part A/B (raw score). PASAT-3’/2’ = Paced Auditory Serial Addition Task 3-/2-second trial. WCST PE = Wisconsin Card Sorting Task perseverative errors. CSRQ = Cognitive Self-Report Questionnaire. BDI-II = Beck Depression Inventory–II. BAI = Beck Anxiety Inventory. Cohen’s |d|≥0.20, 0.50, 0.80 are interpreted as small, moderate, and large effects, respectively (Cohen, 1988). aPASAT-3’ and WCST PE df = 45; PASAT-2’ df = 44.
The RM-ANOVAs performed on the objective outcome measures of cognitive functioning revealed significant interactions with moderate effect sizes for group over time on the WJ-III UD subtest [F(1, 46) = 4.84, p = 0.033, ηp2 = 0.10) and TMT part A [F(1, 46) = 5.02, p = 0.030, ηp2 = 0.09). On both measures, the intervention group improved in performance over time in comparison to the control group (Table 3). No other significant group differences were shown on the cognitive measures, although small effect sizes were observed for improved scores by the intervention group compared to controls on the 3-second trial of the PASAT (ηp2 = .03), TMT part B (ηp2 = 0.02), and on the WCST (ηp2 = 0.01).
Group-by-time interactions for measures of objective function
%Δ= percent change [100×(MFU–MBL)/MBL]. WJ-III UD = Woodcock-Johnson III Tests of Achievement Understanding Directions subtest. TMT A/B = Trail Making Test part A/B. PASAT-3’/2’ = Paced Auditory Serial Addition Task 3-/2-second trial. WCST PE = Wisconsin Card Sorting Task perseverative errors. ηp2 ≥ 0.01, 0.09,.25 are interpreted as small, moderate, and large effects, respectively (Cohen, 1988). *p < 0.05. †Small effect, †Moderate effect. aPASAT-3’ and WCST PE df = 1, 45; PASAT-2’ df = 1, 44.
Similarly, the RM-ANOVAs conducted on self-reported subjective outcome measures revealed a significant interaction with a moderate effect size for group over time on the Cognitive subscale of the CSRQ [F(1, 46) = 5.58, p = 0.022, ηp2 = 0.11), with the intervention group reporting increased function at follow-up relative to control group (Table 4). No other significant interactions were observed for change in subjective function over time, although small effect sizes were observed for improved self-reported function in the intervention group compared to control group on the CSRQ Total scale (ηp2 = 0.05) and on the Social subscale of the CSRQ (ηp2 = 0.01).
Group-by-time interactions for measures of subjective function
%Δ= percent change [100×(MFU–MBL)/MBL]. CSRQ = Cognitive Self-Report Questionnaire. BDI-II = Beck Depression Inventory–II. BAI = Beck Anxiety Inventory (raw score). η p 2 ≥ 0.01, 0.09, 0.25 are interpreted as small, moderate, and large effects, respectively (Cohen, 1988). *p < 0.05. †Small effect, †Moderate effect.
This was a quasi-randomized control trial (RCT) investigating the use of a computerized cognitive remediation program, the BFP, in adults who were at least one-year post-TBI. Both the intervention group and control group were comparable in terms of demographics, premorbid intelligence, clinical indicators and their baseline neuropsychological performance. The intervention group improved on objective neuropsychological measures and a self-report measure of subjective functioning compared to the control after completing the BFP. Specifically, when compared to the control group, the intervention group significantly improved on measures of auditory and visual attention with moderate effect sizes, and small effect sizes were found for improved performance on auditory processing speed, visual working memory, and executive function. In addition, the intervention group reported significant improvements over time, with a moderate effect size, in self-reported cognitive function, and with small effect sizes for self-reported improvements in social and overall functioning. The CSRQ Cognitive domain includes questions regarding one’s perception of their attention, executive functioning, and memory abilities. The objective and subjective improvements were noted in the intervention group compared to the control group with an average of eight years post-injury. Suggesting that adults with a chronic brain injury years after the injury may still benefit from this type of cognitive remediation.
Computerized cognitive training has recently gained much attention, but concern has been raised over the true efficacy of such programs (Max Planck Institute for Human Development and Stanford Center on Longevity, 2014; Owen et al., 2010; Simons et al., 2016), as some lack the scientific evidence necessary to support their claims. In response, the Institute of Medicine (2015) published five guidelines that should be met by a training program in order for it to be considered an evidence-based cognitive training program. To date, the computerized processing speed training programs established by Posit Science (San Francisco, CA, USA), such as the BFP, are the only ones to meet all of these requirements (Merzenich, 2020).
The BFP was designed as a neuroplasticity-inducing “bottom-up” approach for auditory processing with six cognitive exercises that have participants attend and process basic sounds, nonsense syllables, and complete story details (Jahshan et al., 2019; Mahncke et al., 2006; Merzenich et al., 2014). To this end, it is not surprising that our intervention group improved on the WJ-III UD subtest, a measure of verbal attention and working memory, since the BFP targets auditory information processing. The improvements on TMT A and small effect sizes for improvements on the 3-second trial of the PASAT suggests the BFP also improved processing speed (Salthouse, 2011). The improvement on these neuropsychological measures demonstrates the near effects of the intervention, as the functional improvements were seen primarily on measures close to the trained tasks, and they support the findings of Wright et al. (2010), where improving auditory information processing was also shown to improve the acquisition of verbal information. The small effect sizes observed for improvements on tasks of higher-order cognitive abilities, such as cognitive flexibility, suggest that the effects of the intervention may transfer to other abilities; however, similar studies are necessary to replicate these findings.
Numerous studies have shown the benefits of computerized cognitive remediation in older adults (Edwards et al., 2005; Smith et al., 2009), as well as clinical populations such as adults with schizophrenia (Cellard et al., 2016; Fisher et al., 2010; Fisher et al., 2015), and cancer-related cognitive deficits (Bail & Meneses, 2016; Bray et al., 2017; Kesler et al., 2013; Mihuta et al., 2018), MCI associated with Parkinson’s Disease (Bernini et al., 2019; Oh et al., 2020), stroke patients (van de Ven et al., 2015) and neurosurgical patients (Liberta et al., 2020). Likewise, the improvement in neuropsychological performance in the present TBI sample supports prior studies, which have demonstrated the systematic delivery of a computerized cognitive remediation program benefits individuals with TBI (Bogdanova et al., 2016; Cicerone et al., 2019; Fernández López & Antolí, 2020; Fetta et al., 2017).
Quality of life (QOL) is negatively impacted by the cognitive deficits experienced by adults with TBI (Johnson & Ditchman, 2020). Although transfer effects are rarely seen for improved everyday function or increased QOL in the majority of the current cognitive training literature, an exception is seen in the results of studies using Posit Science’s plasticity-based interventions that target cognitive speed of processing (Ball et al., 2002; Ball et al., 2007; Belchior et al., 2019; Edwards et al., 2002; Edwards et al., 2005; Gary et al., 2020; Roenker et al., 2003; Wadley et al., 2006). In the present study, the intervention group reported improvements in overall, cognitive, and social functioning. Along with the improvements demonstrated on objective measures of function, subjective improvement may increase self-efficacy, which has been shown to mediate the relationship between TBI symptom severity and QOL (Stalnacke, 2007). The present findings suggest that neuroplasticity-based speed of processing training may help survivors of TBI to improve their cognitive abilities years post-injury, and this may result in further improvements in the ability to perform everyday activities and increased QOL.
Limitations and future directions
Although, the current results are encouraging, this study has limitations. For a RCT study, the sample size is relatively small and unbalanced; however, this was a preliminary investigation of auditory processing remediation in TBI. Small sample size is a consistent finding in computerized cognitive remediation studies (Bogdanova et al., 2016); therefore, it is important for future studies to replicated our findings and those of past studies with samples of adequate size. Although our findings demonstrated improvement in complex directions, the present findings are limited by our lack of data related to everyday functional tasks, which would allow us to investigate the transfer of cognitive improvements to improvements of activities of daily living. Our control group consisted of adults with TBI and similar demographics and clinical indicators; however, the present study would have benefited from including an active control task. We recommend future studies should have larger samples and measures of instrumental activities daily living to see if the cognitive benefits transfer to functional gains. The control group should also have an active control task. Lastly, we recommend the that future studies investigate the number of cognitive remediation trials that are necessary for persons with TBI to benefit from the training. Some studies have included only 10 hours of training (Ball et al., 2002), while others have included up to 130 hours of training in adults with schizophrenia (Mahncke et al., 2019), and greater working memory gains have been shown to occur with more training sessions (Fisher et al., 2010).
Conclusions
Survivors of TBI experience many cognitive deficits including the acquisition and encoding of verbal information. The present study provides preliminary evidence that a neuroplasticity-based auditory processing speed remediation program may improve verbal attention and working memory, in addition to processing speed, in adults several years post-TBI. Participants also reported feeling improved cognitive processes, which may improve quality of life. While future studies are necessary to confirm these findings, the present study demonstrated that individuals with chronic TBI may benefit from computerized cognitive remediation years after their injury.
Footnotes
Acknowledgments
This study was funded by the New York University Research Challenge Fund (R8740). The authors would also like to express their gratitude to all participants that made this study possible.
Conflict of interest
The authors declare no financial disclosures nor conflicts of interest.
