Abstract
Objectives:
Clinically stable children with HIV can have neuromotor, attention, memory, visual–spatial, and executive function impairments. We evaluated neuropsychological and behavioral benefits of computerized cognitive rehabilitation training (CCRT) in Ugandan HIV children.
Design:
One hundred fifty-nine rural Ugandan children with WHO Stage I or II HIV disease (6 to 12 years; 77 boys, 82 girls; M = 8.9, SD = 1.86 years) were randomized to one of three treatment arms over a 2-month period.
Methods:
The CCRT arm received 24 one-hour sessions over 2 months, using Captain's Log (BrainTrain Corporation) programmed for games targeting working memory, attention, and visual–spatial analysis. These games progressed in difficulty as the child's performance improved. The second arm was a “limited CCRT” with the same games rotated randomly from simple to moderate levels of training. The third arm was a passive control group receiving no training. All children were assessed at enrollment, 2 months (immediately following CCRT), and 3 months after CCRT completion.
Results:
The CCRT group had significantly greater gains through 3 months of follow-up compared to passive controls on overall Kaufman Assessment Battery for Children–second edition (KABC-II) mental processing index (p < .01), planning (p = .04), and knowledge (p = .03). The limited CCRT group performed better than controls on learning (p = .05). Both CCRT arms had significant improvements on CogState Groton maze learning (p < .01); although not on CogState attention/memory, TOVA/impulsivity, or behavior rating inventory for executive function and child behavior checklist (psychiatric behavior/symptom problems) ratings by caregiver.
Conclusions:
CCRT intervention can be effective for neurocognitive rehabilitation in children with HIV in low-resource settings, especially in children who are clinically stable on ARV treatment.
Introduction
W
Preliminary studies of the neurocognitive benefits of CCRT with Captain's Log in Ugandan Children with HIV documented generalization improvements on standardized tests of simple attention and maze learning. 11 Similar improvements were noted for Captain's Log CCRT with children surviving severe malaria. 12,13 Although CCRT had an immediate effect on cognitive outcomes pertaining to attention and some aspects of learning, the evidence was inconclusive in terms of neuropsychological or psychosocial behavioral benefit at school or in the home.
In addition, although a hallmark feature of CCRT procedures is to titrate difficulty of training with ongoing performance, it was unclear how this individualized titration would compare to computer games without this component. A recent report comparing working memory (WM) CCRT with and without performance titration concluded that titration is important for neuroconnectivity to take place in underlying brain regions leading to improved neurocognitive performance. 14 This study also compares CCRT with and without titration in the context of a clinical trial and includes a third group that does not receive CCRT. This took place with rural children in Uganda in an impoverished region where the HIV/AIDS epidemic has been most devastating and children face a myriad of accompanying risk factors to their neuropsychological development. 15,16
Methods
Participants
One hundred fifty-nine rural Ugandan children with WHO Stage I or II HIV disease (6 to 12 years; 77 boys, 82 girls; M = 8.9, SD = 1.86 years) were randomly assigned using a random numbers table by the study manager to one of three treatment arms over a 2-month period. The CCRT arm received 24 one-hour sessions (3 days per week) using Captain's Log (BrainTrain Corporation) programmed for games targeting WM, attention, and visual–spatial analysis. This is the recommended amount of training to achieve a significant neurocognitive benefit. 17 –19 The second arm was a “limited CCRT” with the same nine games rotated randomly through the simplest to moderate levels of training (no titration). The third arm was a passive control group receiving no computer training. All children were assessed at enrollment, 2 months (post-CCRT), and 3 months after CCRT (Fig. 1), at a private study clinic in Kayunga.

CONSORT diagram of flow of participants through clinical trial, including sample selection, randomization to treatment arms, retention, and outcomes assessment number for final analyses. CCRT, computerized cognitive rehabilitation training.
Assessments were conducted in the local language of the children (Luganda) by native speakers. Assessors were unaware of the child's treatment arm. Socioeconomic status (SES) and quality of home environment [home observation for the measurement of the environment (HOME)] was assessed upon enrollment. Children had access to daily medical care and ART was initiated as per Uganda country 2008 guidelines. 20 Informed written consent was obtained from the child's parent and signed assent from children age >7 years. Consent and assent forms were read to the parent and child in the local language. IRB approval for this study was obtained from Makerere University School of Medicine, University of Michigan, and Michigan State University. Research permission was obtained from the Uganda National Council for Science and Technology. Enrollment, assessment, and training took place from 2011 to 2013.
Computerized cognitive rehabilitation training
Captain's Log CCRT intervention
Captain's Log® marketed by BrainTrain Corporation, is a comprehensive set of computerized cognitive training games to improve a wide range of cognitive skills. 21 Research assistants supervising CCRT spoke the local language of Luganda when instructing the children on the training tasks. Training was done in the child's home after school so as to avoid bringing unnecessary attention to the child and possible stigmatization by classmates. We used the same configuration of Captain's Log that was used in our preliminary studies. 10,11 A Uganda psychology team led by M.J.B. and B.G. reviewed each of the possible training tasks and selected nine games considered to be most culturally fair, with three tasks emphasizing visual–spatial WM, vigilance attention, and nonverbal reasoning, respectively.
All children were started at the simplest program level for each task with training becoming more difficult as children progressed. Sessions lasted 45 to 60 min. Captain's Log has an internal evaluator (CLIE) feature, which can be used to audit the child's rate and level of progress in each session, while advancing to progressively more difficult items. We used this feature to assess fidelity of CCRT.
Limited Captain's Log CCRT
For the limited CCRT group, we programmed Captain's Log so that it rotated randomly from simple to moderate levels of training for the entire session. In every other respect, this training arm was like the full CCRT arm.
Assessments for neuropsychological outcomes
Kaufman Assessment Battery for Children–second edition
The Kaufman Assessment Battery for Children–second edition (KABC-II) measures cognitive abilities in children aged 3 to 18 years and is designed to minimize the influence of language and cultural knowledge on test results. 22 A special Nonverbal Index, used in this study, allows children to be tested using only gestures to communicate instructions and requires no understanding of English or the need to engage in spoken verbal response. The KABC-II maintained its factor structure with Ugandan cerebral malaria survivors 23 and is sensitive to clinical biomarkers of disease status in Ugandan children with HIV. 9,24 The primary outcome variables were the global scores of Sequential Processing (memory), Simultaneous Processing (visual–spatial analysis), Learning (immediate and delayed memory), Planning (executive reasoning), and Knowledge (crystallized intelligence). These (except for Knowledge) are combined into a total mental processing index (MPI).
CogState
This computerized neurocognitive assessment was used in our prior CCRT studies. 13,25 –27 A 30-min session is presented, which includes playing cards in a game-like manner to assess memory, attention, discrimination learning, and executive function that is nonlanguage dependent. It does so with card detection (simple reaction time), identification (choice reaction time), one-back WM, and one-card learning. It also includes the Groton Maze Task that includes components to measure visual-motor tracking (Maze Chase) and executive functioning/planning (Maze Learning).
Test of variables of attention
The test of variables of attention (TOVA) is a computer-based measure of sustained attention and impulsivity. 28 This test takes about 23 min to administer and is designed to minimize cultural differences, and has been used in Uganda to assess cognitive factors associated with pediatric HIV. 9,24 The TOVA rapidly presents simple geometric stimuli (i.e., a large open square with either a solid smaller square at the top or bottom of the open square for each presentation) to which the child must respond by pressing a hand switch. Performance outcomes include percent trials with omissions errors of inattention (missing the correct target), percent trials with commissions errors of impulsivity (identifying the incorrect target as correct), mean response time (speed of processing), and variability in response times (consistency of attention processing). Summary performance measures include an ADHD index score [ranging from −10 (High ADHD) to positive 10 (Highly attentive)] and a D prime signal detection measure (sensitivity measures based on correct hits and correct misses).
Captain's Log performance measures
The Captain's Log internal evaluator (CLIE) measures of session performance were used to gauge fidelity of training during a training session. 21 These measure a child's success at correctly responding to all training items for that session, accuracy of responses, speed of processing, and processing speed for correct responses to training items. These measures were entered into the database for all 24 training sessions, and improvements in the CLIE were correlated with improvements in other neuropsychological and behavioral outcomes for the CCRT and limited CCRT treatment arm children.
Bruininks/Oseretsky test for motor proficiency–second edition
This is a comprehensive and sensitive instrument for pediatric motor proficiency. 29 Testing involves game-like tasks that hold the child's interest and are not verbally complex. Composite scores include fine manual control, manual coordination, body coordination, strength and agility, and total composite score. Its use in this study is particularly relevant because of the pronounced motor impairment that seems to accompany HIV-related neurocognitive delay compared with impairment from severe malaria. 30,31
Behavior rating inventory for executive function
The behavior rating inventory for executive function (BRIEF) was developed to especially evaluate behavioral and cognitive problems as they relate to disruption of executive functions of the brain resulting from mild brain injury and/or developmental disorders. The BRIEF has been translated into the local language of Luganda and structure validated for use with this sample of children. 33 It is also sensitive to the clinical status of children in our sample. 34 The BRIEF school-age form was used for all children and takes ∼20–30 min to complete by the parent or principal caregiver. The eight nonoverlapping clinical scales form two broader indexes, Behavior Regulation (three scales) and Metacognition (five scales), and a Global Executive Composite score.
Achenbach child behavior checklist (parent)
We chose the child behavior checklist (CBCL) for our psychiatric assessment measure because it is one of the most widely used screening tools in child and adolescent psychiatry and pediatrics and has been translated into the local language of Luganda and structure validated for use with this sample of children. 33 It has been previously used by our group in pediatric HIV research in Uganda. 35,36 Although the CBCL can provide a wide array of DSM-V and Syndrome scale scores, our principal outcomes were Internalizing, Externalizing, and Total symptoms.
Control variables
Outcome analyses were all adjusted for age, gender, physical growth, socioeconomic status, quality of home environment score, recruitment location, and HAART status (yes/no), based on past research within the Sub-Saharan African context indicating the importance of both basic demographic factors, as well as home environment and occupation/income. 37 The middle childhood version of the Caldwell HOME 38,39 was used to assess the stimulation and learning opportunities offered by the child's home environment. Along with the HOME, we also used a socioeconomic evaluation scale of physical quality of the home environment (SES score) previously validated with Ugandan children as sensitive to long-term neurocognitive outcomes. 40
CD4+ T-cell counts, immune activation, and viral load testing
CD4, CD8, viral load, and other immunology measures were available from a blood draw taken within a week from the time of neuropsychological assessment. CD4 T-cell and CD8 T-cell activation level testing was performed on EDTA anticoagulated whole blood using a fresh lyse no-wash flow cytometry procedure. Blood was incubated with monoclonal antibodies, including CD3, CD8, CD4, CD38, and HLA DR, then processed and acquired on a multilaser benchtop flow cytometer. For each run of patient samples, a separate sample of stabilized blood product (CD-Chex; Streck Laboratories) was processed. CD4 T-cell and CD8 T-cell activation levels were defined as % CD38 and HLA-DR coexpression. 41
Statistical analyses
Adjusted means of the outcome variables were obtained from linear mixed-effects (LME) models with two repeated measures: (1) immediately after CCRT (2 months after intake into the trial) and (2) 3 months following completion of CCRT. Baseline measures of the outcome variables were used as covariates for added control of any preintervention differences among trial arms. The success of randomization was checked by comparing baseline variables by trial arm using the analyses of variance or chi-square tests, as appropriate. Variables that differed by trial arm at baseline were included as covariates in later analyses. The repeated measures analyses were also adjusted for the control variables. The primary analysis focused on the main (additive) effect of the trial arm. The average differences among trial arms over time were reflected by the adjusted (least square) means that were output from the LME model for each outcome variable. Additional analyses assessed the fidelity of the intervention by correlating Captain's Log internal success measures with postintervention outcomes. Finally, to explore whether the effect of the intervention differed according to HIV immunological measures or HAART status, the interactions of the trial arm with these measures were added (one at a time) to the LME models.
Results
Table 1 provides descriptive statistical information for these children following enrollment and before CCRT. Significantly fewer children were on HAART at the start of the study for the Limited CCRT arm, and they also had significantly higher KABC-II Learning and Delayed Recall scores related to Learning. Therefore, subsequent comparisons on neuropsychological outcomes between trial arms included these measures at baseline as covariates. There were no significant changes between posttraining and 3-month follow-up performance on any of our neuropsychological or behavioral outcome measures; so these were combined in comparing differences among trial arms for all of the LME analyses reported below.
WHO 2013 norms.
Standardized scores using age-based norms.
T scores using age- and gender-based norms.
p < .05; ** p < .01.
p-Values in bold are statistically significant.
BOT-2, Bruininks/Oseretsky test for motor proficiency–second edition; BRIEF, behavior rating inventory for executive function; CBCL, child behavior checklist; CCRT, computerized cognitive rehabilitation training; HAART, highly active antiretroviral therapy; HOME, home observation for the measurement of the environment; KABC-II, Kaufman Assessment Battery for Children–second edition; TOVA, test of variables of attention.
At posttraining and 3-month follow-up (Table 2), the CCRT group had significantly greater gains compared to passive controls on overall KABC-II performance (MPI, p < .01; Fig. 2), Planning (p = .04), and Knowledge (p = .03). The limited CCRT group performed better than controls on Learning (p = .05). Although marginal (p < .06), the CCRT group did not reach significance in terms of improvement on Learning. Both CCRT arms had significantly greater gains on CogState Groton maze chasing, on learning (p < .01; Fig. 2), and on card detection (p = .05). However, there were no treatment arm differences on any of the other CogState memory or attention measures, TOVA/impulsivity, or BRIEF and CBCL behavior/symptom ratings. In Table 3, significant interaction effects evidenced that children on HAART at study enrollment showed more dramatic KABC-II (Learning; p < .05) and CogState (one-back card learning, p < .05) performance benefit from the CCRT treatment arms that were not previously evident (Table 3).

Box plots comparing RCT treatment arms (Full CCRT, Limited CCRT, No CCRT) on KABC-II mental processing index (upper graph; standardized score) and CogState maze learning task (lower graph; correct moves per second). Box represents median (bisect), upper and lower quartile, and range of values, as well as individual outliers.
Standardardized scores (using age-based norms).
T scores using age- and gender-based norms.
p < .05 for CCRT versus limited CCRT.
p < .01 for CCRT versus limited CCRT.
p-Values in bold are statistically significant.
SE, standard errors.
Standardardized scores (using age-based norms).
p < .05 for CCRT versus limited CCRT.
p < .01 for CCRT versus limited CCRT.
p-Values in bold are statistically significant.
From first to last training session, both the full and limited CCRT arms had comparable significant improvements on all of the CLIE measures of fidelity of training. Table 4 includes the correlations between CLIE from the last training session and the KABC, CogState, TOVA, Bruininks/Oseretsky test for motor proficiency–second edition (BOT-2), BRIEF, and CBCL principal outcomes immediately following CCRT (2 months). CLIE for the last training session was highly correlated with KABC-II and CogState outcomes that significantly improved from full CCRT (p < .001). Even the TOVA outcomes, which did not significantly improve from CCRT, were significantly correlated to CLIE for both the CCRT and limited CCRT treatment arms (Table 4).
Moderate correlations of 0.40 or higher in absolute value are bolded.
Table 5 contains a summary of longitudinal models with the interaction of trial arm by HIV immunological measures. The coefficients (slopes for each HIV immunologic measure) are compared for CCRT versus control. These are presented in this Table along with their standard errors. The immunological measures of disease status at baseline (viral load, CD4 counts, CD4 activation, CD8 counts, CD8 activation) were consistently predictive of a steeper slope (greater training benefit for CCRT vs. control arm) for KABC-II Planning, CogState card detection speed (one-step attention measure), and card identification speed (two-step attention) (Table 5).
p-Values in bold are statistically significant in terms of the bivariate relationship.
Discussion
The results from this study demonstrate that CCRT-based programs can be adapted for resource poor and rural non-Western settings, and children can be motivated to take part in these extended training regimens. It is also important to note that those intervention children deriving the greatest benefit from CCRT were also those who were the most clinically stable study children on HAART at enrollment. These children tended to have higher CD4, lower CD4 and CD8 activation, and be virally suppressed Our preliminary study also demonstrated the expected improvements in cognitive testing following training, with generalization to neurocognitive performance measures entirely different than the nature of the specific skills needed for Captain's Log CCRT performance. Trainers consistently observed in their session that the children seemed to like and be well-motivated to take part in these game-based training exercises. This would suggest improved motivation and learning adherence, which have been associated with increased benefit from computerized training. 10 In addition, although examiners were present during training and observed that all children maintained training regimens, further research with similar CCRT programs may demonstrate that it can be easily distributed in the field for children to use on their own at home or in the school setting.
Astle et al. recently published a randomized controlled trial of CCRT emphasizing WM training (see
Because this effect is observed “at rest,” and children are not performing any task during the scan, neither could these training-related differences in brain region connectivity be attributed to differences in motivation or strategy nor could their documented brain effects be attributed to differences in blood flow or metabolism, since MEG relies on the electromagnetic field activity of the brain at the microregional level. Furthermore, improvements in WM after training were associated with increased strength of neural connectivity at rest, with the magnitude of these specific neurophysiological changes being mirrored by individual gains in untrained WM performance. These brain/behavior CCRT findings of Astle and colleagues are important in substantiating the potential neurophysiological basis of positive brain plasticity in children, hypothesized to be foundational to this performance gains in the application of CCRT with Ugandan children with HIV.
Through this and a set of other studies our group has completed using CCRT in rural settings with HIV and severe malaria survivors, we have demonstrated that the intervention is feasible and effective. 10,12,13,44 This study, however, is the first to do so within a more rigorous RCT study utilizing full and limited CCRT and passive control arms. The Astle et al. study lacked a passive control arm for performance and connectivity reference. It also lacked a further posttraining follow-up to evaluate whether WM gains and the enhanced neuroconnectivity from CCRT endured months following the completion of training. 14 Our findings suggest that they might.
The next step will be to evaluate ways of bringing such CCRT interventions to scale at a school- or community-wide level. For example, in a pilot intervention with passive controls from this study, we evaluated the neuropsychological benefits of a cognitive games package developed for the African context at Michigan State University, called brain powered games (BPG). 45 Twenty-four training sessions of BPG over 2 months significantly improved TOVA and CogState performance in these children, 45 with anecdotal evidence of how much children appreciated the BPG based on their emphasis on African motif stimuli and music. A next step might be to encourage in-country and local capacity for stakeholders to incubate and evaluate such game packages for scale-up and community-based intervention programs and initiatives. Such programs would take advantage of increased use of smartphones and tablets within the community among children and adolescents.
Conclusions
CCRT interventions can be an effective and viable means of neurocognitive rehabilitation in children with HIV in low-resource settings. The titration feature of CRRT is important for training benefit. Clinically stable children with HIV seemed to derive great neuropsychological benefit from CCRT. This suggests that the combination of HAART and cognitive rehabilitation is important for these children. Future studies are planned evaluating cognitive games for tablets and smartphones that can make cognitive evaluation and CCRT accessible on a mobile network.
Clinical Trial Registry
Footnotes
Acknowledgments
Financial support: This work was funded by the National Institutes of Health (M.J.B., B.G., N.N., grant number R34 MH084782); a Michigan State University (MSU) Clinical Translational Science Implementation (CTSI) (M.J.B. grant number 13-CTSI-204); an MSU College of Osteopathic Medicine (COM) Discretionary Funding Initiative (DFI) award to M.J.B. (12-DFI-COM); an MSU Department of Neurology faculty start-up funding provision to M.J.B.; a University of Michigan (U-M) Global Reach Faculty Mentored Structured Overseas Project (B.G., M.J.B.); and a U-M Global Reach Faculty Development Award (B.G., M.J.B.). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or any of the other funders.
Medical care and ARV treatment were provided by Walter Reed Hospitals clinic at Kayunga District Hospital, and their medical support of the children is greatly appreciated. Cognitive training, assessment, and on-site study management were conducted by members of the Global Health Uganda pediatric HIV study team in Kayunga, Uganda. Team members were Sylvia Malemo Elyanu, Janet Nafula Omita, Betty Nyangoma, Peter Bazira, Godfrey Nyanja Musoke, Agatha Kuteesa, Mohammed Ssemogerere, and Madina Muteesi. Michigan State University medical students who contributed as research interns for the study included Elizabeth Schut, Erin Lorenz, Christopher Adams, and Hailey Wouters. University of Michigan medical students Raina Vachani, Sarah Michael, Rashmi Patil, Andrew Gardner, and Moona Arabkhazaeli also contributed through the support of the University of Michigan Medical School global Reach summer faculty research mentoring program. Jacquelyn Moore from the Chicago Professional School of Psychology also assisted in training team members on KABC-II administration.
All of the authors have contributed substantially to this study and merit inclusion as coauthors. M.J.B. as Principal Investigator designed the study, wrote the grants that funded it, supervised all aspects of the protocol development and implementation, helped program Captain's Log for CCRT, worked on the data analyses, and wrote the article. N.N. supervised the IRB approvals in Uganda, supported logistical and personnel oversight, and contributed to the writing of the article. A.S. verified data quality assurance, completed all data analyses, developed the results Tables, and contributed to the writing of the article. R.O.O. contributed to patient selection and recruitment, clinical coordination, and treatment support for the children, helped supervise study logistics and personnel, and contributed to the writing of the article. B.G. helped design the study, write the grants that funded this project, and program Captain's Log for CCRT, helped with CogState assessment access and programming and contributed to the interpretation of the study findings, and helped write the article.
Author Disclosure Statement
None of the authors have any conflicts of interest to disclose with respect to this study.
