Abstract
Objective:
The purpose of this study was to find potential variables associated with the difference between subjective and object treatment responses in children with attention-deficit/hyperactivity disorder (ADHD) treated with OROS-methylphenidate (MPH).
Methods:
We conducted a post-hoc analysis of data from a multicenter, open-label, 12 week trial of OROS-MPH in Korean children with ADHD. The subjective outcome measurement was the parent version of the ADHD Rating Scale-IV (ARS-P), and the objective outcome measurement was the Continuous Performance Test (CPT). We compared the children's demographic and disease-related variables among four groups, classified according to whether they showed subjective or objective improvement after MPH treatment.
Results:
Higher baseline inattentive scores on the ARS-P were associated with a significantly higher probability of subjective treatment response among objective nonresponders (p=0.033). Lower baseline inattentive scores on the ARS-P were associated with a significantly higher probability of subjective nonresponse among objective responders (p=0.045). Lower baseline omission errors (p=0.006) and response time variability scores (p=0.011) on the CPT were associated with a significantly higher probability of both objective and subjective responses, compared with both types of nonresponse to treatment.
Conclusions:
The baseline severity of parent-perceived inattentive symptoms was predictive of differences in subjective and objective treatment responses, and the baseline severity of neuropsychological deficit (inattention and inconsistency of attention) was predictive of responses, using both subjective and objective measurements.
Introduction
A widely used assessment of treatment efficacy relies on reports by parents and teachers (Shah et al. 2005). However, according to Brewis's literature review (Brewis 2002), parents' and teachers' reports tend to be subjective. Parent and teacher ratings appear to be influenced by the identity of the person reporting the behavior, rather than by the reported behavior itself. The accuracy of subjective assessments is often questioned because they are prone to the placebo effect (Sumner et al. 2010). Another difficulty lies in differentiating between the behavioral response (decreases in the hyperactive-impulsive symptoms) and improvement in attention.
Although there are no laboratory tests for assessing ADHD, there has been increasing recognition of the potential clinical utility of more objective measurements for the diagnosis and the assessment of drug efficacy. The most commonly used group of measurements is the Continuous Performance Test (CPT) (Greenberg and Waldman 1993). The CPT involves the rapid presentation of stimuli on a computer screen for an extended period of time. Children with ADHD are typically measured based on the number of omission errors (failing to press for a target), commission errors (pressing for a nontarget), response time, and response time variability. According to the literature, the sensitivity and specificity of the CPT are 70–80%, and its reliability is ∼0.8 (Greenberg 1987; Forbes 1998; Llorente et al. 2001). Although CPT scores lack sufficient sensitivity and specificity, the CPT's efficacy in measuring drug response is 95% and is, therefore, quite satisfactory (Greenberg and Waldman 1993).
In previous studies comparing subjective ADHD symptom rating scales, with scores obtained using an objective neuropsychological test for the assessment of hyperactivity, inattention, and impulsivity, it was found that agreement between these two measurements was not as strong as anticipated (Manor et al. 2008; Sumner et al. 2010). These results prompted us to find potential predictors associated with differences between subjective perceptions and objective measurements in children with ADHD treated with MPH. Therefore, we conducted a post-hoc analysis of a multicenter, open-label, 12 week trial of OROS-MPH to investigate the influence of baseline characteristics on differences between subjective and objective outcome measurements in children with ADHD.
Methods
Study design and subjects
This study has been previously described in detail (Kim et al. 2013). In brief, this was a multicenter, open-label, 12 week trial of OROS-MPH in drug-naive children (6–12 years of age) with diagnoses of ADHD according to the Diagnostic and Statistical Manual of Mental Disorders, 4th ed. (DSM-IV), criteria (American Psychiatric Association 1994). Other requirements for inclusion were the absence of a current depressive or anxiety disorder requiring drug therapy and no history of bipolar disorder, psychotic disorders, substance use disorders, Tourette's syndrome, pervasive developmental disorders, mental retardation, organic brain disease, or seizure disorders. To diagnose ADHD and any comorbid disorders, we used the Kiddie-Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version (K-SADS-PL) (Kim et al. 2004).
Following screening, the eligible patients were enrolled in the study, and they completed baseline assessments prior to starting treatment. We initiated participants with 18 mg of OROS-MPH per day in children with body weights <30 kg and with 27 mg/day in children with body weights >30 kg. The doses could be adjusted upward in 9 mg or 18 mg increments per week and downward in 9 mg decrements over 8 weeks, depending upon each patient's symptom severity and drug tolerability. The maximum OROS-MPH dose was 54 mg/day. The study was approved by the institutional review board (IRB) for human subjects at the Seoul National University Hospital and other participating hospitals. Parents/guardians provided written informed consent, and the children provided oral assent to participate in this study.
Treatment response and its correlates
The employed subjective outcome measurement was the parental version of the ADHD Rating Scale-IV (ARS-P) (DuPaul 1991; So et al. 2002), and the objective outcome measurement was the CPT. The four variables we recorded on the CPT were omission errors, commission errors, response times, and response time variability, and the composite score (mean scores of the four variables) was calculated. Subjective treatment response was defined as a ≥50% decrease in ARS-P total score from baseline. Objective treatment response was defined as a ≥15% (1.5 SD) increase in the mean composite score on the CPT from baseline. Both the parents and investigators were blinded to the results of the CPT, and the children were blinded to the results of the ARS. The subjects were classified into four groups according to whether they showed subjective or objective responses after MPH treatment: 1) Nonresponders on both the ARS-P and CPT; 2) ARS-P responders without CPT response; 3) CPT responders without ARS-P response; and 4) responders on both the ARS-P and CPT.
The following 10 parameters, which were assessed at screening or baseline, were used in the analysis as possible correlates of treatment response: 1) Age (years); 2) sex (male/female); 3) subtype of ADHD (combined/inattentive/hyperactive-impulsive/not otherwise specified); 4) comorbidity; 5) mean dose of MPH (mg/kg); 6) baseline score on the Clinical Global Impressions-Severity (CGI-S) scale; 7) baseline score on the ARS-P; 8) baseline score on the CPT; 9) baseline score on the maternal Beck Depression Inventory (BDI); and 10) baseline score on the Parenting Stress Index (PSI).
The ARS-P is a symptom severity scale consisting of 18 items, including 9 inattentive items and 9 hyperactive-impulsive items, according to the DSM-IV criteria (So et al. 2002). The BDI consists of 21 items for measuring the subjective severity of depression (Han et al. 1986). The Korean version of the Parenting Stress Index-Short Form (PSI-SF) is composed of 20 items, comprising 8 child characteristic-related stress items, 9 parent–child interaction-related stress items, and 3 achievement expectation-related stress items (Shin and Chung 1998). For all cited scales, the higher the score was, the greater the severity or parent's perceived stress was.
Statistical analyses
We compared demographic and disease-related variables among the four groups using ANOVA for continuous variables and the χ2 test for categorical variables. Multivariate logistic regression analysis was used to analyze possible predictors of subjective and objective treatment responses. Variables that showed group differences by ANOVA or the χ2 test at an α level <0.05 were included in the multivariate regression analysis. All of the statistical analyses were performed with SPSS (version 12.0; SPSS Inc., Chicago, IL), and an α-level <0.05 was considered significant.
Results
Among the 132 subjects initially recruited, 119 completed the ARS-P and the CPT at the last visit (12 weeks after treatment) and were included in the post-hoc analysis. Forty-three subjects (36.1%) were nonresponders according to both subjective and objective measurements, 29 (24.4%) were subjective responders without objective responses, 18 (15.1%) were objective responders without subjective responses, and 29 (24.4%) were responders according to both subjective and objective measurements.
There were differences in age, dose of MPH (mg/kg), baseline inattentive scores on the ARS-P, and baseline omission errors and response time variability scores on the CPT among the four groups (Table 1). Post-hoc comparison revealed that nonresponders on both subjective and objective measurements were older than objective responders with or without subjective responses (p=0.049 or 0.012, respectively); the dose of MPH (mg/kg) was higher in objective responders without subjective responses compared with nonresponders, according to both subjective and objective measurements (p=0.047), and baseline omission errors and response time variability scores on the CPT were lower in objective responders than in objective nonresponders, regardless of subjective response to treatment (p<0.001).
ARS, Attention-Deficit-Hyperactivity Disorder Rating Scale; ARS-P, Attention-Deficit-Hyperactivity Disorder Rating Scale, parent version; CPT, Continuous Performance Test; NOS, not otherwise specified; ODD, oppositional defiant disorder; CGI-S, Clinical Global Impressions – Severity; RTSD, response time variability; BDI, Beck Depression Inventory; PSI, Parenting Stress Index.
Table 2 shows the results of multivariate analyses using the stepwise backward logistic regression model. Higher baseline inattentive scores on the ARS-P were associated with a significantly higher probability of subjective response among objective nonresponders (p=0.033). Lower baseline inattentive scores on the ARS-P were associated with a significantly higher probability of subjective nonresponse among objective responders (p=0.045). Lower baseline omission errors (p=0.006) and response time variability scores (p=0.011) on the CPT were associated with a significantly higher probability of both objective and subjective responses compared with both types of nonresponse to treatment.
Multivariate logistic regression analyses, including all variables in Table 2 (variables that showed group differences in ANOVA at an α level <0.05); the latter is the reference group.
Odds ratio adjusted for all variables in Table 2 except for itself.
ARS, Attention-Deficit-Hyperactivity Disorder Rating Scale; ARS-P, Attention-Deficit-Hyperactivity Disorder Rating Scale, parent version; CAT, CPT, Continuous Performance Test; RTSD, response time variability.
Discussion
To the best of our knowledge, this was the first study to find potential variables associated with differences between subjective and objective responses to MPH in children with ADHD. The major findings of this study were that the baseline severity of parent-perceived inattentive symptoms was predictive of differences in subjective and objective treatment responses and that the baseline severity of neuropsychological deficits (inattention and inconsistency) was predictive of responses according to both subjective and objective measurements.
Parents who perceived their children's inattentive symptoms as severe were more likely to report subjective improvement after treatment, although objective improvement did not occur. Over the long term, parents who perceived their children's inattentive symptoms as mild were more likely to deny subjective improvement, although objective improvement occurred. Subjects with higher inattentive scores at baseline can experience greater improvements over time simply because they have the greatest room for improvement (Buitelaar et al. 2011, 2012). However, it is an interesting finding that parent-perceived inattentiveness, rather than hyperactive-impulsive symptoms or CPT results, was most strongly associated with differences between subjective perception and objective measurements, which suggests a specific role of parent-perceived inattentive symptoms on the placebo effect.
Comparisons between nonresponders according to both objective and subjective measurements and responders according to both measurements revealed that greater omission errors and response time variability were most strongly associated with genuine treatment response. Previous studies have reported strong associations between higher baseline symptom severity and superior treatment outcomes (Newcorn et al. 2010; Buitelaar et al. 2011). Neuropsychological deficits, rather than parent-rated symptoms, can reflect baseline disease severity better; therefore, these deficits are more likely to be predictive of genuine treatment response (superior outcomes on both subjective and objective measurements). Again, inattention measured by omission errors was associated with treatment response, but impulsivity measured by commission errors was not. Response time variability, which is interpreted as a measurement of variability or consistency of attention, has been proposed as a leading endophenotype for ADHD (Castellanos and Tannock 2002), and its utility for assessing stimulant response has been previously reported (Lee et al. 2009).
Consistent with previous studies that reported associations of younger age and higher MPH doses with treatment response (mostly measured by investigators) (Buitelaar et al. 1995; Spencer et al. 1995; Faraone et al. 2004; Biederman et al. 2006; Medori et al. 2008), we found younger ages and higher MPH doses in objective responders compared with objective nonresponders, but we did not find these differences between subjective responders and subjective nonresponders. In addition, age and dosage of MPH were not predictive of treatment response when subjective and objective disease severity was taken into account.
We must interpret the present study's results in the context of the following limitations. First, because of the post-hoc nature of the analysis, some important predictive variables might have been missed, as they were not evaluated in the present study (such as motivational measurements of children and the personality traits of their parents). Second, because this study was a non-comparative, open-label trial, a genuine placebo effect could not be evaluated, although the differences between subjective perceptions and objective measurements might have been related to the placebo effect. Third, we did not use the investigator- or teacher-rated ARS to measure treatment response. Finally, the sample size of this study was small, which might have prevented us from obtaining sufficient statistical power to detect significant group differences; therefore, the results should be interpreted carefully.
Conclusions
The baseline severity of parent-perceived inattentive symptoms was predictive of differences in subjective and objective treatment responses, and the baseline severity of neuropsychological deficits (inattention and inconsistency of attention) was predictive of response according to both subjective and objective measurements.
Clinical Significance
The results of this study suggest that children with ADHD with severe inattentive symptoms are more likely to achieve parental-perceived benefits and that those with greater omission errors and response time variability are more likely to achieve both parental-perceived benefits and neuropsychological improvement after MPH treatment.
Disclosures
Drs. Bung-Nyun Kim, Jae-Won Kim, Min-Sup Shin, Soo-Churl Cho, and Doug-Hyun Han were investigators in this clinical study. All authors have no conflicts of interests or financial ties to disclosure. However, data have been analyzed and the article was written by the primary authors, and funding did not limit the authors' abilities.
