Abstract
Introduction
Mild traumatic brain injury (mTBI) is an unfortunately common repercussion of military service in a combat zone. The CONTACT study tested an individualized telephone support intervention employing problem solving therapy (PST) for mTBI in soldiers recently returned from deployment. We sought to determine the cost effectiveness of this intervention from a military healthcare system perspective.
Methods
We conducted an intent-to-treat post-hoc analysis by building a decision analytic model that evaluated the choice between using PST or education only (EO). The model included cost-minimization and cost-effectiveness analyses. The incremental cost-effectiveness ratios (ICERs) were calculated as the differences in costs of PST versus EO relative to the differences in the outcomes of participants.
Results
The PST intervention resulted in an annual per-enrolee cost of $1027 (95% CI: $836 to $1248), while EO costs were $32 (95% CI: $25 to $39), resulting in a net incremental cost of $996 per enrolee (95% CI: $806 to $1,217). The ICERs were $68,658/QALY based on EQ-5D (95% CI: -$463,535 to $596,661) and $49,284/QALY based on SF-6D (95% CI: $26,971 to $159,309). Estimates of treatment costs in a real-world setting were accompanied by substantially lower ICERs that are within accepted thresholds for willingness-to-pay.
Discussion
Although the intervention had short-term benefits sufficient to yield acceptable ICERs, there was no long-term effect of PST over EO observed in the study. Consequently, we suggest that future studies examine the use of low-cost approaches, such as booster relapse-prevention calls, that may lead to a sustained treatment benefit for this population.
Background
According to the Centers for Disease Control and Prevention (CDC), as many as 2.5 million people experience a traumatic brain injury (TBI) in the United States each year.1–3 Three quarters of those injuries are categorized as mild TBI (mTBI). Although classified as ‘mild’, the symptoms of mTBI can nonetheless be severe and even life-changing. Physical symptoms can include: headache; nausea or vomiting; fatigue or drowsiness; difficulty sleeping or sleeping more than usual; dizziness; or loss of balance. Sensory symptoms may manifest as blurred vision, ringing in the ears, changes in the ability to smell, and sensitivity to light or sound. Cognitive or mental symptoms may present as memory or concentration problems, mood changes or mood swings, post-traumatic stress, or depression and anxiety. 4
As well as the human toll on physical and psychological well-being, the economic impact of mTBI is profound. Beyond costs to the health care system, mTBI can cause serious long-term or even permanent impairments in daily activities and ability to return to work. The cost of mTBI to the nation, including direct and indirect medical costs, has been estimated to be at least $76.5 billion annually. 5
Mild traumatic brain injury (mTBI) is an unfortunately common repercussion of military service in a combat zone. Figures from Operation Enduring Freedom and Operation Iraqi Freedom (OEF/OIF) suggest that up to one quarter of OEF/OIF-deployed American military service members have suffered from mTBI,6–11 most often emanating from explosive blasts.11–13 As with civilian victims, the costs of military mTBI are substantial. Consequently, cost-effective interventions to alleviate mTBI symptoms are of considerable interest to senior leaders.
We recently conducted a randomized clinical trial to assess the impact of telephone-delivered problem-solving treatment (PST) on mTBI symptoms in military service members. The CONcussion Treatment After Combat Trauma (CONTACT) Study was a randomized, prospective trial of telephone-delivered PST versus general education only (EO) for service members with mTBI (n = 356). 14 The PST comprised 12 telephone intervention calls over a six-month period and focused on injury-related education, training in problem solving, and focused behavioural strategies for symptoms (e.g., anxiety, post-traumatic stress disorder, depression, sleep, and headache) that commonly co-occur with mTBI. The EO consisted of 12 educational brochures describing common problems following mTBI and deployment. Follow-up for the trial extended six months beyond the intervention for a total of twelve months of follow-up. Results revealed that the PST group showed significant short-term improvement at six months in psychological distress, sleep, depression, post-traumatic stress, and physical functioning. 14 However, post-concussion symptoms improved equally in both groups at six months and, after discontinuation of PST, none of the effects persisted at 12-month follow-up.
We concluded from our clinical results that telephone-delivered PST was a well-accepted treatment that offers promise for reducing psychological distress after combat-related mTBI. However, we could not conclude without further analysis whether or not that promising intervention was also economically feasible. This is especially salient given the lack of maintenance of benefit over a year compared to less resource-intensive alternative. To our knowledge, the economic feasibility of interventions that address mTBI has not been studied in the literature. In the present paper, we estimated the economic costs and outcomes associated with the findings from the CONTACT study, as well as real-world estimates of the costs of these two interventions, in order to evaluate whether PST represents a cost-effective treatment option for the military healthcare system.
Methods
Study design
We conducted an intent-to-treat (ITT) post-hoc analysis of the CONTACT study by building a decision analytic model in Microsoft Excel. Because the 12 month outcomes of CONTACT were not statistically significant, we conducted a cost minimization analysis of the CONTACT study by assuming equal outcomes between the two trial comparators. At six months, however, PST showed significant improvements in outcomes over EO. Therefore, we also examined the cost effectiveness for the temporary improvement in those outcomes relative to the economic costs of achieving those improvements.
This decision analytic model accrued all intervention costs and the choice for cost minimization was the lowest cost treatment arm.
The cost-effectiveness analyses evaluated the choice between using PST or EO, and considered the differences in costs of PST versus EO relative to the differences in the outcomes collected in the trial, or the incremental cost-effectiveness ratios (ICERs).
Subjects
Subjects from the CONTACT study were analysed in the treatment group to which they were randomized. There were no crossovers or protocol violations observed in the trial. 14 Each treatment group included 178 participants. The primary outcomes report of the CONTACT study showed that the characteristics of participants in both the PST and EO groups were evenly balanced. 14 Overall, participants were primarily young (on average 30 years old), male (93%), white (77%), non-Hispanic (81%), and of regular military status (93%). 85% of participants had experienced a blast-related TBI. The majority of participants were from Womack Army Medical Center (69%), and the other 31% were from Madigan Army Medical Center.
Perspective and time horizon
Our analyses took the perspective of the Department of Defense as the health care payer. We examine two potential cost scenarios from this perspective: (1) the costs specifically accumulated in the CONTACT study; (2) the costs if the PST and EO were implemented in a real-world setting at a local or regional level that provided the intervention at a rate of 500 service members over 6 months.
The base case time horizon for the analysis was 12 months as that aligned with the outcomes collected in the CONTACT study.
Cost inputs
Costs were gathered through a series of discussions, after the study was completed, with supervisors, counsellors, and administrative staff that delivered the PST and EO interventions. From these individuals we established consensus around estimates of the amount of time spent on training counsellors, performing supervision, conducting fidelity oversight, providing additional follow-up calls to ensure the safety of a few suicidal participants, filling out paper work with each counselling session, and mailing or emailing participant call summaries and educational brochures.
Estimated economic costs of problem solving treatment (PST) and education only (EO) in the CONTACT study (base case).
Notes: For supervisors we used the average hourly wage of an O6 or O5 officer ($41.93; range: $32.24, $49.08); for the three counsellors we used the average hourly wage of O3 to O5 officers ($35.31; range: $24.45, $43.87); for staff we used the average hourly wage of an O3 officer ($31.69; range: $24.45, $37.01). The study was implemented over 36 months. Each enrolee completed approximately seven sessions.
Estimated economic costs of problem solving treatment (PST) and education only (EO) if implemented in a real-world military setting, enrolling 500 participants every 6 months (micro-costing approach).
Notes: For supervisors we used the average hourly wage of an O6 or O5 officer ($41.93; range: $32.24, $49.08); for the three counsellors we used the average hourly wage of O3 to O5 officers ($35.31; range: $24.45, $43.87); for staff we used the average hourly wage of an O3 officer ($31.69; range: $24.45, $37.01). In the real-world setting there would be no additional oversight and fidelity checking by staff members, and all the paper work would be done electronically with electronic medical records by the counsellors rather than having a separate staff member emailing and mailing out paperwork after the PST phone calls. Each enrolee is expected to complete 6 sessions.
Estimated economic costs of problem solving treatment (PST) if implemented in a real-world military setting, enrolling 500 participants every 6 months (macro-costing approach).
Notes: FTE: full time employee; for supervisors we used the average hourly wage of an O6 or O5 officer ($41.93; range: $32.24, $49.08); for counsellors we used the average hourly wage of O3 to O5 officers ($35.31; range: $24.45, $43.87). Each enrolee is expected to complete 6 sessions.
Health outcome inputs
The four main health outcomes used in the cost-effectiveness analyses were the Brief Symptom Inventory-18 (BSI-18) global severity index (GSI), the Patient Health Questionnaire-9 (PHQ-9), the Euroquol five dimensions questionnaire (EQ-5D), and the Short Form six dimensions index (SF-6D).
The BSI-18 was a primary outcome measure of the CONTACT study and previous analyses of the study found that there was a significant reduction in the GSI at six months. The GSI is a standardized measure of overall mental and emotional symptom severity with a mean of 50 and standard deviation of 10. The changes at six months were at the magnitude of about one-third of a standard deviation of the measure.
Significant improvements in depression were also observed at six months as measured by the PHQ-9. The average improvement in the PST group’s PHQ-9 score was about one unit better than that of the EO group. A one unit shift in scores is comparable to a shift from a depressive symptom that bothers an individual nearly every day to more than half the days, more than half the days to several days, or several days to not at all. In some studies the PHQ-9 has been used to develop a measure of depression free days,15,16 but that approach was not used in this study because it would require an interpolation of depression free days over the course of the year using only three data points (baseline, six months, and 12 months).
The EQ-5D and SF-6D are both measures of health related quality of life that can be used to generate preference weighted health utility values. When the incremental change in health utility is multiplied by the duration of the effect, this is the estimated number of quality adjusted life years (QALYs) accrued by individuals receiving the intervention. The EQ-5D responses were preference weighted according to a US sample in order to estimate the health utilities. 17 We generated the SF-6D preference weighted utilities using a proprietary algorithm (OptumInsight Life Sciences) that converts SF-12 responses into SF-6D utilities.
For each of the health outcomes we generated mixed-effects regression models. These models adjusted for the subject’s military status, their baseline GSI, and the study site. From these models we calculated the predicted values at the six month point-estimate. The incremental benefit for the outcomes over the entire 12 months was estimated by taking the difference in predicted values at six months and multiplying them by 0.5, or the estimated duration of the effect in terms of years. The effect was estimated to last half a year because all outcomes for PST and EO were similar by the end of the year. Thus, for the EQ-5D and SF-6D we report health utility point-estimates at 6 months, but the incremental benefit over 12 months is the QALYs gained over the year.
Sensitivity analyses
Model estimate variance and uncertainty was assessed through both one-way and probabilistic sensitivity analyses. Each input parameter’s variance was included in the model and combined with the deterministic parameter estimates. The one-way analysis involved individually varying each input parameter to the 2.5% and 97.5% values of the estimated distribution and storing the resulting cost-minimization finding. The results of the one-way sensitivity analysis are presented in the form of a tornado diagram, with the input parameters organized by descending order of influence on the results. We performed a Monte Carlo simulation, drawing randomly from the appropriate statistical distribution of each parameter simultaneously and recorded the results from 3000 simulations. The results of this probabilistic sensitivity analysis were estimated as the probabilistic mean and 95% confidence range.
The University of California, San Diego Human Research Protections Program approved this study (#101730). The CONTACT study was also approved by the institutional review boards at each study site, the University of Washington, and by the Army Human Rights Protection Office. All analyses on the outcomes of the study were conducted in R statistical package. The model calculations and sensitivity analyses were conducted using Excel.
Results
Cost effectiveness of problem solving treatment (PST) compared to education only (EO) over 12 months.
The incremental benefit for the outcomes over the entire 12 months was estimated by taking the difference in predicted values at 6 months and multiplying them by 0.5, or the estimated duration of the effect in terms of years. The effect was estimated to last half a year because all outcomes for PST and EO were similar by the end of the year. Thus, for the EQ-5D and SF-6D we report health utility point-estimates at 6 months, but the incremental benefit over 12 months is the QALYs gained over the year.
The PST group scored lower in the PHQ-9 over 12 months, by 0.66 points (95% CI: 0.01–1.27), generating an incremental cost per point improvement in the PHQ-9 at $1519 (95% CI: $591 to $7749).
Depending on the measure of health utility, there were on average 0.015 (95% CI: −0.003 to 0.034) to 0.020 (95% CI: 0.006–0.034) QALYs gained per enrolee over the 12 months. The ICERs were $68,658/QALY based on EQ-5D (95% CI: -$463,535 to $596,661, with the negative ICER representing a dominated strategy of higher costs but poorer outcomes) and $49,284/QALY based on SF-6D (95% CI: $26,971 to $159,309). The confidence intervals for the ICER based on the EQ-5D are much wider than those for the SF-6D because in the sensitivity analysis there were more values close to zero incremental benefit as measured by the EQ-5D.
One-way sensitivity analysis revealed that wage rates of care providers, call attempts, counselling sessions, and training were the most influential model parameters (Figure 1). This parameter level analysis also demonstrated that the utility input values and wage rates were the most influential on the incremental cost-effectiveness ratio (Figure 2). The probabilistic sensitivity analysis resulted in similar cost-effectiveness ratios compared to the deterministic findings, with similar interpretation overall (Figure 3).
One-way sensitivity analysis of the 10 most influential model parameters on incremental costs per person for problem solving treatment vs. education only as implemented in the CONTACT study. One-way sensitivity analysis of the 10 most influential model parameters on incremental cost-effectiveness (SF-6D) for problem solving treatment vs. education only as implemented in the CONTACT study. Probabilistic sensitivity analysis of the incremental cost-effectiveness for problem solving treatment vs. education only using the EQ-5D and SF-6D.


Real-world costs
Both the macro- and micro-costing based treatment costs for the PST and EO interventions resulted in lower incremental costs for PST compared to the trial-based costs. The more conservative costs estimated an incremental cost of PST at an additional $516 (95% CI: $303 to $789), while the highly efficient clinic costs were estimated at an additional $231 (95% CI: $163 to $308). These lower costs were accompanied by substantially lower cost-effectiveness ratios, well within accepted thresholds for willingness-to-pay in both the EQ-5D and SF-6D models (Table 3).
Discussion
We estimated the economic consequences of choosing to use telephone-delivered PST versus EO to deliver care to individuals with mTBI. Though EO would minimize overall costs compared to PST, we found that the PST intervention can still represent a cost-effective treatment. Acknowledging that the trial-based costs are inflated, particular from a heightened level of oversight that included frequent meetings of supervisors and counsellors, the true incremental cost of adding this new clinical service appears palatable at a likely cost of between $200 and $500 per patient over six months. The oversight in a real-world setting could include less frequent meetings and could also be for a larger group of patients thus reducing the time cost per patient. It should be noted, however, that the lowering of costs in a real-world scenario will have an unknown effect on the treatment efficacy. So, while the costs will likely be lower than those observed for the trial-based application of the intervention, it is possible that the efficacy will also be attenuated. This would increase the incremental cost of PST versus EO.
Limitations
As with any modelling study, there are limitations and assumptions that should be considered when evaluating the results presented herein. First, the effectiveness of both interventions was based on a clinical trial. We attempted to utilize the best available information, generating statistical models from the trial data and adjusting for characteristics that were not balanced by the trial’s randomization. However, real-world effectiveness may differ from what was measured in the trial, so the lower ICERs associated with these analyses may not occur. Second, assumptions were made about the improvements in health outcomes from 0–6 months and 6–12 months. More frequent measures are needed to obtain a more accurate understanding of the intervention over time. Third, we were required to make assumptions regarding costs both in the base case that was developed from the actual costs incurred during the trial and from input received from clinicians regarding real-world scenarios. Those real-world scenarios were developed with clinicians who implement PST interventions in their clinics, lending credibility to the estimates we have generated. Finally, the impact on cost was limited in this study to only the costs of the intervention. We were unable to examine cost impacts on productivity gains from the intervention. We also did not include any changes in medical costs among those receiving PST or EO. If this intervention is implemented more broadly, we suggest that an evaluation be performed that tracks the real-world effectiveness with repeated and more frequent outcome measures, assesses the ongoing time costs associated with the intervention in a real-world setting, and explores the potential costs or gains from changes in medical service utilization and productivity.
Conclusion
The PST intervention provided a measureable benefit on outcomes at six months, but this benefit was indistinguishable from a less resource-intensive alternative by twelve months. The cost-effectiveness analysis found that the cost per increase in several outcomes would likely fall within an acceptable range for the payer. Unfortunately, both the costs and the measured benefit of PST observed in the trial will likely differ in a real-world effectiveness context, thereby affecting the ICER. Given the lack of long-term effect of PST over EO observed in the study, it would be appropriate to further study whether applying resources to low-cost approaches, such as booster relapse-prevention calls, may lead to a sustained treatment benefit for this population.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was partially supported the US Army Medical Research and Material Command (USAMRMC; grant number W81XWH-08-2-0159). Supplementary support was provided by the National Institute on Disability and Rehabilitation Research (grant number H133G070143). The views expressed are those of the authors and do not reflect the official policy or position of the Department of Defense (DoD) or the US Government.
