Abstract
Examining reported costs for Children with Medical Complexity (CMCs) is essential because costing and resource utilization studies influence policy and operational decisions. Our objectives were to (1) examine how authors identified CMCs in administrative databases, (2) compare reported costs for the CMC population in different study settings, and (3) analyze author recommendations related to reported costs. We undertook a systematic search of the following databases: Medical Literature Analysis and Retrieval System Online, Excerpta Medica dataBase, Cumulative Index to Nursing and Allied Health Literature, and Cochrane Library with a focus on CMCs as a heterogeneous group. The most common method used n = 11 (41%) to identify the CMC population in administrative data was the Complex Chronic Conditions methodology. The majority of included studies reported on health care service costs n = 24 (89%). Only n = 3 (11%) of the studies included costs from the family perspective. Author recommendations included standardizing how costs are reported and including the family perspective when making care delivery or policy decisions. Health system administrators and policymakers must consider the limitations of reported costs when assessing local costing studies or comparing costs across jurisdictions.
Keywords
Introduction
Children with Medical Complexity (CMCs) are a heterogeneous pediatric population that span a wide range of clinical diagnoses such as Neuromuscular and Cardiovascular chronic conditions and Congenital/genetic defects (Cohen et al., 2011). CMCs require considerable healthcare resources, have poor health outcomes, and place a substantial financial and psychological burden on caregivers (Berry et al., 2015; Cohen et al., 2011). While CMCs make up roughly 1% of the pediatric population, they account for 30% of pediatric health care resource use (Berry et al., 2015; Cohen et al., 2012a). Understanding healthcare and family costs are essential for clinicians, researchers, and policymakers to improve healthcare delivery and support for CMCs and their families.
Children with Medical Complexity share four key characteristics; the presence of one or more complex chronic conditions, reliance on technology for survival (e.g., feeding tubes or tracheostomies), high healthcare utilization (e.g., requiring several specialist care visits and frequent hospitalizations), and significant caregiver needs (e.g., care coordination, financial and social needs) (Cohen et al., 2011; Dewan and Cohen 2013). While identifying CMCs at an individual level is accomplished through clinical assessment, identifying CMCs at a population level can be challenging (Berry et al., 2015). According to Berry et al. (2015), the three main challenges to identifying CMCs at a population level are (1) how medical complexity is defined, (2) discrepancies in healthcare data collection and reporting, and (3) CMCs, unlike adults with medical complexity, tend to have multiple chronic conditions without any being dominant or prevalent across the population. In addition to the heterogeneity of CMCs, these challenges make it difficult to report on healthcare costs for this population accurately.
This review examines the type and methods of reporting costs for this population. Such a review is essential as cost information can shape health care policy, care service delivery and research priorities. To our knowledge, this is the first review of this kind.
Aims
This systematic review has three aims: (1) to determine how CMCs are identified, (2) to analyze and compare reported costs for the CMC population, and (3) to examine author recommendations related to the costs reported in each included study.
Methods
A protocol was developed (not published), using the Cochrane Handbook for Systematic Reviews of Interventions and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method for systematic reviews (Moher et al., 2009).
Search strategy
We developed the search strategy in consultation with a research librarian and peer-reviewed by a second librarian. We searched for peer-reviewed English language articles in the following databases: Medical Literature Analysis and Retrieval System Online (Medline) (1946–April 22, 2019), Excerpta Medica dataBase (EMBASE) (1974–April 22, 2019), Cumulative Index to Nursing and Allied Health Literature (CINAHL) (inception to April 22, 2019), and Cochrane Library (inception to Current). An online search of non-peer-reviewed articles was also conducted using Google search engine but did not yield additional studies.
Selection criteria
Studies were included if they reported costs for a pediatric population with Neurological Impairment, Complex Chronic Conditions (CCCs), use for Technology Assistance, high resource use, or high family care needs as described in the conceptual framework for CMCs reported by Cohen et al., (2011). Studies not examining CMCs as a heterogeneous group were excluded.
Study designs included were primary studies and literature reviews; letters, commentaries and opinion pieces were excluded. The outcomes of interest were to examine how CMCs were identified, compare what and how cost estimates were reported and examine author recommendations related to the measurement of CMC-related costs.
Study selection
The selection of studies was a two-step process. The first screening involved examining study titles and abstracts against pre-determined selection criteria using Microsoft Excel© 2016 (Microsoft Corporation, Redmond, WA, USA) by two independent reviewers (MSi, MR). The second screening stage involved examining the full text of studies identified in stage one and was completed by the same reviewers (MSi, MR). Any differences underwent discussion and were resolved by consensus. A third reviewer was available in case the two reviewers could not reconcile differences but was not needed.
Data collection and analysis
A piloted data collection tool Microsoft Excel© 2016 (Microsoft Corporation, Redmond, WA, USA), was used to extract the following data: study details (e.g., author, year, country, study design, and objective), population characteristics (e.g., inclusion and exclusion criteria, sample size, participant age), and study costs and related outcomes (e.g., the definition used to identify CMCs, method used for evaluation of an intervention, costs reported and related author recommendations). One reviewer (MSi) extracted data, and a second reviewer (MSe) verified a random selection of studies.
Data were then organized by type of study topic. For example, some studies used descriptive analysis of healthcare administrative data, whereas others conducted an economic evaluation of a specified intervention. The types of costs analyzed included large-scale macro-costing, local level micro-costing, and economic assessment studies reporting costs for the population. Studies were then analyzed for similarities and differences in (1) how the study defined the CMC population, (2) type of costs reported, and (3) cost-related author recommendations.
Quality appraisal of the included studies was conducted in duplicate by two reviewers (MSi and MSe), and conflict was resolved through consensus. The Critical Appraisal Skills Program (CASP) (Critical Appraisal Skills Programme, 2020) for cohort studies (CASP Cohort Study Checklist) was used to assess 26 (96%) of the studies, while the CASP Economic Evaluation Checklist was used for one (3%) study (Fields et al., 2018).
The three domains of quality assessment in the CASP tool are validity of results, study precision and applicability. Results are included in Table 1. Each included study was rated using the tool’s assessment questions as follows: 1. Are results valid? This domain was summarized as either high, medium, or low validity based on clear objectives, appropriate cohort recruitment and accounting for outcome bias and confounding measures. 2. Are results precise? This domain was summarized as either precise, somewhat precise and not precise/unsure. We determined precision based on sample size and spread of the confidence intervals or inter-quartile. 3. Are results applicable? This domain category was summarized as either high, medium or low based on the generalizability of study results, the applicability of results to local CMC populations, and how similar they were to other evidence in the literature. Characteristics of included studies and quality appraisal results. aCritical Appraisal Skills Program (CASP) tool for cohort studies was used for every study except for Fields et al. (2018) where the CASP tool for Economic Evaluation was used. We summarized the CASP Cohort evaluation tool findings as high, medium, or low based on clear objectives, appropriately recruited cohort, and adequately accounting for outcome bias and confounding measures. Precision was summarized as precise, somewhat precise and not precise/unsure based on sample size and spread of confidence intervals or inter-quartile range reported. Finally, applicability of results was summarized as high, medium or low based on study design and how similar the results were to other evidence. Cost Methods and data sources are further summarized in Table 2—Cost Variable Summary. Studies were grouped under Descriptive Studies category if they identified CMCs costs and characteristics but were not an evaluation of an intervention. Studies were grouped under Evaluative Studies category if they included an evaluation of an intervention. Studies were grouped under Other category if they did not fit with Descriptive or Evaluative Studies.
The CASP Economic Review Checklist was used to examine one process improvement study as it was not a cohort study.
Results
The initial search identified 4395 studies in total, and 3205 studies remained after removing duplicates, as illustrated in Figure 1. Following initial title and abstract screening, 160 titles remained for full-text screening. The full-text review identified 33 papers for data extraction; however, six papers were later excluded because they were conference presentations or full text was not available. A systematic review was excluded to prevent bias as it included similar studies to those in this review. Study Selection Flow Diagram
Of the n = 27 included studies, the majority n = 24 (89%) were from the United States; two were from Canada and one from Australia (Table 1). The earliest study was from 2007 (Gordon et al., 2007), and the most recent was published in 2019 (Chirico et al., 2019; Ronis et al., 2019). The ages of participants in the studies varied from birth to 18 years, while three studies included older participants up to 24 years old (Chirico et al., 2019; Goldhagen et al., 2016; Murtagh Kurowski et al., 2014). These studies were included in this review despite having participants older than 18 years as they reported on CMC’s transition from pediatric to adult care, an important consideration for this population. Table 1 outlines the included studies, summarizing how CMCs were identified, reported costs and data sources, author recommendations related to costs and qualitative appraisal results.
Identifying the children with medical complexity population
The majority n = 18 (67%) of studies included in this review used one of four CMC identification methods (Table 1) as described by Berry et al. (2015). The most common method used n = 11 (41%) was Feudtner et al. (2000) Complex Chronic Conditions. 3M Clinical Risk Groups 3M Science (2020), were used by n = 3 (11%), Chronic Condition Indicators Agency for Healthcare Research and Quality (2020), were used by n = 2 (7%), and Patient Medical Complexity Mangione-Smith (2014), was used by n = 1 (3%) of the studies. Technology assistance was identified in seven (25%) studies as part of their CMC definition.
Costing methods
Type of reported health care costs varied and included standard costing methodology, such as case costing or standard hospital costs n = 8 (30%), local direct care costs n = 7 (26%), costs converted from hospital charges n = 6 (22%), hospital charges not converted to costs n = 3 (15%), and utilization rates including relative utilization rates n = 3 (15%), as outlined in Table 1. Costs to CMC families was reported in n = 3 (11%) of studies. This information was captured in family surveys. Data sources varied and included national administrative databases, claims data, provincial or state-wide databases, private payer data, and local administrative and costing data.
Cost variable summary.
Note: Cost variables were reported differently throughout the included studies. For example, some hospital costs were reported as charges, converted to costs or reported as hospital days.
Children with medical complexity costs at a hospital, geographic or national level accounted for n = 14 (52%) descriptive studies. In evaluative studies, n = 11 (40%) included costing of a given intervention. Types of interventions included care coordination, medical home-like support models and CMC family/caregiver educational programs. The remaining two studies, n = 2 (7%), did not fit into the descriptive or evaluative category; one compared CMC family experience and financial hardship with families of asthmatic children, and the other reported a process improvement intervention to improve access to technology for CMCs (Table 1).
A review by Gold et al. (2016) found the prevalence of lengthy hospitalizations for CMC varied significantly by type of chronic condition and that no dominant chronic condition was evident. This lack of a dominant chronic condition presents a challenge in effectively measuring the burden of the disease as each specific ailment has different acuities and, therefore, different financial and social burdens on patients, families and the health system (Berry et al., 2011; Cohen et al., 2012a; Kuo and Houtrow, 2016).
All three (11%) studies that included families' costs identified a significant financial impact to CMC families/caregivers. After examining 7.2 million children’s records, including CMCs enrolled in private insurance plans in the United States, Walter et al. (2018) found that families of CMCs are almost four times more likely to spend over $1000 out of pocket per year than non-CMCs. The authors also noted that this did not include any lost income due to reduced working hours to care for a CMC.
Only two studies (7%) in this review included a health state assessment such as cost-utility analysis or Patient Reported Outcome measures for families/caregivers. Families and caregivers of CMCs are more likely to score their health lower than parents of healthy children or children with single chronic diseases (Dewan and Cohen, 2013).
Cohen et al. (2012b) and Goldhagen et al. (2016) included Health State Quality of Life measurement as part of the evaluation of care coordination. Both studies suggest improving care delivery models such as partnerships between children’s hospitals and care coordination programs can positively affect family caregiver quality of life, and have a positive impact on healthcare costs for the child and the caregiver.
Author recommendations
Summary of author recommendations.
Themes from the included studies are summarized.
Further research on health economic assessment recommendations, especially those considering the family perspective are needed.
Another set of recommendations addressed clinical service delivery for CMCs. A key finding was the need for standardized protocols for clinical practice for CMCs as a means of enhancing care for CMCs and reducing cost variation (Chan et al., 2016; Ralston et al., 2015; Srivastava et al., 2016). Srivastava et al. (2016) suggested measuring variation in medical and surgical pediatric conditions costs might provide more insight into cost variation. Similarly, Berry et al. (2017) found better provider communication during transition from hospital to home could prevent hospital readmissions. Cohen et al. (2012b) reported formal partnerships between children’s hospitals, community hospitals, and primary care are beneficial in reducing CMC care costs. Alternative reimbursement methods for programs supporting CMCs were also recommended (Avritscher et al., 2019; Gordon et al., 2007; Ronis et al., 2019)
Quality of included studies
We assessed the quality of included studies using the CASP tool to examine strength of study designs and applicability of author recommendations. Table 1 includes a summary of the quality appraisal results.
Using the Cohort CASP tool, 15 (56%) of the studies rated as high validity, 9 (33%) medium validity, and two (7%) were low validity. For precision, 17 (63%) were rated as precise, and 9 (33%) were rated as not precise or unsure. In applicability, seven (26%) studies were rated as highly applicable, 16 (59%) were medium applicability, and seven (26%) were rated as low applicability. Finally, using the economic evaluation CASP tool, one (3%) study showed favorable results in reduced operating costs; the savings are specific to the local operational context and may not be applicable in other areas due to different operational structures and processes.
Discussion
This review aimed to examine reported costs for the CMC population, including methods used to identify CMCs and related recommendations. Results indicate that most reported costs are from the healthcare system’s perspective, with significant variation in types and methods used to represent these costs for CMCs. Cost-related author recommendations covered healthcare spending, resource utilization, care coordination, service delivery and the need to include family perspective in reporting costs for this population.
Identifying children with medical complexity
Identifying CMCs in administrative data can be challenging and may affect reported costs for the population (Berry et al., 2015). CMCs are identified in health administrative data using International Classification of Diseases (ICD) ICD-9 and 10 diagnostic codes using various methods.
Our review included studies using all four CMC identification methods based on Berry et al. (2015). While all these methods are capable of identifying CMCs, they may yield different cohorts. For example, Feudtner et al. (2000) would not identify noncomplex Chronic Conditions such as behavioral/mental health conditions, whereas the other three methods would. While Complex Chronic Conditions are clearly defined in Feudtner et al. (2000) and Patient Medical Complexity Algorithm methods, there is no clear definition for Complex Chronic Conditions in the Clinical Risk Groups and Chronic Condition Indicator methods (Berry et al., 2015).
Another limitation of all four methods is the dependence on administrative data, as they do not typically include patient and family-related costs or outcomes. Berry et al. (2015) describe strengths and limitations of each method in detail. While it may be possible to compensate for limitations of these methods through study design, it makes it more challenging to compare costs and outcomes between studies. Future studies need to carefully consider challenges and limitations of using administrative data to identify CMCs and choose the most appropriate option for their study.
Reported costs—health system perspective
Variation in health resource utilization and other types of reported costs in the included studies is partially caused by differences in how data is collected and stored in administrative databases. While administrative databases are a reliable and accessible source of information, they also have well-documented limitations. Riley (2009) described several limitations of claims databases, such as the potential for claims data to contain biases as providers are inherently incentivized to maximize payments, limiting generalizability to a larger population. Limitations with claims data were especially applicable to for-profit health systems, such as the case with many of the studies included in this review.
Healthcare costs were reported as local costs converted by hospital-specific ratios ((AHRQ), 2020) or reported as hospital charges, making it difficult to compare costs across studies. This variation, along with variation in type of health care service cost included in costing data, provides an incomplete picture of CMC resource use. For example, only six (22%) of included studies reported on costs or utilization of mental health resources, even though according to Berry et al. (2017), mental health conditions were the most prevalent chronic conditions in acute-care hospitalizations and are associated with a significant number of pediatric hospital days.
Costs were also reported as a component of evaluating a given intervention, namely care coordination or patient/family education type programs. Consistent with a systematic review by Cohen et al. (2011), we found that most evaluations in the included studies are quasi-experimental and did not include control groups. Nonetheless, intervention studies indicate that examining characteristics of the local CMC population is recommended as some CMCs may benefit from more intensive and often costlier care coordination services than other CMCs. This differentiation in CMC cohort needs is an essential finding for jurisdictions looking to design or improve their CMC care coordination programs.
Standardizing clinical care where appropriate was also identified as an important quality improvement activity that can reduce health system costs and improve care for CMCs and their families (Chan et al., 2016; Ralston et al., 2015). Chan et al. (2016) reported that CMCs make up the largest pediatric Intensive Care Unit (ICU) population, and that standardized care protocols for common admissions, and standard use of palliative care services can improve care for this population. A systematic review by Coller et al. (2014) found that discharge points, transfer from another medical facility, home care, technology supports, and post-discharge follow-up were important in reducing preventable hospitalizations for CMCs (Coller et al., 2014). Our study shows that many of these service categories were not consistently reported in included studies.
Healthcare activities not reimbursed by funding agencies were another area that was not widely considered. Imperfect measurement of reimbursed care activities is a potential barrier to effective and sustainable care coordination efforts (Avritscher et al., 2019; Gordon et al., 2007; Ronis et al., 2019). Ronis et al. (2019) estimated that healthcare staff provided approximately $2400 worth of unreimbursed care coordination time per CMC per year in undocumented activities such as review of medical records, paperwork, and multidisciplinary team meetings. Considering these costs in the design of CMC care programs ensures adequate funding and long-term sustainability.
The context of how healthcare is funded is also an important consideration. For example in the United States, while the Medicare program provides public health insurance for some, the private patient funded third-party insurance is the predominant model. Canada and Australia have more publicly funded healthcare services than the U.S. These important differences should also be considered when using healthcare costing data for policy decisions.
Family/caregiver perspective
Evidence from this review suggests a substantial gap in reporting of costs incurred by families and caregivers of CMCs. Included studies that reported CMC family costs showed that families of CMCs endure a substantial financial burden. For example, Walter et al. (2018), after examining 7.2 million children’s records including CMCs that were enrolled in private insurance plans in the United States, found that families of CMCs are almost four times more likely to spend over $1000 out of pocket per year than non-CMCs. The authors also noted that this did not include any lost income due to reduction in working hours to care for a child with medical complexity. Another study by Thomson et al. (2016) showed that families of CMCs experienced more financial and social hardships.
Measuring and reporting family costs can be more arduous as it often involves survey design and implementation. Excluding family costs from program evaluation not only provides incomplete information but risks transferring the cost burden from the health system to individual CMC families, causing harm to patients and families. Prudent policy makers and funders would carefully examine the implications of funding decisions given the complexity of accurately measuring the patient and family burden for this population. It is critical to consider funding decisions from a larger system perspective that include social and healthcare system supports for this population.
Limitations
This study has several limitations that must be considered. We examined CMCs as a heterogeneous cohort, so costing evaluations of individual complex chronic diseases were not included. As a result, disease-specific costing assessments that were excluded may provide further insight into the financial burden of CMCs. A lack of European studies, with most of included papers from the United States n=24 (89%) is another limitation. This result may be due to the use of the term Children with Medical Complexity, the definition used for CMCs in this search, or because non-English papers were excluded. More research is needed to ascertain differences between North American and other countries' definitions of CMCs. Only peer-reviewed studies were included in this review, and unpublished studies may have different results or provide more insights into the gaps identified.
Implications for practice
While CMCs make up only a small fraction of all children (usually less than 1%), they are consistently identified as the highest utilizers of health care resources (Agrawal et al., 2016; Berry et al., 2017; Chan et al., 2016; Cohen et al., 2012a; Srivastava et al., 2016). Calculating family/caregiver costs alongside health system costs may provide more insight on policy or operational gaps (Berry et al., 2014).
Healthcare administrators, policymakers, and researchers can benefit from the findings of this review by considering limitations of costing data when making policy or operational decisions. The type of data used for cost analysis, including claims data, charge data, or publicly funded system data, impacts how costing information is used and compared across jurisdictions. Variables such as unfunded care coordination time and examining trends over time would also help provide a clearer picture of costs for the local CMC population and inform local care policy or delivery decisions. (Agrawal et al., 2016; Berry et al., 2014; Shumskiy et al., 2018; Srivastava et al., 2016).
Conclusion
Caring for CMCs requires a large, disproportionate amount of healthcare resources and exerts financial and psychosocial strain on families. This systematic review has identified essential issues, including inconsistent reporting of healthcare costs and a need to consider the family perspective. Finally, identifying standardized methodologies for reporting costs for this population will improve the comparability and applicability of results across different jurisdictions.
Supplemental Material
Supplemental Material—Reported costs of children with medical complexity—A systematic review
Supplemental Material for Reported costs of children with medical complexity—A systematic review by Michael Sidra, Meghan Sebastianski, Arto and Sholeh Rahman in Journal of Child Health Care
Footnotes
Acknowledgments
The authors would like to thank Ms Linda G. Slatter for her support in development and execution of the search strategy and Dr David Wyatt Johnson for his review and recommendations for the manuscript. Dr David Wyatt Johnson, MD Senior Medical Director Maternal, Newborn, Child and Youth Strategic Clinical Network at Alberta Health Services. Linda G. Slatter BA, BEd, MLIS, John W. Scott Health Sciences Library (retired).
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Supplemental Material
Supplemental material for this article is available online.
Appendix
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
