Abstract
Continuous glucose monitoring (CGM) is indicated in poorly controlled insulin-treated patients with type 2 diabetes (T2D) to improve glycemic control and reduce the risk of hypoglycemia, but the benefits of CGM for lower risk patients have not been well studied. Among 17,422 insulin-treated patients with T2D with hemoglobin A1c (HbA1c) <8% and no recent severe hypoglycemia (based on emergency room visits or hospitalizations), CGM initiation occurred in 149 patients (17,273 noninitiators served as reference). Changes in HbA1c and severe hypoglycemia rates for the 12 months before and after CGM initiation were calculated. CGM initiation was associated with decreased HbA1c (−0.06%), whereas noninitiation was associated with increased HbA1c (+0.32%); a weighted adjusted difference-in-difference model of change in HbA1c yielded a net benefit of −0.30%; 95% CI −0.50%, −0.10%; P = 0.004). No significant differences were observed for severe hypoglycemia. CGM may be useful in preventing glycemic deterioration in well-controlled patients with insulin-treated T2D.
Introduction
Randomized controlled trials have demonstrated the efficacy of continuous glucose monitoring (CGM) to improve glycemia in poorly controlled patients with insulin-treated type 2 diabetes (T2D). 1,2 We recently reported that initiation of real-time CGM, relative to self-monitoring of blood glucose (SMBG) alone, was associated with improvement in glycemic control and reduction in severe hypoglycemia (based on emergency department [ED] visits or hospitalization) in an observational cohort of 36,080 insulin-treated patients with T2D. 3 However, the benefits of CGM specifically in lower risk patients have not been well studied. We conducted a real-world comparative effectiveness study of the benefits of CGM use in insulin-treated patients with hemoglobin A1c (HbA1c) <8% and no history of severe hypoglycemia.
Materials and Methods
This study cohort included 17,422 insulin-treated T2D patients who used SMBG, had HbA1c <8%, and no recent severe hypoglycemia (ED visits or hospitalizations for hypoglycemia). CGM initiation (real-time CGM) was identified among patients during 2015–2019 and the remaining noninitiators served as a reference group. All patients received care from Kaiser Permanente Northern California, a fully integrated health care delivery system providing care for 4.6 million members. A retrospective cohort design was used to estimate changes in HbA1c and severe hypoglycemia rates associated with CGM initiation compared with SMBG use alone (active comparator reference group). The Kaiser Permanente Northern California Institutional Review Board approved this study.
The outcomes of interest were HbA1c and severe hypoglycemia rates (based on a primary diagnosis from an ED visit or a principal diagnosis from a hospitalization). The exposure of interest was CGM initiation. Changes in the outcomes attributable to CGM initiation were calculated as difference-in-differences (DiD) estimates defined as the pre–post changes during the 12 months before and after CGM initiation (exposure) minus the pre–post changes among patients who used SMBG alone (reference group using a randomly assigned date as baseline). 4 The size and sign of the DiD estimate indicate the magnitude and direction of the net changes in outcome in CGM initiators accounting for changes observed in the reference group.
In addition to the crude DiD estimates, confounding was addressed by specifying adjusted and propensity score-based overlap weighted, 5,6 repeated measures, generalized linear models, assuming a compound symmetry covariance structure to account for nonindependence of the residual error. 6 Conservative 95% confidence intervals were calculated using the Huber White sandwich estimator method. 7 These doubly robust 8 DiD estimates were intended to balance covariates in the exposed and reference groups and emulate a randomized clinical trial. 6
To calculate the propensity scores, treatment models were specified to predict the probability of CGM initiation using >40 candidate predictors and all possible interactions and quadratic terms as inputs (see Supplementary Table S1 for list of variables included in the propensity score models) using a machine learning approach to stepwise logistic regression with model decisions based on Akaike information criterion. Instrumental variables (e.g., cost-sharing for CGM) were purposely excluded from the treatment models. 9 Missing data were rare (∼0.4% of the data points). Median values were imputed for missing continuous variables and indicators for missing categorical variables were added to the propensity score models.
The propensity scores were then used to derive overlap weights using the formula (overlap weight = 1 − propensity score) for the CGM initiators and (overlap weight = propensity score) for the noninitiators (reference group). 5,6,10 Overlap weights give more influence to (i.e., upweight) exposed individuals (i.e., CGM initiators) predicted to have a low likelihood of being exposed and to unexposed individuals (i.e., noninitiators) predicted to have a high likelihood of being exposed.
Covariate differences before and after overlap weighting were assessed using the standardized difference (Cohen's D
11
), which is the difference in means or proportions divided by pooled standard deviation. D indicates the size and direction of imbalance in the distribution of characteristics in exposed versus reference groups. A positive D for a given characteristic means patients were overrepresented in CGM initiators and underrepresented in the noninitiators, and vice versa for a negative standardized difference. |D| < 0.1 is considered a negligible imbalance.
12
The overlap weights balanced the majority of covariates specified in the treatment model between exposed and the reference groups (i.e., created exchangeability
Analysis of a directed acyclic graph (DAG) 13 of the hypothesized causal framework identified potential confounding variables: insulin injection frequency, use of rapid or short-acting insulin, insulin pump use, a history of acute metabolic crises, and HbA1c results 12–24 months before baseline (i.e., assessed in the 12 months before the beginning of the prebaseline period). The final weighted models were further adjusted for these putative confounders.
We checked for violations of the DiD model assumptions, including Experimental Treatment Assignment, 14,15 parallel trends, 4 common shock, or no spillover 4 ; none were identified. P-values were two-sided, with a significance threshold of .05. Statistical analyses were performed using SAS version 9.4 (SAS Institute) and R.
Results
In this cohort of 17,422 insulin-treated patients with T2D who used SMBG, had HbA1c <8%, and no recent severe hypoglycemia, 149 patients initiated CGM (Table 1). Compared with noninitiators, CGM initiators were more likely to be younger at baseline, younger at diabetes onset, have fewer comorbidities, and have a higher predicted risk of hypoglycemia; CGM initiators were less likely to be Hispanic or black, have limited English-proficiency, or live in a deprived neighborhood.
Baseline Characteristics Before and After Propensity Score Overlap Weighting in 17,422 Insulin-Treated Patients with Type 2 Diabetes Who Used SMBG and Had HbA1c <8% and No Recent Severe Hypoglycemia Who Were Real-Time Continuous Glucose Monitoring Initiators (n = 149) or Noninitiators (n = 17,273) During January 1, 2015–December 31, 2019
Column percent unless otherwise specified.
Propensity score models were based only on the variables included in this table (Supplementary Table S1).
The standardized difference (D) compares characteristics for CGM initiators with noninitiators. An absolute value of D (|D|) ≤0.1 indicates a negligible difference in the mean or in the prevalence of a covariate between groups. 12
Self-reported race/ethnicity from the electronic medical record. Mixed race means more than one of the racial/ethnic categories was selected.
The neighborhood deprivation index 17 is a validated contextual measure of socioeconomic status derived by linking each participant's geocoded residential address to census tract level socioeconomic indicators as reported in the 2010 American Community Survey.
Kaiser Foundation Health Plan is the provider of all insurance and does not offer Medicare fee-for-service; insurance types are not mutually exclusive.
Based on the modified version of the Deyo Charlson Comorbidity Score, 18 using inpatient and outpatient diagnosis and procedure codes. Possible scores ranged from 0 to 20 and represent the number of comorbid conditions identified (excluding diabetes) during the 12 months prebaseline.
This validated risk stratification score 19 predicts the 12-month risk of severe hypoglycemia (ED visit or hospitalization) in participants using electronic medical record data. The score is categorized as low (<1%), intermediate (1%–5%), and high (>5%).
NPH, Neutral Protamine Hagedorn; insulin types are not mutually exclusive.
Glucagon prescription may be an indicator of higher risk for a hypoglycemic event. Data were not available regarding unfilled prescriptions or usage.
Pump users often use pen as a backup, so participants with both pen and pump were categorized as pump users.
Table reports medications at the therapeutic drug class level.
Last HbA1c recorded during the 12 months prebaseline. HbA1c was included in propensity score models used for the hypoglycemia outcome but not HbA1c outcomes. Therefore, it appears here both as a baseline measure and as an outcome measure. The same is true of hypoglycemic events.
Identified by a principal diagnosis in the inpatient setting or a primary diagnosis in the ED during the 12 months prebaseline.
Utilization captured during the 12 months prebaseline.
CGM, continuous glucose monitoring; ED, emergency department; HbA1c, hemoglobin A1c; SMBG, self-monitoring of blood glucose.
In addition, compared with noninitiators, CGM users were more likely to be using basal-bolus insulin, long-acting analog insulin (vs. Neutral Protamine Hagedorn [NPH]), rapid-acting analog insulin (vs. regular), insulin pens, or insulin pumps, and they were more likely to have been dispensed glucagon; CGM users were less likely to be using mixed insulin, multiple daily injections, sulfonylureas, or ≥2 therapeutic medication classes. After overlap weighting, most of the differences in baseline characteristics were balanced (|D| < 0.1) between CGM initiators and noninitiators. To correct for the residual imbalance, the few baseline characteristics that remained unbalanced (|D| ≥ 0.1) were added as covariates in the DiD models along with the critical confounders identified from the DAG analysis.
Mean HbA1c declined among initiators from 6.98% to 6.92% (difference −0.06%) and increased among noninitiators from 7.10% to 7.42% (difference +0.32%), yielding a crude (unweighted and unadjusted) DiD estimate of −0.37 (−0.50, −0.24) and a weighted, adjusted DiD estimate of −0.30%; 95% CI −0.50%, −0.10%; P = 0.004) (Table 2). Changes in HbA1c were also estimated as the proportion of participants having HbA1c <7%, <8%, or >9% (consistent with Health care Effectiveness Data and Information Set (HEDIS) performance measures).
12-month pre- and Postbaseline Differences in a Cohort of 17,422 Insulin-Treated Patients with Type 2 Diabetes Who Used SMBG, Had HbA1c <8%, and No Recent Severe Hypoglycemia
Pre–post difference is calculated as postbaseline value minus prebaseline value.
DiD (95% CI) is calculated as ([postbaseline value minus prebaseline value in CGM initiators] minus [postbaseline value minus prebaseline value in CGM noninitiators]) from repeated-measures generalized linear models; there are slight discrepancies between the unadjusted/unweighted model-based DiD and the crude DiD for the HbA1c outcomes due to missing data. Patients with ≥1 HbA1c measure in either the pre- or postbaseline were included in the model.
Overlap weighting was based on propensity score model and adjusted for variables identified in the directed acyclic graph as critical adjusters (prebaseline insulin treatment, glycemic control, and acute metabolic crisis) and baseline covariates with |D| > 0.10 after weighting. Conservative 95% confidence intervals for both DiD estimates were estimated using robust variance estimators. 7
DiD, difference-in-differences.
The prevalence of HbA1c <7% increased from 40.3% to 53.7% (difference +13.4%) among CGM initiators compared with a decline from 35.1% to 33.2% (difference −1.9) among noninitiators, for a weighted and adjusted net change in prevalence associated with CGM initiation of 11.7% (95% CI: −1.2, 24.6; P = 0.08). The change in the prevalence of HbA1c <8% (i.e., the baseline eligibility criteria) among CGM initiators compared with noninitiators was not significant. Fewer CGM initiators had HbA1c >9% compared with the reference (1.4% vs. 6.6%, respectively; P = 0.009). Pre–post changes in severe hypoglycemia rates did not differ significantly between CGM initiators and noninitiators.
Discussion
CGM initiation was associated with a net improvement in glycemic control (0.30 points lower HbA1c) in this observational cohort of insulin-treated patients with T2D who used SMBG, had HbA1c <8%, and no recent severe hypoglycemia. This net benefit was largely attributable to the significant deterioration of glycemic control among noninitiators rather than improvement in glycemic control among CGM initiators. However, no changes were observed in the risk of severe hypoglycemia. Although rigorous causal estimation methods achieved excellent balance in covariates, 3 these observational findings may have been susceptible to selection bias or regression to the mean.
Observed patterns are unlikely due to treatment intensification in the CGM initiators or lack thereof in the noninitiators since mean HbA1c after baseline was still <8% (i.e., below the glycemic threshold indicating an urgent need for intensification). CGM initiation may have enabled patients to better manage their insulin and health behaviors than SMBG alone. Additional observational studies from other health care settings or randomized trials of CGM in well-controlled patients with T2D should be conducted to confirm these observational findings.
Conclusions
This real-world comparative effectiveness study suggests that CGM may provide benefit by preventing glycemic deterioration even in well-controlled patients with insulin-treated T2D.
Footnotes
Disclaimer
The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the article; and had no role in the decision to submit the article for publication.
Authors' Contributions
A.J.K., M.M.P., H.H.M., L.K.G., and R.D. were involved in study design, researched data, contributed to discussion, wrote/edited the article, and reviewed/edited the article. M.M.P. performed statistical analyses.
Author Disclosure Statement
A.J.K. reported receiving grants from Dexcom (an independent investigator award), the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), the National Institute on Aging (NIA), the National Library of Medicine, and the Patient-Centered Outcomes Research Institute. M.M.P. reported receiving grants from Dexcom, Inc., the NIDDK, and the National Institute on Aging (NIA). H.H.M. reported receiving grants from Dexcom, the NIDDK, the NIA, Kaiser Permanente Northern California Community Benefits, and the National Library of Medicine. No other disclosures were reported.
Funding Information
This research was supported by an independent investigator award from Dexcom and funding from NIH (R01 DK103721 and P30 DK092924 from the NIDDK) and Kaiser Permanente Northern California Community Health. The sponsor did not have the right to veto publication or to control the decision regarding to which journal the article was submitted.
Supplementary Material
Supplementary Table S1
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
