Abstract
Background:
Many different devices are available to patients to measure glucose levels, but there is no validated method to assess treatment satisfaction with glucose monitoring devices and its impact on quality of life and other patient-reported outcomes. To address this problem, we developed the Glucose Monitoring System Satisfaction Survey (GMSS). We describe the construction and validation of the GMSS and examine how key patient factors are associated with glucose device satisfaction.
Materials and Methods:
Items were developed from interviews with 15 adults with either type 1 diabetes (T1D) or type 2 diabetes (T2D) and 10 diabetes healthcare professionals, resulting in an initial pool of 42 items. Separate exploratory factor analyses (EFAs) were conducted with adults with T1D (n=254) and with insulin-using T2D (n=206). Construct validity was established with overall well-being (World Health Organization-5), diabetes distress (Diabetes Distress Scale), attitudes toward glucose monitoring (Self-Monitoring of Blood Glucose Obstacles scale), and the previously validated Blood Glucose Monitoring System Rating Questionnaire. Regression analyses examined associations between total scale satisfaction and demographics, diabetes status, and glucose monitor use.
Results:
The two EFAs resulted in two 15-item scales, one for T1D and one for T2D, and yielded four coherent and meaningful factors in each sample: three factors with the same items in common for both samples (Emotional Burden, Behavioral Burden, and Openness) and a fourth factor unique to each sample (Trust for T1D, Worthwhileness for T2D). The final EFA accounted for 66.5% of the variance in the T1D sample and 67.0% in the T2D sample. Validity was established by significant correlations with criterion variables.
Conclusions:
The GMSS is a reliable, valid measure of glucose device satisfaction in its T1D form and in its insulin-using T2D form. It provides a comprehensive profile of sources of device satisfaction for use in clinical care and research.
Introduction
A
Previous studies have examined broad attitudes toward blood glucose (BG) monitoring, highlighting how patients' confusion and frustration regarding BG data can influence adherence to monitoring recommendations, 1 but there has been little research directly examining patient views of the utility, usefulness, and satisfaction with their monitoring devices. For example, to evaluate a novel system integrating an insulin pump and RT continuous glucose monitor, Peyrot and Rubin 2 developed the BG Monitoring System Rating Questionnaire (BGMSRQ), which targeted eight key dimensions: convenience, interference, BG burden, BG control, overall satisfaction, desire to switch BG monitoring systems, willingness to recommend current BG monitoring system, and comparison of current and prior BG monitoring. Researchers for the JDRF CGM Study Group 3 developed the Glucose Monitoring Survey (GMS), a 22-item scale that examined both satisfaction with and the therapeutic impact of patients' current glucose monitoring systems (self-monitoring of BG [SMBG] alone or with CGM). Preliminary analyses revealed two key factors: glucose control (the perceived influence of BG monitoring on glycemic values) and social complications (how monitoring impacts on interpersonal relationships). Finally, Polonsky and Hessler 4 developed the 16-item RT-CGM QOL scale that assesses QOL-related benefits and losses associated with RT-CGM. Factor analysis pointed to three major factors evidencing acceptable internal reliability: perceived control over diabetes, hypoglycemic safety, and interpersonal consequences and support.
Unfortunately, it is unknown whether any of these three scales is applicable across the broad range of glucose monitoring devices or across different diabetes types. It is noteworthy, for example, that each of the three measures focuses exclusively on patients with type 1 diabetes (T1D).
Without the availability of a validated, comprehensive instrument, it is difficult to examine the differential psychological impact and perceived satisfaction across a range of glucose devices and to determine the acceptability of such devices and their features on patients and their self-care. To address these needs, we developed and validated the Glucose Monitoring System Satisfaction Survey (GMSS), which builds on the strengths of previously developed instruments and addresses many of their limitations. This report describes the construction, evaluation, and validation of the GMSS and examines how key patient factors are associated with glucose device satisfaction.
Research Design and Methods
Structured interviews, with content guided by the current literature, were conducted with 15 adults with either T1D or type 2 diabetes (T2D) and with 10 diabetes healthcare professionals (HCPs). Respondents' verbal descriptions of their wide-ranging personal experiences with glucose monitors and the different features of each instrument were documented, focusing on the positive and negative attributes of the devices, how the devices had affected their feelings about diabetes and their ability to manage diabetes, and the impact of the device on their overall health and QOL. Responses were reviewed for duplication and were converted into an initial set of 42 survey items. Patients and HCPs then reviewed the items for completeness and clarity. The draft scale was formatted such that respondents could rate each item on a 5-point scale: 1=strongly disagree, 2=disagree, 3=neutral, 4=agree, and 5=strongly agree. The 42 items were part of a larger, online assessment battery that included previously validated instruments to be used for documenting the construct validity of the new scale.
Separate samples of T1D adults and insulin-using T2D adults were recruited from the Taking Control of Your Diabetes (TCOYD) Research Registry. This Registry is a Health Insurance Portability and Accountability Act (HIPAA)–protected online platform that includes adults with diabetes, recruited primarily from TCOYD's 1-day diabetes education events conducted in multiple cities across the United States. By joining the Registry, patients agree to be contacted about participating in online survey research. For the current study, participants were required to be ≥19 years old, be diagnosed with T1D or T2D and using insulin for ≥1 year, and own and use a primary glucose monitor regularly for >3 months (minimum testing at least once weekly). After receiving the initial study announcement via e-mail and successfully completing a brief online eligibility questionnaire, participants completed informed consent and the survey battery online. Participants received a $10 electronic gift card for participation. Questionnaire data were entered into a central database using a HIPAA-protected server. The research protocol was approved by Ethical and Independent Review Services, a community-based, institutional review board.
Measures
In addition to the initial 42-item GMSS, three groups of measures were included to describe the sample and examine correlates of device satisfaction. First, demographic measures included age, gender, ethnicity (white vs. non-white), education (years), type of diabetes, number of years since diagnosis, number of years using insulin, and body mass index (BMI) (calculated from self-reported weight and height). In addition, the Subjective Numeracy Scale 5 was used to assess ability and preference for the presentation of numerical information (eight items) (α=0.81). Second, measures of diabetes status included self-reported glycated hemoglobin (A1C), insulin regimen (continuous subcutaneous insulin infusion vs. injections), use of RT-CGM, number of low blood glucose measurements (<70) in the past week, and number of diabetes complications (from a list of 14). Third, assessments of monitor use focused on frequency of SMBG, how regularly glucose results were reviewed with a clinician (ranging from 1=never to 5=at all of our visits), and—in response to high and/or low glucose results—how regularly the patient made dietary, activity, or medication changes or did nothing in response (all four items ranging from 1=never to 4=I do this regularly). 6
The following scales were included to assess the construct validity of the GMSS. The World Health Organization-5 (WHO-5) is a five-item scale that assesses QOL 7 (α=0.86). The Diabetes Distress Scale (DDS) assesses worries and concerns specifically related to diabetes and its management; it has been shown to be a good marker of diabetes-related QOL 8 (α=0.93). T2D participants completed the original, 17-item DDS, whereas T1D subjects completed the new DDS version for T1D, the 28-item DDS-T1 9 (α=0.91). The SMBG Obstacles scale assesses two negative attitudes regarding SMBG: pointlessness (α=0.70) and avoidance (α=0.83). 1 Participants also completed the satisfaction subscale of the previously validated BGMSRQ. 2
Statistical analysis
Descriptive statistics were computed to review item and scale distributions for each sample. The χ2 and t tests, as appropriate, were conducted to test for differences in patient characteristics and outcome variables across the two samples. Separate exploratory factor analyses (EFAs) were conducted with Promax rotation for each sample to determine whether the device satisfaction items could be reduced and grouped into meaningful subscales. Separate EFAs also were conducted to explore whether differences in response patterns might point to the construction of separate instruments for each sample with different subscales. Based on factor analytic results, subscales were created by averaging across items. Internal consistency of the subscales and the total scales was determined by Cronbach's α statistic. Construct validity was examined by Pearson correlations between subscale and total scale scores with QOL, diabetes distress, and glucose monitoring attitudes. Multiple regression analyses examined associations of total device satisfaction with the three groups of variables: demographics, diabetes status, and glucose monitor use.
Results
Of the 471 individuals who completed informed consent and started the survey, 460 (97%) completed the entire survey. A description of the T1D (n=254) and T2D (n=206) samples is presented in Table 1. As expected, the T1D group was significantly younger, with a lower BMI and with a longer duration of diabetes than the T2D group. The T1D sample included significantly more males, non-Hispanic whites, and insulin pump users than the T2D sample. In addition, T1D subjects reported a significantly lower A1C, higher QOL, and lower levels of SMBG obstacles than T2D subjects.
Mean and SD values are presented for continuous variables.
Comparing patients diagnosed with type 1 versus type 2 diabetes (t test or χ2 test).
BMI, body mass index; BGMSRQ, Blood Glucose Monitoring System Rating Questionnaire; CGM, continuous glucose monitoring; DDS, Diabetes Distress Scale; DDS-T1, Diabetes Distress Scale for type 1 diabetes; HbA1c, glycated hemoglobin; SMBG, self-monitoring of blood glucose; WHO-5, World Health Organization-5.
Factor analysis and construct validity of the GMSS
Inspection of individual item distributions led to the removal of one item, due to lack of variability within both samples. An EFA of the remaining 41 items, run separately for T1D and T2D patients, yielded seven-factor solutions (eigenvalues ≥1.00) for each sample that accounted for 59.2% of the common item variance for T1D and 63.3% for T2D. Inspection of the items in each factor and the scree plot of successive eigenvalues for each analysis indicated that four factors might provide a good description of the data in each analysis. Items that loaded <0.50 on all factors or were cross-loaded on multiple factors (i.e., ≥0.30) were dropped, and the remaining items were subjected to a second EFA for each patient group. This analysis included 15 items: 12 of which were common across the two samples and three items that were unique to each sample. This final EFA yielded four coherent and meaningful factors in each sample: three factors with the same items in common for both samples and a fourth factor unique to each sample. The final EFA accounted for 66.5% of the variance in the T1D sample and 67.0% in the T2D sample. Items and factor loadings are presented in Table 2.
(R) indicates the item is reverse-scored before averaging for subscale score. In addition, items that load onto the emotional burden and behavioral burden subscales are reverse-scored before averaging across all items to obtain the total scale score.
Bolded items are those that load most highly on the individual factor.
Based on the item content, the three subscales common to both samples were labeled as follows: “Openness” centered on a sense of liberation and/or perceived reduction in feeling restricted due to monitor use (e.g., “Helps me be more open to new experiences in life”) (four items; Cronbach's α=0.81 for T1D and 0.82 for T2D); “Emotional Burden” focused on the emotional stresses and strains of monitor use (e.g., “Makes me feel more frustrated with my diabetes”) (four items; Cronbach's α=0.82 for T1D and 0.80 for T2D); and “Behavioral Burden” related to the day-to-day bother and annoyance associated with monitor use (e.g., “Is too much of a hassle to use”) (four items; Cronbach's α=0.80 for T1D and 0.84 for T2D). Unique to the T1D sample, “Trust” focused on the perceived reliability of the monitor and the sense of confidence that the results were accurate (e.g., “Gives me numbers that I don't entirely trust”) (three items; Cronbach's α=0.80). Unique to the T2D sample, “Worthwhileness” centered on the perceived personal value of monitor use (e.g., “Helps me and my doctor to know how much of my diabetes medications to take”) (three items; Cronbach's α=0.76). The total GMSS score, which included all 15 items relevant for each sample, also demonstrated good internal consistency (Cronbach's α=0.86 and 0.90 for T1D and T2D, respectively). Thus, analysis of the initial GMSS items yielded coherent, internally consistent and reliable subscales that were both general and unique to each T1D and T2D sample.
Intercorrelations among subscales were low to moderate (r=0.17 to r=0.53 for T1D; r=0.44 to r=0.54 for T2D), suggesting related, but distinct, dimensions of glucose monitoring device satisfaction. Each scale score was calculated as the mean of the contributing items after reverse coding items (see Table 2), and the mean score per subscale was as follows: Openness, 3.40 (±0.84) for T1D and 3.14 (±0.80) for T2D; Emotional Burden, 1.73 (±0.75) for T1D and 1.95 (±0.77) for T2D; Behavioral Burden, 2.32 (±0.84) for T1D and 2.55 (±0.93) for T2D; Trust, 3.69 (±0.89) for T1D; and Worthwhileness, 3.89 (±0.73) for T2D. The average total GMSS satisfaction score (reverse coding negative subscales to be positive) was 3.76 (±0.60) for T1D and 3.61 (±0.64) for T2D. Of note is that mean T1D satisfaction scores were significantly higher than mean T2D satisfaction scores on each of the three commonly shared subscales (in all cases, P<0.005).
The GMSS total scale and all four subscales were significantly related (all P<0.001) to the criterion variables for both the T1D and T2D samples (Table 3). These findings support the validity of the subscales and total scale score for patients with T1D and T2D on insulin.
All correlations were significant at P<0.001.
BGMSRQ, Blood Glucose Monitoring System Rating Questionnaire; GMSS, Glucose Monitoring System Satisfaction Survey; SMBG, self-monitoring of blood glucose.
Predictors of BG monitor satisfaction
Three multiple regression equations were run for each sample to determine whether patient demographics, diabetes status, or device use predicted subsequent device satisfaction, as reflected by the total GMSS score (see Table 4 for standardized β values). Among the five demographic variables (age, gender, ethnicity, diabetes duration, and subjective numeracy), only subjective numeracy was associated with GMSS and only among T2D subjects (P<0.001): higher subjective numeracy was associated with a higher total GMSS score.
All analyses are controlling for gender and ethnicity.
CGM, continuous glucose monitoring; GMSS, Glucose Monitoring System Satisfaction Survey; HbA1c, glycated hemoglobin; T1D, type 1 diabetes; T2D, type 2 diabetes.
Among the five diabetes status variables (number of complications, A1C, insulin pump use, CGM use, and number of hypoglycemic events in the past week), A1C was significantly associated with GMSS scores for both samples (T1D, P=0.002; T2D, P<0.006): for both T1D and T2D groups, lower A1C was associated with higher GMSS scores. Furthermore, number of complications (P=0.003) and insulin pump use (P=0.05) were also significantly associated with GMSS scores, but only for the T2D sample: fewer complications and insulin pump use were independently associated with higher GMSS scores.
Finally, of the six device use variables (how frequently subjects checked their BG levels, reviewed results with their HCP, responded to out-of range BG results by altering their dietary intake, exercise level, or medications, or “did nothing” in response to out-of-range BG levels), only reviewed results with their HCP and “did nothing” emerged as independent predictors of GMSS and only for T2D subjects: those who typically did not take action in response to out-of-range BG levels had lower GMSS scores, whereas those who more regularly reviewed with their glucose results with their HCP had higher GMSS scores.
Of note is that device satisfaction was not associated with gender, age, ethnicity, years with diabetes, or frequency of monitor use for either the T1D or the T2D sample in any of the three equations. The regression equations were run again with adjustments for gender and ethnicity, and the results remained unchanged.
Discussion
Toward a more comprehensive understanding of patients' satisfaction with glucose monitoring devices, we developed the GMSS, a 15-item self-report scale with documented validity and reliability. The GMSS comprises four clinically meaningful subscales that capture key features contributing to device satisfaction. Three of the four subscales, representing 12 of the 15 items, are shared by both T1D and insulin-using T2D samples: Openness, which embodies the ways in which a glucose device may have a broad, favorable impact on diabetes-related quality of life; Emotional Burden, which captures the negative impact on diabetes-related QOL; and Behavioral Burden, which reflects the more narrow, day-to-day hassles associated with monitor use. The fourth subscale is different in the T1D and T2D samples. For T1D, the fourth subscale was Trust, which represents the subject's perception of how accurate or reliable the device may be. For T2D, the fourth subscale was Worthwhileness, which represents the perceived personal value of monitor use.
Several findings support the need for two GMSS scales: one for T1D patients and one for insulin-using T2D patients. First, the patterns of intercorrelations among subscales are strikingly different between the T1D and T2D samples. Second, the significantly different levels of reported device satisfaction in the two samples (T1D patients report markedly greater device satisfaction than T2D patients on the three shared GMSS subscales) suggest that studies including T1D and T2D samples should be careful not to combine subscale scores or total scores across samples. We suspect that these differences in device satisfaction between the two samples may reflect broader group differences in treatment burden. For example, the demands of day-to-day care are typically greater for T1D patients than for T2D patients (even insulin-using T2D patients), and T1D patients are likely to feel more dependent on glucose devices than T2D patients, perhaps because of the greater danger of severe hypoglycemic episodes.
The GMSS provides several advantages over currently available instruments. First, although the GMSS examines satisfaction with both SMBG and CGM devices, the currently available RT-CGM QOL scale 4 is limited to use only with CGM devices. Furthermore, the RT-CGM QOL scale only examines the perceived impact of the device, not satisfaction per se. Second, the BGMSRQ 2 and GMS 3 have only been evaluated with T1D patients, preventing direct comparison of satisfaction between T1D and T2D patients, thus limiting their clinical utility. Third, both instruments are substantially longer than the GMSS (the BGMSRQ is 29 items; the GMS is 22 items). Fourth, the original standardization samples for both measures were markedly smaller than the GMSS sample (BGMSRQ study, n=28; GMS study, n=120 adults), and, unlike the GMSS, neither scale made use of factor analytic methods to document the statistical coherence of the subscales. Thus, our newly developed scale is far more psychometrically sound than previous measures.
As expected, greater device satisfaction, as assessed by the GMSS total and all subscales, is linked to greater well-being, lower levels of diabetes distress, and less negative attitudes toward BG monitoring, all lending support to the validity of the new measure. Although causality cannot be determined, these associations suggest that emotional distress (generic or diabetes-specific) may color a patient's perception of his or her monitoring device, rendering device satisfaction less likely. Alternatively, it is possible that greater device satisfaction may help to alleviate distress. Regardless of the direction of influence, satisfaction with one's glucose monitoring device is a significant component of overall emotional distress.
Variations in device satisfaction based on participant characteristics raise important implications for how satisfaction might be enhanced. Among T2D subjects, greater device satisfaction is associated with a set of predictors that reflect a greater sense of willingness or ability to be personally engaged with their diabetes (more likely to take action in response to out-of range BG values, more frequently reviewing results with their HCP, insulin pump use, and higher level of subjective numeracy) as well as more favorable outcomes (fewer long-term complications and better glycemic control). This suggests that boosting device satisfaction may require support and training to help T2D patients understand and make better use of their own glucose data, leading to greater interest and engagement in self-management. 10,11 In contrast, greater device satisfaction among T1D subjects is linked only to better glycemic control but is not associated with any demographic or device use variable. Because T1D adults are more likely to be familiar and comfortable with glucose monitoring devices and how to interpret the resulting data, use their devices relatively more frequently, and feel more dependent on them, this last finding suggests that the various features of the monitoring device itself may be more important in determining satisfaction for T1D patients than any particular patient characteristic. As a practical matter, it is important to note that the ability to influence device satisfaction may be limited by common insurance company and/or governmental constraints, making careful selection of “appropriate” devices for each patient all the more important.
The strengths of this study are that relatively large samples of insulin-using patients—both T1D and T2D—were included, item content was developed directly from the T1D and T2D adults and providers, and results suggest excellent reliability and validity. Several cautions, however, should be noted. First, non–insulin-using T2D patients were not included in the current study, so the applicability and utility of the GMSS in that population have not been documented. Second, the study samples were primarily non-Hispanic whites and highly educated (see Table 1), factors that may limit generalizability. The scales should be reevaluated with a broader patient sample. Finally, glycemic control (A1C) was assessed via self-report rather than by a laboratory analysis, which may have introduced important bias. However, fewer than 3% of subjects were unable to report a value or reported an improbable value, and in our related work with T1D adults there was a high level of agreement between self-reported A1C and the laboratory result (r=0.84; see Fisher et al. 9 ).
The GMSS is a reliable, valid measure of device satisfaction, with versions available for adults with T1D and for adults with T2D. It provides a comprehensive profile of key contributors to device satisfaction, including both negative and positive influences.
Footnotes
Acknowledgments
This investigator-initiated study was supported by Sanofi Diabetes Care.
Author Disclosure Statement
W.H.P. has worked as a consultant for Sanofi Diabetes Care, Dexcom, Roche Diabetes Care, Abbott Diabetes Care, and Johnson & Johnson. L.F. has worked as a consultant for Roche Diabetes Care, Abbott Diabetes Care, and Sanofi Diabetes Care. D.H. reports no competing interest. S.V.E. has worked as a consultant for Sanofi Diabetes Care, Dexcom, Bayer Diabetes Care, Abbott Diabetes Care, and Johnson & Johnson.
W.H.P. and L.F. were responsible for study conception and protocol. D.H. was responsible for statistical analysis. All authors were responsible for manuscript development and read and approved the final manuscript.
