Abstract
Introduction
By 2030, diabetes mellitus (DM) will affect an estimated 336 million people worldwide. 1 Approximately 35% of individuals with DM have diabetic retinopathy (DR), which is the leading cause of new-onset blindness globally as well as in the United States among adults. 2,3 The American Academy of Ophthalmology and the American Diabetes Association generally recommend an annual eye examination for people with diabetes. 4,5 Less than 65% of people with diabetes receive these screenings and in underserved populations, the rates can be as low as 10–20%. 6 –8
Poor health status, legal blindness, younger age, and short duration of diabetes are associated with lower rates of follow-up of eye examinations. 6,9,10 Barriers to care include lack of access to care, high costs, limited insurance, distance, time away from work, and difficulty with transportation. 9 –15 Low comprehension of risk for DR, even after discussions with the provider, also leads to lack of adherence to eye screening recommendations. 6,10 In one study, 91% of patients cited “the doctor's recommendation” as a key reason to follow up with eye examinations. 16 DR telemedicine programs address some of these barriers through point-of-care eye imaging at primary care offices, and they are cost-effective, efficient, and accurate with high sensitivity rates (up to 95%). 17 –21 A randomized control trial showed that screening rates were 56% for traditional, in-person visits compared with 94% in the telemedicine group. 22 In England and Wales, DR is no longer the leading cause of blindness, which is attributed to a national DR telemedicine screening program. 23 Telemedicine for DR screening has the potential to grow rapidly as a result of these successes. 24 –26
Despite the promise of telemedicine for DR, we do not understand patients’ perceptions of telemedicine for eye disease management. Patient satisfaction with DR telemedicine varies widely from 35% to 99%. 27 –31 But patient satisfaction does not measure patients’ underlying beliefs. It is essential to engage patients to understand their attitudes, concerns, and perceptions before wide-scale implementation. This is especially critical in the United States, where a nationally sponsored program is less likely to be implemented. Telemedicine programs should reflect patients’ beliefs and be tailored toward those most in need and those most likely to utilize this type of service. We performed a study of patients, largely unfamiliar with telemedicine, to explore their attitudes toward telemedicine and their willingness to participate in a telemedicine program for DR screening.
Materials and Methods
The Institutional Review Board at Duke University and the Durham Veterans Administration approved this study. Participants were recruited from the Duke University Medical Center and from the Durham Veterans Affairs primary care and endocrine clinics, and all eligible patients received informed consent. Consecutive adults with diabetes from a convenience sample of patients were recruited from these centers. The study coordinator identified individuals who had DM in coordination with the treating physician and clinic. Then, the study coordinator approached the participants in the waiting room or after the examination by the physician and took the patients to a private interview space to conduct the study. There, the study coordinator re-confirmed the diagnosis of diabetes before survey administration.
Survey content
The survey included questions on demographics (patient age, sex, race, education level), duration of DM, ocular and systemic comorbidities, access to medical care, and attitudes toward telemedicine for DR (Supplementary Fig. S1; Supplementary Data are available online at
During the survey, the interviewer asked, “Have you heard of telemedicine?” Then, the interviewer read a one-paragraph explanation of telemedicine for DR screening followed by the opportunity to ask questions.
The statements to measure patients’ attitudes were developed through cognitive interviewing. First, the instrument was assessed for face validity by advisors, members of the study team, and medical colleagues. Then, 42 patients completed open-ended cognitive interviews for further feedback (not included in final analysis). These patients were asked what they understood from the questions, and their feedback was used to refine the statements until thematic saturation was achieved.
The three measures of patients’ attitudes were: (1) willingness to participate in telemedicine (Willingness) stated as “I would be willing to receive my exams this way.”; (2) perception of the convenience of telemedicine (Convenience) stated as “I believe this method of eye exam would be more convenient than going to a separate eye appointment.”; and (3) the perceived impact of telemedicine on the patient–physician relationship (Relationship) stated as “I would miss interacting with my eye doctor in person.” Responses were recorded on a five-point Likert scale and then converted to binary outcomes by combining “strongly agree” with “agree,” and combining “uncertain,” “disagree,” and “strongly disagree.”
Survey administration
Two research assistants conducted all interviews in person with the participants. Interviews were standardized by protocol. To test the protocol for inter-interviewer reliability, both research assistants interviewed the same three participants. Responses to the telemedicine attitude scale were compared after each interview, and reliability was confirmed.
Statistical analysis
Participant characteristics were summarized using means and standard deviations for continuous variables and frequencies and percentages for categorical variables. Our primary outcome of interest was participants’ willingness to participate in telemedicine. Predictor variables included participant demographic factors (age, sex, race, and education level), duration of DM, number of ocular and systemic comorbidities, and access to care. We included patients’ perception of convenience and patient–physician relationship to assess their impact on willingness to participate in DR screening via telemedicine. Our secondary outcome measures were patient perception of convenience and the perception of the patient–physician relationship. We analyzed outcomes using univariable and multivariable logistic regression models. The model generated odds ratios with 95% confidence intervals (95% confidence interval). Regression diagnostics were performed, including checks for multicollinearity. We considered p-values less than 0.05 to be statistically significant. All statistical analysis was performed using Stata 11.0 (Statacorp, College Station, TX).
Results
Ninety-seven participants completed the survey (Table 1). The median age of participants was 57 years (interquartile range = 52–70 years). Thirty (31%) of 97 participants were women. The median duration of diabetes was 10 years (interquartile range = 5–20 years). Of 97 participants, only 3 (3%) had heard of telemedicine before the interview.
Characteristics of Survey Participants (n = 97)
Thirty-one (32%) of the 97 participants were either not willing or uncertain of participating in telemedicine. Of the 97 participants, 67 (69%) believed that telemedicine would be more convenient than an in-person eye exam. Of the 96 participants, 50 (48%) reported that they would not miss their relationship with the eye physician (Fig. 1-Distribution of responses).

Attitudes toward telemedicine for diabetic retinopathy for patients with diabetes mellitus. Distribution of participant responses for survey questions regarding telemedicine for diabetic retinopathy is displayed in the figure. Patients answered strongly disagree, disagree, uncertain, agree, or strongly agree for the following questions: “I would be willing to receive my eye exams this way” (left), “I believe this method of eye exam would be more convenient than going to a separate eye appointment” (center), and “I would miss interacting with my eye doctor in person” (right).
Participant demographic factors, including age, sex, race, and education level, were not associated with willingness, convenience, or the patient–physician relationship (all p > 0.05) (Tables 2 –4).
Logistic Regression Models for Willingness to Accept Telemedicine for Diabetic Retinopathy Examinations
Univariable logistic regression.
Multivariable logistic regression adjusted for all other variables in the table.
The referent category is “less than 8th grade.”
The referent category is “Caucasian.”
OR, odds ratio; CI, confidence interval.
Logistic Regression Models for Perception of Convenience of Telemedicine for Diabetic Retinopathy Examinations
Univariable logistic regression.
Multivariable logistic regression adjusted for all other variables in the table.
The referent category is “less than 8th grade.”
The referent category is “Caucasian.”
OR, odds ratio; CI, confidence interval.
Logistic Regression Models for Missing the Patient–Physician Relationship in Telemedicine for Diabetic Retinopathy Examinations
Univariable logistic regression.
Multivariable logistic regression adjusted for all other variables in the table.
The referent category is “less than 8th grade.”
The referent category is “Caucasian.”
OR, Odds ratio; CI, Confidence interval.
Willingness
In univariable analyses, the patient's duration of DM (unadjusted odds ratio (OR) = 0.96, 95% confidence interval (CI) = 0.93–0.99, p = 0.02) and the perception that they would miss the patient–physician relationship (unadjusted OR = 0.136, 95% CI = 0.05–0.36, p < 0.001) significantly decreased a participant's likelihood of being willing to participate in telemedicine (Table 2). Conversely, if patients perceived the program to be convenient, that significantly increased their likelihood of being willing to participate in the program (unadjusted OR = 6.23, 95% CI = 2.41–16.10, p < 0.001) (Table 2).
In multivariable analysis, the patient–physician relationship and the longer duration of diabetes decreased the willingness to participate in telemedicine compared with an in-person examination. Patients who valued the patient–physician relationship had 92% decreased odds of being willing to participate in telemedicine (adjusted OR = 0.08, 95% CI = 0.02–0.35, p = 0.001). For each additional year of having DM, patients had 7% decreased odds of being willing to participate in telemedicine (adjusted OR = 0.93, 95% CI = 0.88–0.99, p = 0.02). The perceived convenience and the number of systemic comorbidities increased willingness. Patients who believed telemedicine to be more convenient had eight times higher odds of being willing to participate in telemedicine (adjusted OR = 8.10, 95% CI = 1.77–36.97, p = 0.01). For each additional systemic comorbidity, patients had 85% higher odds of being willing to participate in telemedicine (adjusted OR = 1.85, 95% CI = 1.10–3.11, p = 0.02).
Convenience and patient–physician relationship
Perception of convenience, when analyzed as an outcome independent of willingness, was influenced by patients’ number of ocular comorbidities and their access to care (Tables 3 and 4). In multivariable analysis, for each additional ocular comorbidity, the patient had 68% decreased odds of considering telemedicine to be more convenient (adjusted OR = 0.32, 95% CI = 0.15–0.71, p = 0.005). For each unit increase in access to care, participants had 20% decreased odds of perceiving telemedicine to be more convenient (adjusted OR = 0.80, 95% CI = 0.68–0.93, p = 0.004) (Table 3).
In univariable analyses, patients with greater ocular and systemic comorbidities had higher odds of missing the patient–physician relationship through telemedicine (unadjusted OR = 1.88, 95% CI = 1.16–3.05, p = 0.01 and unadjusted OR = 1.33, 95% CI = 1.05–1.70, p = 0.02, respectively). These associations were not significant in multivariable models (p = 0.18 and p = 0.07, respectively) (Table 4).
Discussion
Telemedicine is a care delivery method proven to deliver high-quality screening for DR. However, whether patients will accept this new model of care is unknown. We explored the willingness to accept telemedicine by focusing on individuals’ beliefs about telemedicine, demographics, and health characteristics. In this study, 97% of the study population had not heard of “telemedicine,” which is reflective of the majority of U.S. citizens. Only pockets of the U.S. population (e.g., Veterans, Native Americans, indigent populations in specific regions) currently use telemedicine. The clinic for our recruitment had not instituted their DR telemedicine program at the time of enrollment. In our study, 32% of participants were either unwilling or unsure about participating in telemedicine for DR screening. It is important to take these perceptions into account when designing telemedicine programs. We found that patients’ age, gender, race, and education level did not influence their attitudes toward telemedicine. We were surprised that age did not influence attitudes toward telemedicine, as it is well known that older adults are less likely to use technology. 35 We hypothesize that older participants believed that the burden of technology in a telemedicine encounter is placed on the provider, and not placed on the patient.
Patients’ willingness to participate in telemedicine was influenced by how much they value the relationship they have with their physician, their perceived convenience of telemedicine, and their current health status. Patients who highly valued the patient–physician relationship had 92% lower odds of being willing to participate in telemedicine. Patients with diabetes see the same physician frequently (often more than four times a year), leading to close patient–physician relationships. A strong patient–physician relationship is often among the highest priorities for patients. 36 Patients with a longer duration of diabetes were less willing to participate in telemedicine. “Willingness” to try new technologies is closely tied to the concepts of trust and openness. 37,38 Patients with long-standing disease are less likely to trust a new, less-personal delivery model. In our study, the highest impact on willingness was convenience. Patients who believed telemedicine to be more convenient had eight times (or 800%) higher odds of being willing to participate in telemedicine. Patients with multiple systemic comorbidities had 85% higher odds of being willing to participate in telemedicine. Though this result seems to contradict the findings that those who highly valued their patient–physician relationship and had a longer duration of diabetes were less willing to use telemedicine for DR screening, perhaps patients with multiple chronic diseases value simpler screening methods for conditions such as eye disease, which may not be their highest medical priority. 39 –41 Our results indicate that willingness to participate in telemedicine for DR screening reflects how patients perceive convenience, the patient–physician relationship, and their health.
We evaluated the perceived convenience of telemedicine independent of willingness. Two key factors influenced perceived convenience: access to care and number of ocular comorbidities. Patients with better access to care did not believe telemedicine to be more convenient than an in-person eye examination. Therefore, telemedicine programs should focus on individuals who have limited access to care. 24, 42 Programs could also highlight the shortened travel distances and decreased time away from work for those who already have good access to care. 39 Not surprisingly, patients with ocular comorbidities did not believe telemedicine to be more convenient than an in-person examination. However, in the multivariable model, having ocular comorbidities did not impact overall willingness to participate in telemedicine for DR. The results indicate that a person's general health and beliefs outweigh ocular health in terms of willingness to participate in telemedicine for DR.
Our study has limitations. All participants were patients in an endocrinology or primary care clinic. We did not include patients outside of the healthcare system. We used a convenience sample approach for patient recruitment, which introduces some potential biases. Also, a low percentage of women were enrolled in the study, largely due to recruitment at the Veterans Affairs clinics. This limits generalizability of our results. Self-reported ocular and systemic comorbidities may differ from clinical diagnoses, which could potentially impact their association with the measured outcomes. Interviewers provided information about telemedicine, whereas patient responses were based on hypothetical extrapolation, not on practical experience with telemedicine services. We find lack of telemedicine exposure both a weakness and a strength of the study, because lack of experience also more closely reflects the experience of the general U.S. population. Additional research will need to be conducted to better understand attitudes toward telemedicine for those already familiar with the approach or those in remote areas.
Telemedicine programs should be designed based on consumer needs. Patients’ attitudes toward telemedicine eye care are influenced by their health and beliefs, not by their demographics. Patients who valued convenience or had more systemic health problems were more willing to participate in telemedicine for diabetic eye care. Patients who valued their relationship with their physician or had a longer duration of DM were less willing to participate. Access to care did not influence patients’ willingness, but it did influence their perceived convenience of telemedicine. Patients with more ocular or systemic health issues were more likely to miss the patient–physician interactions in a telemedicine care model. Telemedicine programs should focus on patients with the greatest need for services and those who would be the most receptive to telemedicine. Understanding patients’ attitudes toward telemedicine is key to developing, improving, and maintaining patient-centered telemedicine programs.
Footnotes
Acknowledgments
This work was supported by the National Eye Institute, Bethesda, MD [grant numbers K23EY023596-01 (Maria A Woodward), K12EY022299 (Paula Anne Newman-Casey)]; Research to Prevent Blindness, New York, NY (Paul Lee as unrestricted grant to the Department of Ophthalmology, University of Michigan); and the National Center for Advancing Translational Sciences (NCATS), Bethesda, MD [grant number UL1TR000433 (Nita Valikodath)]. The funding organizations had no role in the design or conduct of this research.
Disclosure Statement
M.W: Intelligent Retinal Imaging Systems (Scientific Advisory Board), 418 West Garden St., Suite 209, Pensacola, Florida 32502
P.L: Centers for Disease Control (Consulting), 1600 Clifton Rd, Atlanta, GA 30333
The following authors have no financial disclosures: Nita Valikodath, Thellea Leveque, Sophia Wang, Sean Hansen, and Paula Anne Newman-Casey.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
