Abstract
BACKGROUND:
Telemedicine is an alternative to traditional face-to-face doctor-patient office visits. Although telemedicine is becoming more prevalent, few studies have looked at the perceived favorability rate among patients utilizing telemedicine over the traditional office visit to a provider’s office considering data samples from more than 5 clinics in northern Louisiana.
OBJECTIVE:
This study aims to measure patient favorability of using telemedicine to receive care. This study looks at the perceived positive and negative favorability rates of patients in the oncology settings. The researchers analyzed how age, income level, and education level influenced the perceived patient favorability rates and their willingness to utilize telemedicine.
METHODS:
The investigators used Chi-Square analysis to identify favorability with respect to age education and income levels. In addition to this Artificial Neural Networks were used to identify the threshold for favorability with respect to age, income, and education.
RESULTS:
Chi-Square tests of association showed that of the variables analyzed, only education level had a statistically significant relationship with a patient’s favorability rate of telemedicine utilization. While our neural network analysis indicated that the threshold for income, age, and education are $34,999, 66 years, and a college degree.
CONCLUSION:
In this article the investigators have successfully demonstrated the use of Artificial Neural Networks in identifying favorability of telemedicine used in addition to the traditional statistical methods such as Chi-Square. Thereby, creating a path for future research using advanced computational techniques like Artificial Neural Networks in analyzing human behavior.
Introduction
The idea of receiving medical care remotely, known as telemedicine, is no longer an unfamiliar practice in the health care system. With the continuous need to harness the power of health information technology, doctors and patients alike are benefitting from the increased access to health care services made possible by telemedicine. The adoption and use of telemedicine has increased dramatically since the 1990s [1]. A ubiquitous definition of telemedicine requires a geographic separation between the patient and the clinician providing the medical care [2]. Here we would like to inform our readers that this article illustrates an extension of the research described in Gurupur et al. [3]. The instrument and data used here is the same; however, the investigators have demonstrated a different approach in attempting to analyze the acceptability of telemedicine use. The instrument used has been successfully tested for internal validity using Cronbach’s Alpha as described in [3].
Telemedicine is used in various capacities from teleconsultation and telediagnosis to telemonitoring services, which these are also the most popular uses of telemedicine [3]. Further, telemedicine has been instrumental in various medical specialty including cardiology, dentistry, dermatology, hematology, emergency care, endocrinology, home care, medical education, pediatrics, psychiatry, ophthalmology, radiology, surgery, urology and oncology. There are also various modes of interaction in using telemedicine technology. Telemedicine can occur in real time with synchronous one-way or two-way interaction motion video, transmission of still images or video clips with voice interaction or text interaction or asynchronous interaction in which images, or videos are stored and viewed at a later time [1]. Telemedicine utilizes both health information technology and communication mediums to deliver health care services, health information and health education [4].
Literature review
The focus of this study will be on telemedicine in the field of oncology. Telemedicine is utilized in oncology as a means to increase access to appropriate care [5]. To date, much of the literature has focused on models for deploying teleoncology, specifically as it relates to rural patients who would otherwise have to travel extensively for treatment [5, 6]. This travel costs the patient not only in gasoline and accommodation charges, but also in time lost due to excessive commuting.
Age has been an important factor when it comes to acceptability of telemedicine. This has been ascertained by Cimperman et al. [7]. In this study the investigators analyzed the significant factors responsible for acceptance of telehealth for older adults. The denouement of which provided seven predictors: effort expectancy, perceived usefulness, social influence, computer anxiety, perceived security, physicians’ opinions, and facilitating conditions. Telemedicine implementation is extremely important for older adults given the presence of chronic diseases and the rise in occurrence of dementia and diabetes. Owing to this aforementioned reason successful implementation of telemedicine is pivotal for providing healthcare to older adults.
Wootton and Bonnardot [9] analyzed the use of telemedicine usage in countries with lower income levels. The scenario of such telemedicine usage was described as a “low-resource setting.” Interestingly this study also analyzed education level which is another important factor applicable to the use of telemedicine considered in this article. To increase the acceptability of telemedicine usage the investigators pointed out that the education programs were pivotal in improving acceptance of telemedicine. Additionally, George, Hamilton, and Baker [10] analyzed the use of telemedicine among low level African Americans and Latinos. Some of the perceived factors included: confidentiality, privacy, and physical absence. In this study the investigators clearly pointed out that socio-economic conditions can be pivotal in the acceptance of telemedicine among its users. Based on the aforementioned arguments we can conclude that age, income, and education levels can be important factors in the acceptance of telemedicine.
In one recent study, Canada deployed teleoncology modalities as a feasible option for delivering care to hundreds of small, rural communities spread throughout its northern regions. This project began with simple videoconferencing used during appointments and later transformed into teleoncology consultations, follow-ups, and diagnostic evaluations [4, 6]. As of late, imaging and chemotherapy are being made available at local, regional centers, allowing patients to receive care at centers much closer to their home. Such realities can save patients significant money through decreasing travel costs [4, 6]. A similar study was conducted in rural Iowa at Visiting Consultant Clinics (VCCs) [6]. VCCs scheduled specialists and oncologists to visit outreach sites to assist in providing diagnostic or treatment services to cancer patients [6]. Nearly half of all Iowa-based oncologists practiced in the VCC rural community, increasing access to necessary care for cancer patients [8].
Other studies have assessed the perceived satisfaction rates of patient or provider telemedicine usage. Most literature suggests that physicians and patients alike report satisfaction in using teleoncology [7, 8, 9]. In the state of Kansas, a study found that all patients receiving care via telemedicine interactive video in a specialty oncology/hematology clinic reported high satisfaction with their care. Participants felt their access to specialty services was improved through telemedicine [10].
Although much of the literature on telemedicine, specifically teleoncology, addresses appropriate models of teleoncology and satisfaction rates with these models, few studies have addressed patient favorability rates, or intention of use. This study will address patient positive and negative favorability rates related to teleoncology utilization.
Dewar et al. [11] analyzed the motivation to engage with telehealth technology using t-tests by including the parameter of device use in their analysis. The idea of device use correlates to the notion of usability when it comes to telehealth and mHealth applications as described by Gurupur and Wan [12]. It has been commonly noticed that improvement in usability can be one of the deciding factors of telemedicine usage especially for especially for individuals above 50 years and older. With that in mind the investigators have taken into consideration the use of Theory of Planned Behaviour to this study. The application of this framework to analyze the specific research questions implies the fact that the analysis carried out here is different from the previous experiment [13] on the same dataset.
Gagnon, et al., [14] illustrated the use of the use of interpersonal behavior to analyze the adoption of telemedicine among physicians. In this particular study conducted in the state of Quebec, Canada the investigators identified the fact that physicians who had a perception of professional and social responsibilities towards the adoption of telemedicine had a stronger positive intention towards its adoption. Additionally, the investigators also found self-identity to be have a negative effect towards the intention of this adoption. These benchmark findings have led the investigators of the study delineated in this article to adopt Theory of Planned Behavior; although, in this study the investigators are not involved in analyzing the physicians.
Another interesting aspect of this study is that Artificial Neural Networks have been rarely used in analyzing acceptability of telemedicine and for general behavioral science studies. This article presents an interesting analysis of the usage of Artificial Neural Networks in analyzing the acceptability of telemedicine usage.
Methods and materials
Theoretical frameworks
As a guiding framework for this study, the authors have used the Theory of Planned Behavior [13] as well as the FITT framework. The key use of the Theory of Planned Behavior is that it predicts and explains behavior in specific contexts, or in this case, intention towards telemedicine favorability. Individual attitudes and norms will influence one’s intention and thus, ultimately, influence one’s behavior. In essence, individuals with positive attitudes toward telemedicine usage will likely have positive intention towards utilization. This intention then leads to the behavior: actually engaging in usage of telemedicine. Figure 1 displays the sequential components of the theory as they work together to influence one’s behavior.
Integration of Theory of Planned Behavior and FITT framework.
On the other hand, the FITT framework – or the fit between individual, task, and technology, is commonly applied to health information evaluation [15, 16]. The framework asserts that the adoption of health-related information technology tools is dependent upon the fit between attributes of the users (e.g. motivation), the attributes of technology (e.g usability and functionality), and the attributes of the “tasks” or clinical processes (e.g. task complexity) [15]. Figure 2 displays the three domains in the FITT framework, as adapted by [15]. This study will apply the FITT framework and analyze the results based on each model domain: individual, task and technology.
This study looks at the favorability rates (positive and negative favorability) of patients using telemedicine in the treatment for cancer, specifically patients from both rural and urban regions of Northern Louisiana. Favorability rate is defined as a patient’s attitude towards the usage of telemedicine. Patients’ attitudes towards telemedicine can range from favorable to not favorable. As mentioned before, prior studies have focused on the prevalence and usage of telemedicine in oncology, types of telemedicine and barriers in the use of teleoncology [7, 8, 9, 10, 17]. Few studies have studied patients’ favorability in the acceptance and likelihood of using telemedicine as an alternative to the traditional face-to-face patient-doctor office visit for oncology care. This study looks to fill this gap in the literature on telemedicine and patients’ favorability for teleoncology and will focus on how patients’ gender, age, income level, and education level impact patients’ perceived favorability in using teleoncology. This exploratory study aims to answer the following research questions:
Sample demographic characteristics [16]
Sample demographic characteristics [16]
Note. Since not all participants elected to answer all demographic questions few variables total less.
Algorithm used for artificial neural network analysis.
RQ1. How much influence does age have on the favorability rate of patients using teleoncology for their cancer care? RQ2. How much influence does income level have on the favorability rate of patients using teleoncology for their cancer care? RQ3. How much influence does education level have on the favorability rate of patients using teleoncology for their cancer care?
Structure of the Artificial Neural Network used for experimentation.
In addition to the above data specific questions the investigators have also considered analyzing the aforementioned research questions using a neural network for the purpose of analyzing the results between Chi-Square analysis and Artificial Neural Networks.
This is an exploratory, cross-sectional study designed to look at the favorability rates of patients using teleoncology [19, 20]. The survey instrument used for this study was adapted from Gurupur et al. [3]. Using a 5-point Likert scale, patients were asked to rate their perception of their favorability in using telemedicine.
There were a total of 147 responses from a sample of cancer patients from oncology clinics located in both rural and urban Louisiana, nearby the city of Shreveport, Louisiana. The convenience sample of patients was selected from within clinics in the region who had not used telemedicine yet, and volunteered to participate in the survey. The demographics show that the survey sample is a good representative sample of the Louisiana population (Table 1) as compared to Louisiana demographics as per US Census data (
Applied measurement
Our study looked at the favorability rate of patients using telemedicine and whether gender, age, income level and education level influenced the favorability rate of patients using telemedicine, specifically for patients suffering from cancer. Appendix A provides the survey instrument used in the study. If a patient answered “agree” or “strongly agree” on the positive favorability rate questions and “strongly disagree” and “disagree” on the negative favorability rate questions, this indicated that the patients were favorable towards using telemedicine.
Independent variables were recoded to represent dichotomous or trichotomous categories. Gender was already dichotomized. Age was recoded into 3 categories: under 40 years of age; 40–65 years of age; and over 66 years of age. Education level was recoded into 4 categories: less than or some high school; high school or vocational school graduate; some college; and a completed degree or higher. Lastly, income was recoded into 3 categories based on low, medium, and high annual household incomes: low income represented under $35,000; medium represented $35,000–$74,999; and high represented $75,000 or higher.
The respondent’s favorability rate toward telehealth utilization was the dependent variable for this study. To determine this rate, each respondent’s overall survey score was summed, using the formula shown below.
Respondent favorability
The respondent’s Likert scale responses to each survey question was computed (i.e. a strongly agree response was worth 5 points whereas a strongly disagree response was worth 1 point). A total score of 45 was the highest possible survey score (i.e. 9 survey questions
From the survey, the positive favorability rate indicators include perceived benefits, which includes concepts such as the savings in travel cost and reduced wait times, perceived motivation which includes improved clinical feedback and quicker response time, perceived compatibility and advantage which includes increased accessibility and improved access to more specialists. The negative favorability rate indicators include perceived anxiety, which includes lack of comprehension and hindrance in communication, and perceived complexity, which includes the complexity in the telemedicine technology. Table 2 highlights positive and negative favor rate factors.
Definition of favourability rate
The survey instrument had a Cronbach’s alpha coefficient of 0.84 (alpha
The responses were coded (and reverse scale coding for negatively worded questions) prior to statistical analysis testing. Both descriptive and inferential statistical analyses were performed using IBM SPSS 22. The research questions were analyzed based on models developed to measure patient telemedicine utilization favorability. We performed univariate analyses on each of the response variables to obtain descriptive statistics, central tendency and the pattern of responses.
Chi-Square test of associations was conducted to determine if there was an association between the independent variables (gender, age, income level, or education level) and the dependent variable (favorability rate for telehealth utilization). For this statistical analysis, statistical assumptions were met. These assumptions included variables that were categorical in nature with each category representing two or more independent groups.
The dataset consists 147 responses of which 117 were used for training the neural network and remaining 30 were used for testing since neural networks require a training data set. Here the investigators have used 80% of the dataset (93 participants) of the participants are used for training the Artificial Neural Network and the remaining 20% (24 participants) were used for validation. Four independent variables (answers to question Q1 through Q4) were used for analysis. The dependent variable used here is S4 (Counting the income of everyone in your household, which category best represents your annual household income?). A new output variable is defined such that if the value of S4 is greater than 4 (which indicates the annual household income is greater than $34,999) then it is assigned value “1” else if S4 is less than or equal to 4 (which indicates the annual household income is less than or equal to $34,999) it assigned value “0”.
This Artificial Neural Network takes the aforementioned 4 independent variables as inputs. These inputs are given to the hidden layer consisting of 3 nodes as illustrated in Fig. 2. Rectified linear unit is used as the activation function at the input and hidden layer. The output of the hidden layer is given to the output node which is the dependent variable. Sigmoid activation function is used at the output layer. The Artificial Neural Network is compiled using adman optimizer involving the calculation of cross binary entropy and 100 epochs. The accuracy is predicted by considering the threshold value as 50%.
Results
Chi-Square analysis
Unlike the previous experiment delineated in Gurupur et al. [3], the researchers used Chi-Square analysis for analyzing the acceptability of telemedicine usage. The Chi-Square test of association between age and favorability rate, gender and favorability rate, and income level and favorability rate all showed no statistical significance. This indicates that these variables had no bearing- either positive or negative- on one’s attitude toward using telemedicine in oncology care. However, education level and favorability rate proved to be statistically significant at 0.020, thus indicating an association between the two variables. Table 3 above indicates the statistical findings for testing the association between education level and favorability. As it relates to education, it is worth noting that of those who perceived telemedicine use with disfavor, seventy percent had only some high school or a high school diploma completed. As individuals pursued and completed high levels of education, their favorability rate towards telemedicine usage increased, to either average or high favorability. Table 4, above, illustrates the cross tabulation of respondent’s education level and perceived favorability rates: negative, average, or high. Of individuals with a negative favorability (
Test of association between education and favorability
Test of association between education and favorability
Cross tabulation of education level and telemedicine usage favorability
Overall, most survey respondents had average or high favorability perception toward telemedicine usage. Sixty-eight percent of survey respondents had a high favorability rate towards telemedicine (
Confusion matrix for all the three hypothesis.
While the research question 4 was sufficiently answered by the Chi-Square analysis it was not able to identify a significant correlation for questions RQ1, RQ2, and RQ3. Therefore, we attempt to apply Artificial Neural Networks to extract some answer to 3 by identifying relationships between annual household income and favorability of telemedicine use. The hypothesis and their obtained results are as follows (Fig. 4):
Hypothesis 1: If the value of annual household income is greater than $34,999 then the output variable is assigned value “1” else if annual household income is less than or equal to $34,999 it assigned value “0”. The details of the confusion matrix is as follows: a) True Negative (TN) value
Hypothesis 2: If the education level is greater than 3 the output variable is assigned value “1” else if it is less than or equal to 3 then it is assigned “0”, 3 indicates high school education. The details of the confusion matrix is as follows: a) True Negative (TN) value
Hypothesis 3: If age is greater than or equal to 66 the output variable is assigned value “1” else if the age is less than 66 it is assigned “0”. The details of the confusion matrix is as follows: a) True Negative (TN) value
Discussion
Our study assessed telemedicine favorability rates for patients receiving oncology care. As the field of teleoncology continues to grow [21, 22, 23], it is important to understand patients’ perceptions on utilization and assess various favorability factors towards this usage.
Revisiting the study’s research questions, it was determined that variables such as gender, age, and income level are not associated with one’s perception towards telemedicine usage. Which provides a negative result for research questions RQ1, RQ2, and RQ3. Based on the Chi – Square analysis described so far education was the statistically significant factor that lead to a positive perception towards the use of telemedicine.
Education level has a statistically significant relationship towards association with telemedicine favorability. In assessing those with negative favorability views towards telemedicine usage, the majority of respondents who were unlikely to use the technology did not have a high school diploma. As such, it is important to consider telemedicine systems that are easy to use and understand by patients of all educational backgrounds. It is also necessary to apply efforts to educate all patients, regardless of education status, on proper use, function and benefit.
The study’s theoretical framework – both the Theory of Planned Behavior and the FITT model – support the study results. As the Theory of Planned Behavior predicts, those with positive intentions (or high favorability perceptions) toward telemedicine usage will likely behave as such and utilize the technology. In this study, over half of respondents (68%) had a positive favorability reception (or intention) towards telemedicine. This holds positive implication for telemedicine innovation to serve as a suitable alternative to face to face care delivery. Because intention leads to behavior [13, 17], those study participants with high favorability (i.e. intention), will likely utilize telemedicine (i.e. behavior).
Technology adoption and use is dependent upon a number of variables: the user, the task and the technology at hand. The FITT framework [15]captures this construct and assesses utilization based on these overlapping factors. As the study results conclude, those who view telemedicine utilization with an unfavorable attitude are users primarily without a high school diploma, or those with only a high school/vocational school diploma. This particular user reveals a disconnect with the technology (i.e. usability and functionality) and task (complexity) which leads to unfavorable perception of use [3, 17].
It is necessary to reduce barriers to teleoncology utilization, such as fear, lack or education or lack of understanding, so that patients and providers, alike, can successfully adopt and utilize telemedicine tools. Exploring the reasons why individuals perceive negative favor towards telemedicine usage will be key in eliminating barriers of use. As it relates to education, patients should receive proper guidance and training concerning the use of telemedicine tools; ease of use should also be communicated to patients to alleviate their concerns and increase positive favorability. Future research opportunities, as suggested by the researchers, include expanding the sample size in an effort to analyze the variables once more, with a larger, more generalizable population.
It is important to note that Artificial Neural Networks displayed a higher level of accuracy when compared to Chi-Square analysis for the dataset used for the study. This analysis allowed us to predict the threshold identifiers as well. The analysis delineated here may form the basis for further exploration in experiments where traditional methods used in behavioral science may not sufficiently answer questions that may be answered by Artificial Neural Networks.
Limitations
There are several limitations of this study. First, the Cronbach’s Alpha for the negative readiness factor questions was 0.476 (alpha
Second, although the sample of respondents are representative of the population of Louisiana, the small sample size is a limitation of the study, and thus, the study results are not very robust. The study sample proved homogeneous and instead, a more heterogeneous sample should be considered. Further, the demographic of populations within the 50 states is very different, thus the results from this study may not be generalizable to other states in the United States.
Third, with respect to usage of neural networks the amount data used for the analysis was relatively smaller proportion when compared to traditional neural network analysis that consumes large amount of data to provide accurate results. Also, the analysis would have improved by modifying the program using category variables.
Lastly, self-reported answer may contain bias if respondents feel that they should answer the survey questions as to how they think the researchers would want them to answer. Nevertheless, the limitations of this study do not de-tract from the significance of the findings from this study.
Conclusion
The results from this study will provide policy makers, clinicians and health care systems with information as to the favorability of telemedicine utilization. Telemedicine offers an alternative method in which to deliver care that can be more accessible and affordable to patients. As the United States struggles with access and cost issues within our health care system, it would be prudent to look towards telemedicine as another method to deliver health care services. Those individuals who are not yet ready to accept telemedicine as a means in delivering health care services, policy makers, clinicians and administrators, alike, may want to boost educational campaigns to increase these patients’ knowledgebase and understanding of the benefits of using telemedicine.
Future research opportunities include measuring patient favorability for telemedicine based on their specific disease/condition, health care outcomes, or for basic primary care needs. The decision to utilize telemedicine is impacted by many factors. With the rapid advancement of healthcare technology, telemedicine will be incorporated in the health care field in many different capacities. Thus, it is important to understand patient favorability to the use of telemedicine.
Footnotes
Acknowledgments
The authors would like to express thanks and appreciation to Dr. Thomas Wan. Without his guidance and mentorship, this study would not have been possible.
Conflict of interest
The authors declare that there is no conflict of interest.
