Abstract
Introduction:
Broad expansion of telehealth technologies has been implemented during the coronavirus disease 2019 (COVID-19) pandemic to allow for physical distancing and limitation of viral transmission within health care facilities. Although telehealth has been studied for its impact on patients, payors, and practitioners, its educational impact is largely unstudied. To better understand the trainee experience and perception of telehealth during the COVID-19 pandemic, we conducted a survey of the membership of the American College of Surgeons Resident and Associate Society (RAS).
Methods:
An anonymous survey was sent to members of RAS. Descriptive analysis was used to report experiences and perceptions. Chi-square analysis was used to compare cohorts with and without exposure to telehealth.
Results:
Of the 465 RAS respondents, 292 (62.8%) reported knowledge of telehealth technologies at their institutions. The majority of these respondents experienced a decrease in in-person clinic volume (94.4%) and an associated increase in virtual clinic volume (95.7%) related to the COVID-19 pandemic. Trainee integration into telehealth workflows increased drastically from prepandemic levels (11% vs. 54.5%, p < 0.001). Likelihood of trainee exposure to telehealth was associated with university-based training programs or larger program size. Trainees demonstrated a desire for more integration and development of curricula.
Conclusions:
These data serve as the first description of surgical trainee experience with, and opinion of, telehealth. Trainees recognize the importance of their integration and training in telehealth. These results should be used to guide the development of workflows and curricula that integrate trainees into telemedicine clinics.
Introduction
The use of telemedicine within surgical clinics had been steadily growing before 2019, 1 being safe in both pre- and postoperative settings. 2 Broad adoption of telehealth has been limited by the perceived barriers of untrained staff, institutional/provider resistance to change, implementation costs, reimbursement, and patient-level considerations such as age and level of education. 3,4 The novel coronavirus disease 2019 (COVID-19) pandemic effectively forced providers and institutions to rapidly expand administration of telehealth services in the setting of social distancing and widespread public health measures to mitigate intrahospital disease spread. Relaxation of regulations and payment policies by the Department of Health and Human Services, Office for Civil Rights, and the Centers for Medicare & Medicaid Services allowed for needed economic viability. 5 As practitioners and patients experience the benefits of digital encounters, it is expected that a significant portion of care will continue to be provided through telehealth after the pandemic. 6
Study of the impact of telehealth on surgical ambulatory care has focused on various stakeholders (providers, systems, payors, and patients), with educational impact on trainees being largely absent from surgical literature. Prior work has demonstrated that teleconferencing can be an effective means to connect multiple hospitals worldwide and exposes trainees to rare and unusual cases. 7 Telementoring programs allow for experts to guide less experienced surgeons intraoperatively from remote locations, bypassing geographic and financial constraints of meeting at a common location. 8 Although these strategies leverage the use of telecommunication technologies for didactics, they do not investigate the involvement of trainees in the delivery of ambulatory care through telehealth. Due to an anticipated continued expansion of telemedicine services in the aftermath of the COVID-19 pandemic, studies evaluating the trainee telehealth experience are essential.
We sought to assess the current state of trainee experience and perception of telemedicine across the United States through a survey of the American College of Surgeons (ACS) Resident and Associate Society (RAS) and its COVID-19 Resident Task Force, with the aim of identifying deficiencies in effective trainee integration into telemedicine workflows and guiding future progress.
Materials and Methods
The RAS and the ACS Young Fellows Association (YFA) created a COVID-19 Resident Task Force in May 2020 to evaluate the effects of the pandemic on members of RAS. Task force members developed and disseminated a survey centered on resident and early career surgeons' experiences within the following areas: clinical, educational, financial, and personal, the results of which have previously been published by Coleman et al. 9 A fifth section to the survey was included (V.C.N.) to allow for further evaluation of resident experiences in telehealth. The survey was sent through SurveyMonkey® (San Mateo, CA) during July 2020 to the e-mail listservs for RAS and YFA. The survey was administered over a 2-week period. Following the initial dissemination of the survey, two reminders were sent to those who did not respond. Recipients were informed that their response constituted their consent to the study and that individual responses could not be linked back to respondents or their programs.
Initially, respondents were asked whether a telehealth option existed within their institution. An answer of yes brought the respondent to the remainder of the telehealth survey. An answer of no or not sure ended the telehealth portion of the survey. This portion of the survey focused on two attributes: (1) experience with telehealth and (2) opinions on telehealth initiatives. The demographic and telemedicine components of the survey are included in Appendix A1. Descriptive statistics were tabulated for the RAS cohort data and reported as numbers and percentages. Agreement with telehealth initiatives was assessed with the Likert scale and demonstrated in tabular form. Chi-squared testing was used to evaluate differences in responses by respondent demographics. All data were analyzed using SPSS, version 27 (IBM Corp., Armonk, NY). The study protocol was independently reviewed and approved by the Oregon Health & Science University and American Research Institutes Institutional Review Boards.
Results
Survey Respondent Demographics
Of the 465 RAS respondents, 292 (62.8%) reported knowledge of telehealth technologies at their institutions and were asked further questions about their experiences with telemedicine. There was an approximately equal gender distribution (49.8%); most were between 26 and 35 years of age (89.8%) and identified as Caucasian (66.1%, Table 1). Respondents were from training programs in the Northeastern (34.9%), Midwestern (22.9%), Southern (22.9%), and Western (14.4%) regions of the United States. A small proportion of respondents (4.8%) were noted to be from non-U.S. training programs.
Demographics of 292 Trainee Respondents
PGY, post-graduate year.
Individuals with knowledge of institutional telehealth options (n = 292) were not significantly different from those without (n = 173) in respect to age group, gender, race, sexual orientation, or residency geographic region within the United States (p > 0.1 for all). Respondents in university-affiliated programs were more likely to report telehealth options (66.3%, n = 250) compared with respondents in nonuniversity-affiliated programs (46.7%, n = 35; p = 0.02). Respondents were more likely to report available telemedicine options with larger residency sizes: 80.8% (n = 42) for programs with >8 graduating chiefs, 69.6% (n = 126) for programs with 6–8 graduating chiefs, 55.9% (n = 90) for programs with 4–5 graduating chiefs, and 47.9% (n = 34) for programs with three or fewer graduating chiefs (p < 0.001). The respondent post-graduate year (PGY) level was not associated with reported telemedicine options, except at the PGY-1 level (23.5%, n = 4) compared with other respondents (62.8%, n = 282; p = 0.004).
Trainee Experience With Telemedicine
The majority of respondents stated that the in-person clinic volume decreased (94.4%) and video visit volume increased (95.7%) during the pandemic (Table 2). Although 40.3% of respondents reported that video visit/telemedicine programs were established at their programs before the COVID-19 pandemic, only 11% of respondents reported being involved in video visit/telemedicine evaluations in the prepandemic period. In contrast, 54.5% of respondents reported having trainees (e.g., medical students, residents, and fellows) involved in video visit encounters in the middle of the COVID-19 pandemic (p < 0.001). Trainee treatment plans were typically evaluated through synchronous staffing with faculty (77%). The majority of respondents reported providing care during encounters with new patients, established patients, and postoperative patients, demonstrating trainee involvement in all phases of ambulatory care.
Video Visit Experience of 292 Trainees
Respondents were able to select all answers that applied.
COVID-19, coronavirus disease 2019.
A higher proportion of respondents in the northeastern United States reported reduced clinic duty hours (40.2%, n = 41; p = 0.01) due to COVID-19 compared with the rest of the country. Similarly, a higher proportion of PGY-5 residents reported reduced clinic duty hours (43.6%, n = 41) due to COVID-19 compared with other PGYs (p = 0.02), while respondent age groups did not significantly differ (p > 0.1 for all comparisons). No other significant associations between perception of COVID-19's impact on clinic duty hours and gender, race, sexual orientation, relationship status, residency academic affiliation, or class size were noted (p > 0.1 for all comparisons).
Trainee Perceptions Of Telemedicine
Overall, the majority of residents (75.9%) believed that residents should be involved in telemedicine and video visit encounters (Table 3). This belief was not significantly different by age group, sex, race, sexual orientation, relationship status, residency region, institution type, class size, or PGY (p > 0.1 for all). Notably, trainees reporting institutional implementation of telemedicine before the COVID-19 pandemic were more likely to believe that residents should be involved in telemedicine and video visit encounters (83.6% vs. 72.6%; p = 0.04). The majority of trainees agreed that virtual visit encounters should be simple to complete (51%), programs should develop dedicated telemedicine curricula (62%), optimization should involve trainee integration (60%), and trainees would benefit from being involved in telemedicine/virtual visit encounters (59%). Females were more likely than males to agree that a curriculum for virtual visits and telehealth should be established for trainees (62.8% vs. 52.1%; p = 0.03) and that virtual visit workflow optimization should be integrated into the trainee experience (62.1% vs. 50%; p = 0.048). No other significant associations between trainee perceptions of telemedicine and age group, gender, race, sexual orientation, relationship status, residency geographic region, residency academic affiliation, class size, or PGY were noted (p > 0.1 for all comparisons).
Trainee Perception of Video Visit Experience
Discussion
Our survey results demonstrate an increase in surgical trainee integration at all levels into digital health workflows during the COVID-19 pandemic. The majority of respondents believed that trainees should be included in and trained to conduct telemedicine-based patient encounters. Interestingly, there were gender-specific differences in perception of telehealth, with females more likely to support formal training curricula for telehealth encounters and optimization of workflows to integrate trainees. The reason for this difference is not immediately clear. Although provider race has been reported to affect patient satisfaction with telehealth encounters, we found no impact of trainee race or ethnicity on their experience with telehealth. 10 A significant proportion of residents felt their clinic work hours were negatively impacted by the COVID-19 pandemic. As care transitions to virtual platforms, it is worrying that residents from smaller and nonuniversity-affiliated programs were less likely to report telemedicine options at their institutions. Similarly, it has been shown that these institutions were less likely to adopt telemedicine technologies, highlighting a disparity in telemedicine education and experience for surgical trainees. 11 It remains to be seen whether potential educational deficiencies in administering outpatient care will impact future graduating classes' ability to administer care and is a topic for future study.
Our respondents indicated reduced in-person clinic volume and increased telehealth clinic volume during the COVID-19 pandemic. Both the Accreditation Council for Graduate Medical Education and American Board of Surgery require surgical trainees to be involved in preoperative and postoperative patient care. 12,13 As ambulatory care becomes digital, the American Medical Association has recently highlighted the need for medical students and residents to be integrated into telemedicine workflows. 14 Integration strategies have yet to be explored and evaluated, but our study identified that the majority of residents were involved in synchronous evaluations of patients. Synchrony in telemedicine implies that the patient encounter, medical decision-making, and trainee evaluation are all performed in real time, much like a traditional clinic visit. 15 Two evaluation strategies have been proposed by groups from the University of Michigan. Iancu et al. demonstrate a workflow that mirrors that of a traditional clinic. 16 The trainee begins with evaluating a patient and presenting their plan to the supervising faculty. Trainee and faculty return to the patient's virtual room where the trainee observes the patient–faculty interaction, and the plan is finalized. In contrast, Strong et al. developed a strategy that has increased latency between the first and second patient encounters, allowing for a large group of patients to be reviewed before a second patient–faculty meeting. 17 In both these workflows, faculty and trainees could be in different physical locations, allowing for the use of telecommunication technologies for monitoring patients and supervising trainees. Further work is required to identify the most effective strategies for integrating surgical trainees into telemedicine clinics.
Formalized telemedicine curricula exist, but primarily these come from nonsurgical training programs and medical schools. 18 One neurology residency program implemented formalized digital health training through lectures and a 2-week telehealth rotation, demonstrating improved knowledge of telehealth technologies and an increased belief that telemedicine provided care at least equal to traditional inpatient visits. After the curriculum, 90.9% of residents believed that telehealth would reduce caregiver burden, as opposed to 54.6% before. 19 A similar elective was designed for medical students matched to general surgery internships to teach best practices regarding conducting telehealth visits. 20 Participants reported high satisfaction and greater comfort with video visits. Even in programs with established telehealth curricula, there is room for improvement. In the teledermatology clinic, trainees and faculty agree on diagnosis and treatment plan in 53% and 65% of cases, respectively. Concordance for referral to an in-person clinic was 93%. 21 Inability to perform typical examinations (e.g., dermatoscopic examination) was cited as a reason for trainee difficulty with the telemedicine assessment, highlighting the need for training in this modality. Studies of this nature demonstrate the need of formalized programs to optimize our telemedicine skill set and more effectively manage patients.
Surgical trainees strongly believe that involvement in telehealth will be beneficial to their training. This study is the first to assess trainee opinions of providing care through telehealth platforms. In nonsurgical literature, multiple studies from the Veterans Affairs health system have explored the educational value of teledermatology consults for residents and medical students. Telemedicine has allowed faster accumulation of a variety of high-yield cases in a teledermatology clinic. 22 Medical students have reported increased engagement and satisfaction in the process. 23 Once telehealth platforms become better established, specialized clinics or potential training programs could host outside trainees. These virtual rotations would benefit both the host institution and the trainee as knowledge and experience can be exchanged without the geographic and temporal constraints of busy residency programs through the use of telecommunication technologies.
We found that in our sample although the majority of trainees (76%) believe that residents should be involved in video visits, a large portion (24%) disagreed. We posit that the disagreement comes from subpar experiences with telehealth for these trainees. Our survey was distributed during July 2020 as in-person ambulatory care was being transitioned to telehealth platforms at many institutions. At this time, many faculty members were using telehealth for the first time. Telehealth clinic workflows were being constructed on the fly through a patchwork of infrastructure demonstrated by the many different platforms used by our respondents (Table 2). Reported provider satisfaction with telehealth evaluations at this time was also scattered, with providers reporting difficulty in breaking bad news or performing physical examinations. 24 We believe that improving the efficacy of telehealth encounters with staff training will improve its overall utility and perception with patients and providers. Likewise, trainees who first experienced telehealth as an emergency measure during the COVID-19 pandemic may be less likely to appreciate its value in postpandemic ambulatory care or within their own careers.
Our study has certain limitations due to the structure of the survey and the timing of its administration. The COVID-19 pandemic has continued to affect the United States and the rest of the world. Our survey was distributed in July 2020 when certain areas of the United States did not begin to see a spike in cases. Regions where cases were still low may not have had the same shift of in-person clinic visits to video visits. We are encouraged by the heterogeneity of our respondents and believe we captured a representative cross-section of the overall RAS membership. Inherent in this design, our survey results are subject to recall bias and did not capture the opinions of those trainees without telehealth platforms at their institutions. Finally, this survey was focused on trainees and their interactions with telehealth. Although we believe it is important to recognize the contribution of trainees to the future of telehealth, we recognize that health care has many stakeholders. The success of telehealth is dependent on its acceptance by health care institutions, payors, practitioners, and, most importantly, patients.
Conclusions
As the COVID-19 pandemic continues and institutions expand their telemedicine infrastructure, our survey serves as the first description of trainee experience and opinion of this new modality. Trainees recognize its importance and their need to be involved. We suggest that these results be used to support the development of organized workflows and curricula for trainee integration into telehealth.
Footnotes
Acknowledgments
The authors would like to thank the ACS for their support in disseminating this survey to its membership. The authors would also like to thank the RAC-ACS COVID-19 Task Force in its entirety: Heather Carmichael, MD, Navin G. Vigneshwar, MD, Randi Ryan, MD, Qiong Qiu, MD, Apoorve Nayyar, MD, Michael R. Visenio, MD, Cheyenne C. Sonntag, MD, Pranit Chotai, MD, Vahagn C. Nikolian, MD, Joana Ochoa, MD, and Patricia Turner, MD, FACS.
Disclosure Statement
No competing financial interests exist.
Funding Information
No funding was received for this study.
