Impacts on Surgery Resident Education at a First Wave COVID-19 Epicenter

Clinical experience

Clinical experience was assessed in 2 ways: first, we examined the duty hours logged for clinical work and number of outpatient clinics attended, and second, through several anonymous survey questions, completed by 91% of surgical residents. Surgical residents worked an average of 64.7 hours/week before the COVID-19 pandemic, and 40.8 hours/week during the pandemic, a 37.0% decrease (Table 1). A significant portion of the clinical experience for surgical residents was redirected to caring for COVID-19 patients during the pandemic. In the survey, residents reported working between 28 and 38 (SD = 26.7) hours/week caring for COVID-19 patients (Table 1). In regards to outpatient clinics, in 2019 for the period of interest residents averaged 4.7 clinics, while in 2020 this decreased by 70.2% to 1.4 clinics per resident.

OPEN IN VIEWER

Table 1.

Clinical experience.

Part A: Quantitative data
	Before pandemic	During pandemic	Difference	% change	P-value
Weekly hours of logged clinical work per resident	64.7	40.8	23.9	−37.0	.002
Weekly hours carrying for COVID patients*	0 (0)	28.6-38.6 (26.7)	+28.6-38.6 (26.7)	NA
Number of outpatient clinics attended per resident	4.7	1.4	−3.3	−70.2	.04
Part B: Qualitative data
			Agree (%)	Disagree (%)
Concerned about preparedness to become an attending			7 (35)	7 (35)
Concerned about completing graduation requirements			3 (15)	15 (75)
Concerned about requiring an extra year of training			0 (0)	19 (95)
My experience and education has been positively impacted by the pandemic			7 (35)	4 (20)
I am attending the same amount of outpatient clinic			1 (5)	19 (95)

*

The variable was acquired from the survey.

Educational experience

An average of 5.9 hours/week were spent on organized didactics before COVID-19 (Table 2, Supplemental Table 1). This included 3 hours of protected time for resident education based on the SCORE curriculum, morbidity and mortality conference, grand rounds, specialty attending conferences, and trauma review conference. During the pandemic, all conferences were done remotely through teleconferencing, and the average time spent on organized didactics was 3.8 hours/week—a reduction of 35.6% (Table 2). Residents were split on whether the quality of didactics improved, with 35% reporting an improvement, and 35% perceiving a decrease in quality. Despite a significant drop in clinical work of 22.1 hours per week, residents reported an increase in independent studying of only 1.6 hours per week: from 6.1 to 7.7 hours per week (Table 2).

OPEN IN VIEWER

Table 2.

Educational experience.

Part A: Quantitative data
	Before pandemic	During pandemic	Difference	%	P value
Weekly hours of didactics	5.9	3.8	2.1	−35.6	<.01
Weekly hours studying individually*	6.1 (3.1)	7.7 (4.7)	+1.6 (4.7)	+26.2	.07
Part B: Qualitative data
			Agree (%)	Disagree (%)
The quality of didactics increased during the pandemic			7 (35)	7 (35)
Concerned about preparedness to become an attending			7 (35)	7 (35)
Concerned about completing graduation requirements			3 (15)	15 (75)
Concerned about requiring an extra year of training			0 (0)	19 (95)
My surgical knowledge has been negatively affected by the pandemic			7 (35)	8 (40)
My experience and education has been positively impacted by the pandemic			7 (35)	4 (20)

*

The variable was acquired from the survey.

Operative experience

From March 3rd to May 25th, 2019, residents at Danbury Hospital logged 600 operative cases. For the same period during the COVID-19 pandemic, residents logged 240 cases, a 60% decrease (Table 3). Since the number of residents in each post-graduate year (PGY) position varied from 2019 to 2020 we calculated number of cases per resident. On average there were 35 cases per resident before the pandemic, which decreased by 65.7% to 12.0 cases per resident during the pandemic (Table 3, Supplemental Table 1). Junior residents in PGY1, 2, and 3 positions were disproportionally affected during the pandemic, with a 76.2% decrease from 25.2 to 6.0 cases per resident for the study period. Senior residents in PGY4 and PGY5 positions saw a 49.7% decreased in operative cases, from 59.6 to 30.0 cases per resident. Overall, 70% of residents felt their surgical skills have been negatively affected by the pandemic.

OPEN IN VIEWER

Table 3.

Operative experience.

Part A: Quantitative data
	Before pandemic	During pandemic	Difference	% change	P value
Total major cases	600	240	360	−60
Average major cases per resident	35.0	12.0	23.0	−65.7	.002
°Senior residents (PGY 4/5)	59.6	30.0	29.6	−49.7	.04
°Junior residents (PGY 1,2,3)	25.2	6.0	19.2	−76.2	.008
Part B: Qualitative data
	Agree (%)			Disagree (%)
I feel my surgical skills have been negatively affected by the pandemic	14 (70)			3 (15)

Clinical experience

This restructuring of the program is similar to that reported by institutions in other highly affected areas. ⁷ Unlike this study, prior literature did not address the effect of this restructuring on resident training, but discussed their experience and offered recommendations on how to safely and effectively prepare hospitals and programs.^8,9 In this study, we demonstrate that surgical residents had a significant contribution to the overall COVID-19 response at Danbury Hospital, with an average resident spending 28 to 38 hours per week caring for critical COVID-19 patients (Table 1). This contribution resulted in a decrease in clinical duty hours by 35.1%, from 64.7 to 40.8 hours per week, in addition to fewer outpatient clinics attended, and less operative experience. However, surgical residents spent more time in a critical care setting, which the American Board of Surgery (ABS) identifies as a primary component of general surgery training. ¹⁰ Similarly, Meyer et al argued that surgical critical care is crucial for practicing surgeons to be able to holistically manage ill patients with life-threatening conditions. The ABS has no specific requirement for duration of ICU rotations; instead, it requires a log of 25 critically ill patients. Prior studies describe a wide variability in surgical critical care training and fund of knowledge of graduating residents.^11,12 Therefore, this sudden increase in critical care training is one of beneficial effects on surgical training. ¹⁰

One of the ways to enhance resident clinical experience to supplement the drop in clinical duties and outpatient clinic attendance was through resident involvement in telehealth clinics. ¹³ At our institution there were several barriers to this proposal, including a lack of infrastructure to transition to telehealth and the uncertainty of the timing of elective surgeries resumption. Both of these factors resulted in low volume of appointments initially; however, as telehealth became more common, incorporation of residents became more feasible. More widespread incorporation of resident involvement in telehealth clinics can potentially be an invaluable supplementation to clinical experience.

Educational experience

The COVID-19 pandemic changed surgical resident didactics, resulting in a decrease in protected time for academics. This was a surprising finding, given the implementation of video conferencing and noted reduced clinical responsibilities of residents. All conferences at our institution transitioned to video platforms, allowing presenters to share screens from remote locations and facilitating assembly of large groups in a safe manner. Other advantages of video platforms include the ability to record lectures for viewing outside of scheduled time, and increased ease in inviting leading experts and educators from prestigious academic institutions to present and discuss topics within their specialty.

Another surprising finding in our study was that despite a decrease in clinical duties by 17 hours per week, independent studying only increased by only 1.6 hours/ week. Given this significant decrease in clinical hours, we expected a larger increase in time spent studying independently. Several factors may play a role here. Given the timing of the national surgical in-training exam (ABSITE), residents may have felt less pressure to increase their time in independent study. Residents who formerly utilized independent study time to prepare for elective cases naturally would decrease time spent on this endeavor. This study was conducted during the pandemic and includes both subjective data from the survey as well as objective data from the time allotted for didactics. Further longitudinal investigation is warranted to evaluate the effect of the pandemic on ABSITE performance, board certifying exam scores and passing rate.

At our institution, attending-led, weekly mock oral exams are performed at the end of the academic year to prepare senior for their Board exams. Junior and senior residents are led through various scenarios examining their surgical management, decision-making, and ability to describe necessary operative steps. At a time when surgical volume and educational opportunities are decreasing, this method of education can be very beneficial and has been very successful at our institution.

Operative experience

Perhaps most obviously, the COVID-19 pandemic significantly impacted the operative component of surgical training (Table 3). The cancellation of all elective cases resulted in a 60% reduction in total major cases logged by residents. Although prior studies have reported on resident perception of drop in case volume through surveys, this is the first study to objectively report a significant decrease which disproportionally affected junior residents. The American Board of Surgery (ABS) decreased the number of required operative cases for graduating seniors as a direct consequence of the pandemic. ¹⁴ However, such a dramatic decrease in surgical volume will likely affect residents at all levels. In the survey, 70% of residents reported that the pandemic has negatively affected their surgical skills and 35% reported concern about preparedness to become an attending. Junior residents may be less concerned about preparedness to become an attending with several more years of training and hope that the pandemic and its effect will be short lived.

The long-term impacts of the pandemic remain to be seen; yet surgery residents still have a limited 5 years to acquire the clinical knowledge and operative experience to become surgeons. Per ABS, the requirement to qualify for board certification is 54 weeks of surgical clinical experience and 750 logged procedures in defined categories. ¹¹ Therefore, the significant drop in operative volume is concerning, as physical skill is fundamental to surgical education. One solution to supplement the growing deficit of operative experience is simulation-based training (SBT). Prior studies have demonstrated that surgical residents value the ability of SBT to expose them to new procedures, but conclusions were divided on the best ways to implement SBT within curricula. ¹⁵ Through SBT, residents can improve dexterity and speed in operative maneuvers and enhance their technical skill. ¹⁶ Resident performance can even be assessed by attendings or colleagues observing remotely through videoconferencing. This provides a unique opportunity to progress physical skills while maintaining social distancing, and additionally provides another outlet for independent study while clinical hours are reduced.

High quality surgical videos can also help compensate for diminished operative volume. Although not a tactile exercise, when viewed in a group setting with discussion driven by faculty, these sessions can supplement resident operative education. ¹³ Videos can also play a role in flipped classroom models in which pre-recorded lectures are watched prior to conferences, which enhances knowledge acquisition and enriches discussion.

Currently, there are not many tools available to assess overall resident operative competency, therefore demonstrating decrements in residents’ ability as a result of the pandemic is challenging. Several procedure-specific evaluation tools have been proposed such as the Operative Performance Rating System and similar assessments for laparoscopic skills. More universally, Gofton et al ¹⁷ proposed an assessment, the Ottawa Surgical Competency Operating Room Evaluation (O-SCORE), which assesses surgical resident technical skills for any procedure. This tool has been shown to discriminate between residents of different technical levels, regardless of their year in training, and has been validated for assessing training in operative competency. Implementation of similar curriculum should be strongly considered given the drop in operative volume to continue monitoring resident progression through training and intervene early when deficiencies are identified.

In the event of future outbreaks, hospitals and healthcare networks capable of maintaining elective operative flow should attempt to do so, as several studies have demonstrated that they do not incur significant risk of COVID-19 transmission in patients discharged home. ¹⁸ Other proposed solutions include maintaining separate “COVID-free” facilities or surgical centers for elective operations if COVID-19 hospitalizations were sufficiently managed by hospitals. This is integral not only for economic viability of the hospital but also for continuing surgical training.

The main limitation of this study was that it was limited to a single surgical residency program. Therefore, the results may not be generalizable to residents in other programs in the United States. However, as one of the earliest areas affected by COVID-19, we are able to analyze its effects in a timely fashion that may benefit other geographic areas affected similarly in the future. While residents in states with lower incidence of COVID-19 may not be as significantly impacted as residents at our institution, continued evolution of the COVID-19 pandemic and the rise of new epicenters of disease may make these results more generalizable over time. Despite the limitations, these results are integral in critically thinking about the future of surgical education. The COVID-19 pandemic will continue to affect residency programs across the country with changes to clinical work, didactics, and operative experience of surgical residents.

As physicians, our highest mandate is patient care. We have an ethical and moral responsibility to take care of COVID-19 patients, and there is a great deal to be learned from such experiences. Nonetheless, the cultivation of surgical knowledge and physical skills is integral to the development of future surgeons, and the short duration of residency education is an incomparably formative time. It is important to keep in mind that the role COVID-19 as a disease will have in the future of medical care is impossible to divine, and that regardless of the role it plays, medicine will still need the specific capabilities for which surgeons are trained.