Video-based coaching might complement general surgery education, but little is known of its applicability for otologic microsurgical teaching. Our purpose was thus to evaluate the content and resident-perceived benefit of video-based coaching for mastoidectomy education.
Methods:
In this mixed-methods pilot design, mastoidectomies were recorded from operative microscopes and reviewed during 30-minute video-based coaching sessions at 2 tertiary care centers. Eight residents and 3 attendings participated. Ten-point Likert-type questionnaires on the extent to which attendings taught 12 topics through 8 techniques were completed by residents after surgical and coaching sessions. Coaching sessions and structured interviews with residents were audio-recorded, transcribed and iteratively coded.
Results:
Seven audio-recordings were available for coaching sessions, during which a mean of 2.22 ± 0.5 topics per minute were discussed. Of the 12 teaching topics, technique was discussed most frequently (32%, 0.71 ± 0.2 topics/min), followed by anatomy (16%, 0.31 ± 0.16 topics/min). Of all 8 ratings between coaching and operative sessions, residents indicated a greater extent of discussion of anatomy (median difference, [95% confidence interval (CI)] of 3 [1-4]), progress (2.25 [95% CI, 0.5-4]), technique (3.5 [95% CI, 1.5-5.5]), pitfalls (2.5 [95% CI, 1-3.5]), and summarizing (3 [95% CI, 1-5]). In structured interviews, residents reported improved self-confidence and global perspective.
Conclusions:
Video-based coaching is educationally dense and characterized by perceived richer teaching and promotion of a deeper surgical understanding. It requires no additional resources, can be completed in a short period of time and can be implemented programmatically for any otolaryngologic subspecialty utilizing video-recording capable equipment.
ButvidasLDAndersonCIBaloghDBassonMD. Disparities between resident and attending surgeon perceptions of intraoperative teaching. Am J Surg. 2011;201(3):385-389.
3.
RoseJSWaibelBHSchenartsPJ. Disparity between resident and faculty surgeons’ perceptions of preoperative preparation, intraoperative teaching, and postoperative feedback. J Surg Educ. 2011;68(6):459-464.
4.
ClaridgeJACallandJFChandrasekharaVYoungJSSanfeyHSchirmerBD. Comparing resident measurements to attending surgeon self-perceptions of surgical educators. Am J Surg. 2003;185(4):323-327.
5.
VollmerCmJrNewmanLRHuangGIrishJHurstJHorvathK. Perspectives on intraoperative teaching: divergence and convergence between learner and teacher. J Surg Educ. 2011;68(6):485-494.
6.
ChaudhryZCampagna-VaillancourtMHuseinM, et al. Perioperative teaching and feedback: How are we doing in Canadian OTL-HNS programs?J Otolaryngol Head Neck Surg. 2019;48(1):6.
7.
PoonCStevensSMGolubJSPensakMLSamyRN. Pilot study evaluating the impact of otology surgery videos on otolaryngology resident education. Otol Neurotol. 2017;38(3):423-428.
8.
HakimiAALalehzarianASLalehzarianSPAzhdamAMNedjat-HaiemSBoodaieBD. Utility of a smartphone-enabled otoscope in the instruction of otoscopy and middle ear anatomy. Eur Arch Otorhinolaryngol. 2019;276(10):2953-2956.
9.
ZhaoYCKennedyGYukawaKPymanBO’LearyS. Improving temporal bone dissection using self-directed virtual reality simulation: results of a randomized blinded control trial. Otolaryngol Head Neck Surg. 2011;144(3):357-364.
10.
AndersenSAFoghsgaardSKongeLCayé-ThomasenPSørensenMS. The effect of self-directed virtual reality simulation on dissection training performance in mastoidectomy. Laryngoscope. 2016;126(8):1883-1888.
11.
AndersenSAKongeLMikkelsenPTCayé-ThomasenPSørensenMS. Mapping the plateau of novices in virtual reality simulation training of mastoidectomy. Laryngoscope. 2017;127(4):907-914.
12.
WilsonBD. Development in video technology for coaching. Sports Technol. 2008;1(1):34-40.
13.
SinghPAggarwalRTahirMPucherPHDarziA. A randomized controlled study to evaluate the role of video-based coaching in training laparoscopic skills. Ann Surg. 2015;261(5):862-869.
14.
AlameddineMBEnglesbeMJWaitsSA. A video-based coaching intervention to improve surgical skill in fourth-year medical students. J Surg Educ. 2018;75(6):1475-1479.
15.
AugestadKMButtKIgnjatovicDKellerDSKiranR. Video-based coaching in surgical education: a systematic review and meta-analysis. Surg Endosc. 2020;34:521-535.
16.
HuYYPeyreSEArriagaAF, et al. Postgame analysis: using video-based coaching for continuous professional development. J Am Coll Surg. 2012;214(1):115-124.
17.
HuYYMazerLMYuleSJ, et al. Complementing operating room teaching with video-based coaching. JAMA Surg. 2017;152(4):318-325.
18.
PernarLIPeyreSEHassonRM, et al. Exploring the content of intraoperative teaching. J Surg Educ. 2016;73(1):79-84.
19.
ChenXPWilliamsRGSanfeyHASminkDS. A taxonomy of surgeons' guiding behaviors in the operating room. Am J Surg. 2015;209(1):15-20.
20.
RobertsNKBrennerMJWilliamsRGKimMJDunningtonGL. Capturing the teachable moment: a grounded theory study of verbal teaching interactions in the operating room. Surgery. 2012;151(5):643-650.
21.
KapadiaMRHrabeJESheltonJErdahlLM. Teaching and mentoring early in surgical practice. Am Surg. 2021;87(6):933-937.
22.
KamaliDIllingJ. How can positive and negative trainer feedback in the operating theatre impact a surgical trainee’s confidence and well-being: a qualitative study in the north of England. BMJ Open. 2018;8(2):e017935.
23.
GrantJ. Learning needs assessment: assessing the need. BMJ. 2002;324(7330):156-159.
24.
CoxSSSwansonMS. Identification of teaching excellence in operating room and clinic settings. Am J Surg. 2002;183(3):251-255.
25.
DavisDAMazmanianPEFordisMVan HarrisonRThorpeKEPerrierL. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296(9):1094-1102.
26.
Herrera-AlmarioGEKirkKGuerreroVTJeongKKimSHamadGG. The effect of video review of resident laparoscopic surgical skills measured by self- and external assessment. Am J Surg. 2016;211(2):315-320.
27.
RaaijmakersSFBaarsMPaasFvan MerriënboerJJGvan GogT. Training self-assessment and task-selection skills to foster self-regulated learning: do trained skills transfer across domains?Appl Cogn Psychol. 2018;32(2):270-277.
28.
NayarSKMustoLBaruahGFernandesRBharathanR. Self-assessment of surgical skills: a systematic review. J Surg Educ. 2020;77(2):348-361.
29.
BonrathEMDedyNJGordonLEGrantcharovTP. Comprehensive surgical coaching enhances surgical skill in the operating room: A randomized controlled trial. Ann Surg. 2015;262(2):205-212.
30.
CopeACMavroveliSBezemerJHannaGBKneeboneR. Making meaning from sensory cues: a qualitative investigation of postgraduate learning in the operating room. Acad Med. 2015;90(8):1125-1131.
31.
KreutzerLHuYYStulbergJGreenbergCCBilimoriaKYJohnsonJK. Formative evaluation of a peer video-based coaching initiative. J Surg Res. 2021;257:169-177.
32.
LiaoCHOoyangCHChenCC, et al. Video coaching improving contemporary technical and nontechnical ability in laparoscopic education. J Surg Educ. 2020;77(3):652-660.
33.
GreenbergCCByrnesMEEnglerTAQuammeSPRThummaJRDimickJB. Association of a statewide surgical coaching program with clinical outcomes and Surgeon Perceptions. Ann Surg. 2021;273(6):1034-1039.
34.
SemsarAMcGowanHFengY, et al. Effects of a virtual pointer on trainees' cognitive load and communication efficiency in surgical training. AMIA Annu Symp Proc. 2020;2019:1197-1206.
35.
LaeeqKBhattiNICareyJP, et al. Pilot testing of an assessment tool for competency in mastoidectomy. Laryngoscope. 2009;119(12):2402-2410.
36.
FrancisHWMasoodHChaudhryKN, et al. Objective assessment of mastoidectomy skills in the operating room. Otol Neurotol. 2010;31(5):759-765.
37.
JethwaARPerdoniCJKellyEAYuehBLevineSCAdamsME. Randomized controlled pilot study of video self-assessment for resident mastoidectomy training. OTO Open. 2018;2(2):2473974X18770417. doi:10.1177/2473974X18770417
38.
ConlinALeaJBanceM, et al. Mental practice in postgraduate training: a randomized controlled trial in mastoidectomy skills. J Otolaryngol Head Neck Surg. 2016;45(1):46.
39.
AndersenSAKongeLCayé-ThomasenPSørensenMS. Learning curves of virtual mastoidectomy in distributed and massed practice. Otolaryngol Head Neck Surg. 2015;141(10):913-918.
40.
CrawshawBPSteeleSRLeeEC, et al. Failing to prepare is preparing to fail: A Single-Blinded, randomized controlled trial to determine the impact of a preoperative instructional video on the ability of residents to perform laparoscopic right colectomy. Dis Colon Rectum. 2016;59(1):28-34.
41.
WilliamsRGVerhulstSColliverJADunningtonGL. Assuring the reliability of resident performance appraisals: more items or more observations?Surgery. 2005;137(2):141-147.
42.
SethiaRKerwinTFWietGJ. Performance assessment for mastoidectomy. Otolaryngol Head Neck Surg. 2017;156(1):61-69.
43.
CarterSCChiangAShahG, et al. Video-based peer feedback through social networking for robotic surgery simulation: a multicenter randomized controlled trial. Ann Surg. 2015;261(5):870-875.
44.
SoucisseMLBoulvaKSiderisLDroletPMorinMDubéP. Video coaching as an efficient teaching method for surgical residents – a randomized controlled trial. J Surg Educ. 2017;74(2):365-371.
45.
BacksteinDAgnidisZSadhuRMacRaeH. Effectiveness of repeated video feedback in the acquisition of a surgical technical skill. Can J Surg. 2005;48(3):195-200.
46.
VyasaPWillisREDunkinBJGardnerAK. Are general surgery residents accurate assessors of their own flexible endoscopy skills?J Surg Educ. 2017;74(1):23-29.
47.
PalterVNBeyfussKAJokhioARRyzynskiAAshamallaS. Peer coaching to teach faculty surgeons an advanced laparoscopic skill: a randomized controlled trial. Surgery. 2016;160(5):1392-1399.
48.
NousiainenMBrydgesRBacksteinDDubrowskiA. Comparison of expert instruction and computer-based video training in teaching fundamental surgical skills to medical students. Surgery. 2008;143(4):539-544.
49.
FanTWorkmanADKochGRathiVKScangasGAMetsonR. Educational utility of an online video-based teaching tool for sinus and skull base surgery. Laryngoscope Investig Otolaryngol. 2021;6(2):195-199.
50.
McNeilEReichHHurlimanE. Educational video improves dermatology residents’ understanding of Mohs micrographic surgery: a survey-based matched cohort study. J Am Acad Dermatol. 2020;83(3):926-927.
51.
HamourAFMendezAIHarrisJRBironVLSeikalyHCôtéDWJ. A high-definition video teaching module for thyroidectomy surgery. J Surg Educ. 2018;75(2):481-488.
52.
LuuNNYverCMDouglasJETascheKKThakkarPGRajasekaranK. Assessment of YouTube as an educational tool in teaching key indicator cases in otolaryngology during the COVID-19 pandemic and beyond: neck dissection. J Surg Educ. 2021;78(1):214-231.
53.
de’AngelisNGavriilidisPMartínez-PérezA, et al. Educational value of surgical videos on YouTube: quality assessment of laparoscopic appendectomy videos by senior surgeons vs. novice trainees. World J Emerg Surg. 2019;14:22.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
