Assessment of Clinical Leadership Training Needs in Senior Pediatric Residents

Abstract

Introduction:

Although clinical leadership in physicians is associated with improved healthcare, leadership training is rarely integrated into residency training. Our objective was to perform a comprehensive needs assessment of our pediatric residents’ existing leadership experiences and knowledge and to identify training gaps within our program.

Methods:

First, we held focus groups with senior pediatric residents to understand their clinical leadership experiences and identify training needs. Notes were transcribed and independently coded by 2 researchers, with thematic saturation achieved. Next, we focused each session on 1 leadership content area identified from the aforementioned themes to better understand the specific training needs for each topic.

Results:

Four major themes were identified: (1) Effective and timely communication with supervisors, learners, ancillary staff, and patients is indispensable in promoting safe patient care, avoiding conflict, and preventing misunderstanding. (2) Training in teaching methods is desired, especially gaining the skills needed to teach various levels of learners, in different settings and under time constraints. (3) Time management, availability of resources, and team logistics were often learned through trial-and-error. (4) Self-care, self-acceptance, emotional regulation, and peer debriefing are relied upon to manage negative emotions; rarely are resilience and wellness strategies employed in “real-time.”

Conclusion:

Senior residents currently face gaps in clinical leadership training and may benefit from additional instruction in content areas related to these 4 themes. Our next steps are to utilize the identified themes to develop a longitudinal and skills-based clinical leadership curriculum to address the gap in graduate medical education.

Keywords

Needs assessment focus groups resident leadership clinical leadership leadership curriculum professional development graduate medical education

Introduction

Clinical leadership, broadly defined as the ability to effectively lead and coordinate teams, communicate clearly in various settings, role model positive behaviors, and display emotional intelligence, is considered an essential skill for physicians.¹ On an individual level, physicians who demonstrate clinical leadership can collaborate effectively in team-based settings and minimize miscommunication to deliver high quality, cost-effective care to patients.² On a systems level, clinical leadership increases physician engagement and results in advances in healthcare reform, regulation, and patient safety policies.³ Although there is literature that suggests that clinical leadership empowers physicians and improves patient care,^2-6 the process by which clinical leadership is learned is less clear, as there have been no standardized residency curricula or competency-based assessments for leadership development in physicians.^6-9 While physicians invest the majority of time during their residency to the acquisition and application of clinical knowledge, their exposure to leadership training is generally lacking; they primarily report learning these critical skills through trial-and-error or observation of faculty in higher positions of power.¹⁰ As a result, recently graduated physicians report feeling inadequately prepared to assume basic leadership responsibilities, such as leading multidisciplinary teams and resolving professional conflicts.^6,11 Furthermore, physicians who lack leadership training are more prone to burnout and depression, which impacts quality of care and patient safety as well as contributing to high physician turnover and a workforce shortage.¹² Effective clinical leadership training is critical in graduate medical education to ensure a holistic education that will provide the necessary skills that future generations of physicians need in the dynamic healthcare environment.⁶

While the need for leadership training has been established,^6,10,11 and there is ample evidence that it affects patient outcomes,^2-6 as well as physician wellbeing and resilience,¹² robust needs assessments for the content of such a training are lacking. Several programs have attempted to survey leadership training needs, such as at a large Northeastern academic medical center, where respondents reported needs in “leading a team,” “confronting problem employees,” “coaching and developing others,” and “resolving interpersonal conflicts.”^13,14 However, surveys may not be an optimal methodology in evaluating training needs as they provide standardized representations of groups as a whole, lack insight into individual needs, and may fail to identify needs that were not pre-conceived during the survey design process.^15,16 Few programs have conducted focus groups to expand upon these leadership needs through in-depth discussions.^17,18 Additionally, most programs are geared toward improving knowledge as opposed to developing practical, applied skills.^17,19-23 Other programs have instituted brief leadership workshops to try and address leadership training needs,^7,24,25 but find it difficult to evaluate the efficacy of their program without fully assessing training needs.²⁶

In order to develop a longitudinal and skills-based clinical leadership curriculum based on best practices both within and outside of medicine,⁶ we performed a comprehensive needs assessment with the residents at our own institution through focus groups with in-depth peer-to-peer discussions.

Methods

We utilized the 21 Standards of Reporting Qualitative Research (Table 1) as our reporting guidelines.²⁷ We modeled our comprehensive needs assessment after Steps 1 and 2 of Kern’s 6 steps of curricular development, which include problem identification and general needs assessment, and targeted needs assessment, respectively.²⁸

Table 1.

Standards for reporting qualitative research (SRQR).

No.	Topic	Item
Title and abstract
S1	Title	Assessment of Clinical Leadership Training Needs in Senior Pediatric Residents
S2	Abstract	Introduction: In order to develop a comprehensive leadership curriculum, we performed a needs assessment.
		Methods: First, we held focus groups with residents to understand their leadership experiences and identify training needs.
		Results: Four major themes were identified:
		(1) Effective and timely communication is indispensable(2) Training in teaching methods is desired(3) Time management, availability of resources, and team logistics were often learned through trial-and-error(4) Self-care, self-acceptance, emotional regulation, and peer debriefing are relied upon to manage negative emotions

		Conclusion: Senior residents currently face gaps in leadership training and may benefit from additional instruction in content areas related to these four themes.
Introduction
S3	Problem formulation	Clinical leadership empowers physicians and improves patient care, but the process by which clinical leadership is learned is less clear, as there have been no standardized residency curricula or competency-based assessments for leadership development in physicians.
S4	Purpose or research question	To comprehensively assess clinical leadership training needs in senior pediatric residents at our own institution
Methods
S5	Qualitative approach and research paradigm	Modeled our comprehensive needs assessment after Steps 1 (problem identification and general needs assessment) and 2 (targeted needs assessment) of Kern’s six steps of curricular development
S6	Researcher characteristics and reflexivity	1. Faculty facilitator was trained in focus group facilitation and was well received by the residents to establish social familiarity.2. Utilized focus groups to gather qualitative data on both the breadth and depth of training needs.
	Researcher characteristics and reflexivity
S7	Context	Focus groups took place in the morning conference room with tables arranged in a circle formation facing inward and a fair distribution of residents.
S8	Sampling strategy	Convenience sample of available residents, usually consisting of 8 to 12 participants, but no more than 15. A total of nine focus group sessions were conducted.
S9	Ethical issues pertaining to human subjects	Obtained approval from our Institution Review Board at Eastern Virginia Medical School (IRB# 16-09-NH-0174)
S10	Data collection methods	Each month, residents participated in peer-to-peer discussion during 1-hour focus groups with open-ended questions from the prepared script related to their challenges in a senior role, experiences related to witnessing unprofessional behavior, and “what they wished they had known prior to starting as a senior.”
S11	Data collection instruments and technologies	Faculty facilitator and transcriber took notes at each focus group session.
S12	Units of study	66* (100%) PGY-2 and PGY-3 residents participated in at least one focus group session.
S13	Data processing	Resident responses were directly transcribed.
S14	Data analysis	Transcriptions were independently coded by the facilitator and transcriber using an iterative coding process to identify patterns of responses, ensure reliability, and examine discrepancies. Codes were categorized and emerging themes were identified.
S15	Techniques to enhance trustworthiness	Rigorous memos of coding decisions were kept to ensure consistency.
Results/findings
S16	Synthesis and interpretation	Needs assessment identified clinical leadership training needs in four major areas:
		(1) effective and timely communication,
		(2) teaching methods in the clinical setting,
		(3) time management and resource utilization, and
		(4) self-care and emotional regulation techniques to build resilience.
S17	Links to empirical data	Please see Figure 1.
Discussion
S18	Integration with prior work,implications, transferability, and contribution(s) to the field	Residents currently face gaps in clinical leadership training and would benefit from formal instruction. Next steps are to:
		1. Utilize the identified themes to develop a longitudinal and skills-based clinical leadership curriculum.2. Evaluate the impact of the curriculum utilizing skills-based domains, in addition to focusing on resident behavior, resilience, and wellbeing.Goal: Ultimately empower residents, reduce the prevalence of depression and burnout within graduate medical education, and improve patient care outcomes.

S19	Limitations	1. Needs assessment was performed with pediatric residents, so identified themes may not apply universally across other specialties; however, our findings align with those in the current literature, which are not exclusive to pediatrics
		2. Needs were identified by residents at a single institution, which might limit the generalizability to other settings; however, the high level of resident participation and the variety of different clinical settings of our program are likely to have needs similar to other institutions
		3. Employed qualitative methods to assess training needs, as opposed to more robust methods that utilize both qualitative and quantitative data
Other
S20	Conflicts of interest	No conflicts of interest among the researchers
S21	Funding	No funding for this project provided.

This accounts for the overlap of 22 residents transitioning into resident positions over a 2-year period.

After requests by residents and faculty members for additional training of residents in the “senior role,” we obtained approval from the local institution review board for an educational intervention (IRB#16-09-NH-0174) to perform a needs assessment for the purpose of developing a clinical leadership curriculum for residents.

Conducting focus groups was the optimal methodology because it allowed us to perform a comprehensive needs assessment to gather qualitative data on both the breadth and depth of training needs.¹⁶ Asking open-ended questions allowed us to better understand residents’ thought processes and follow-up with responses, if necessary.¹⁶ As social familiarity establishes a more comfortable environment to elicit honest answers, we sought to recruit a group facilitator that had been well received by the residents.²⁹ Furthermore, we considered alternative methods, such as a standardized survey, but opted instead to conduct focus groups, as it encouraged peer-to-peer discussion and allowed observations of participant behaviors to re-direct tangential conversation. Lastly, we hoped that interpersonal discussions between residents, sharing personal experiences, would trigger memories or examples from other residents to add value to the discussion.

Focus group team and preparation

We assembled a team including clinical faculty, a graduate medical education (GME) specialist, and chief residents. To ensure consistency, we designated 1 faculty member to facilitate every session and another to transcribe every session. At our program, the faculty facilitator was an attending physician with focus group facilitation training and experience. Each resident had previously worked with the physician during their emergency medicine rotation, so the participants and the facilitator were familiar with each other. The faculty facilitator and the transcriber also had previous training in focus group coding and qualitative research. We created and used a script (Figure 1) that was reviewed by chief residents, faculty, and an expert in focus groups for use by the faculty facilitator during the sessions. During each focus group, the transcriber used a laptop to transcribe resident responses electronically.

Figure 1.

Focus group script.

Participants and setting

Participants in the focus groups included post-graduate year-2 (PGY-2) and PGY-3 pediatric residents who assumed a “senior role” in the residency program. We excluded interns because we were interested in the unique challenges of “leading from the middle,” where senior residents lead junior learners, such as interns and medical students, but still report upwards to an attending physician.³⁰ No other prerequisite knowledge or training was required of participants. This study was conducted at an urban, stand-alone children’s hospital with a medium-sized three-year pediatric residency program that has approximately 22 residents per year. Of note, there are no subspecialty fellows outside of the Emergency Department.

Focus group design and implementation

From August 2016 to May 2017, senior pediatric residents at CHKD/EVMS participated in monthly focus groups to better understand their clinical leadership training needs. We informed residents that participation was voluntary, that all responses would be transcribed but not associated with identifying information, that their participation in the focus group implied consent, and that the information would be used to better understand resident training needs in clinical leadership.

The focus groups took place in the morning conference room with tables arranged in a circle formation facing inward to allow each participant to visualize each other. Upon entering the room, residents could select their own seats, but were asked to move where possible to ensure a fair distribution of residents. Each focus group had a convenience sample of available residents, usually consisting of 8 to 12 participants, but no more than 15.

Each month, residents participated in peer-to-peer discussion during 1-hour focus groups with open-ended questions from the prepared script related to their challenges in a senior role, experiences related to witnessing unprofessional behavior, and “what they wished they had known prior to starting as a senior.” At the end of each focus group, the facilitator summarized the key points of discussion and invited clarifying comments. By the end of the academic year, we had conducted a total of 9 focus group sessions as we had achieved thematic saturation from the resident responses. We did not conduct a focus group during December due to resident obligations during the holiday schedule.

Thematic analysis

Resident responses were directly transcribed. The faculty facilitator and the transcriber performed content analysis by independently coding the transcriptions from each session using an iterative coding process to identify patterns of responses, ensure reliability, and examine discrepancies.³¹ The faculty facilitator and the transcriber kept rigorous memos of coding decisions to ensure consistency in coding. The codes were then categorized, and emerging themes were identified. Both coders then met to achieve consensus and resolve discrepancies. Thematic saturation was achieved and used as a basis for a targeted assessment.

Targeted needs assessment

In the second year of the program, from August 2017 to May 2018, we conducted monthly facilitated discussions with the succeeding group of PGY-2 and PGY-3 residents. We used the same format as previously described, but we focused each monthly session on 1 content area related to the themes that emerged from the qualitative analysis of the sessions from the prior year. The purpose of the 2017 to 2018 focus groups was to better understand resident experiences and training needs within each content area. The same prepared script was used and residents were asked to focus their responses and discussion on the selected content area (eg, feedback). Responses were again transcribed.

Results

During the initial 9 focus groups from 2016 to 2017, all 44 (100%) PGY-2 and PGY-3 residents participated in at least 1 focus group session. From 2017 to 2018, the succeeding group of 44 (100%) PGY-2 and PGY-3 residents participated in at least 1 focus group for the targeted needs assessment. A total of 66 senior pediatric residents participated in the focus groups, which accounts for the overlap of 22 residents who transitioned from a PGY-2 to a PGY-3 position over this 2-year period. Based on the resident responses that were transcribed and coded, we identified 4 major themes (Tables 2 –5):

Table 2.

Theme 1: Effective and timely communication.

Theme description

Effective and timely communication with supervisors, learners, ancillary staff and patients is indispensable in promoting safe patient care, avoiding conflict, and preventing misunderstanding.

Resident quotes

“You learn a lot about human nature in regards to teamwork; you have me, the intern, and the nursing staff, and there always seems to be one person who doesn’t want to play ball. . .As a team, it would be super helpful to work together instead of having others side stepping me and going straight to the attending.”

“I am most nervous about not having the answers for the interns. . .I just don’t know how to answer and how to delegate. I know [that] I will need to be honest with them if I don’t the answer but [I will] ensure them [that] I will find the answer.”

“Do[ing] feedback individually not in group settings so they don’t feel called out. There are times when immediate inappropriate behavior should be addressed in a quiet place but pull the person to the side. Remember, it is a behavior and not a personal issue.”

“A lot of the night team will have questions from family. Make sure to communicate with the day folks so they are aware of conversations, so it looks like you are really a team working on their child.”

“Dealing with personalities can be tough. What is in my head doesn’t always come out of my mouth with the same intent.

Table 3.

Theme 2: Teaching in the clinical setting.

Theme description

Training in teaching methods is desired, especially gaining the skills needed to teach various levels of learners, in different settings, and under time constraints.

Resident quotes

“Mak[ing] sure to set expectations not just for medical students, interns, [and] residents, but also your Attendings. How do they expect rounds to go?”

“Remembering how important peer learning is!!! Model behavior and do it in front of your interns, not behind their backs.”

“Reminding the intern that at the beginning of the month we set expectations of x, y, and z. You are doing well with x, and y, but we still need to work on z.”

“Teaching interns the challenges of the medical system is a good approach because this will be an issue at any institution they go to. Teach them to adapt to changes and factors out of our control. Teach them to always think of what’s coming next.”

“Managing med students. When sending them to admissions, give them a certain amount of time. Go check on them if they have been there too long.”

“Struggl[ing] with having to cut medical students off during rounds [on] Pulmonary to get to the next sub-specialty rounds on time.

Table 4.

Theme 3: Effective time management and resource utilization.

Theme description

Time management, availability of resources, and team logistics were often learned through trial-and-error.

Resident quotes

“I got seven admissions in a three-hour time span. I was doing floor work and admissions and it was way too much. . .I knew I just had to ask for help.”

“When things don’t get done on the floor and expectations aren’t clear, make sure to let the chief residents know what is going on. Someone ‘above your pay grade’ needs to step in and have a conversation with the interns. It is too time consuming for you to continue to remind the interns.”

“Learn[ing] to be flexible—as long as “it” gets done, “it” may be done differently and that is okay.”

Table 5.

Theme 4: Self-care and emotional regulation to build resilience.

Theme description

Self-care, self-acceptance, emotional regulation, and peer debriefing are relied upon to manage negative emotions; rarely are resilience and wellness strategies employed in “real-time.”

Resident quotes

“I am constantly worried I am missing something. . .because as a senior I am having less and less folks ask me things. . .questioning me. I miss that. It is anxiety provoking to have autonomy and frustrating to not have it as well. Debriefing is helpful.”

“[There is] the realization that you cannot possibly please everyone all the time. . .Learn to not be reactive and turn it into a teachable moment. . .Bring it back to the patient.”

“Try and remember to leave work at work. When you get home, you can’t put orders in, you can’t work on the patient, so let the docs at the hospital take over care with the patient. You need a good night’s sleep and need to be rested.”

“[There is] so much to be said for morale. . .de-stress [in] the morning and try and make things fun, but productive. Play some music, etc.”

“Try not to get in the rut of thinking negative each morning because it will directly affect how your day will run.”

“Try and remember it isn’t them, it’s the system. The [interns] are overwhelmed with a system that has too much to handle that ebb and flows with no way to handle it.”

“[There is] a lot of frustration and animosity right now. We are at the end of third year and we don’t know who is really listening and who really cares.”

“There can be a feeling of nothing is going to happen to these other senior residents so now you become mad or angry and it is the end.”

Lack of effective communication is currently a barrier to optimal patient care and is prevalent when interacting with colleagues, attending physicians, medical students, ancillary staff members, and even patients themselves. Miscommunication may consequently contribute to frustration and negative emotions that compound dissatisfaction with their training and the program. To minimize miscommunication, medical trainees would benefit strongly from instruction on how to resolve conflicts and avoid misunderstanding in a professional manner.

Although PGY-2 and PGY-3 residents assume more teaching responsibilities, they currently lack training in teaching methods, especially with learners at different levels of education, in various clinical settings, and under time-limited circumstances. Formalized instruction on how to set expectations, provide feedback, and delegate roles would establish a foundation to facilitate learning and assume teaching roles.

In addition, residents struggle to develop efficient techniques in time management and resource utilization, which are currently learned through trial-and-error. A lack of dedicated instruction may compound the high stress environment of residency training, as residents practice unhealthy behaviors, such as avoiding meals or having poor sleep hygiene. Identifying personalized solutions on how to prioritize tasks appropriately, for example, would be greatly appreciated.

Finally, many stressors within the clinical learning environment can contribute to the myriad of negative feelings experienced among residents, including anxiety, apprehension, and Imposter Syndrome. These feelings contribute to the prevalent rates of burnout and depression among residents. Therefore, instruction on strategies for self-care, self-acceptance, and emotional regulation may reduce burnout and depression and foster resilience.

Discussion

Here we presented the results of our assessment, which identified clinical leadership training needs in 4 major areas for senior pediatric residents at our institution. They would benefit from training in: (1) effective and timely communication, (2) teaching strategies in the clinical setting, (3) effective time management and resource utilization, and (4) self-care and emotional regulation techniques to build resilience.

The identified themes collectively align with the current literature on what is necessary for effective clinical leadership and would benefit resident trainees.^1-7 Resident responses also indicate an overall desire for applied leadership skills training in the content areas covered by the 4 themes. Additionally, the high prevalence of depression and burnout within graduate medical education^32-36 is often attributed to the “hidden curriculum,”^37,38 which involves implicit standards of conduct that govern behaviors, beliefs, and attitudes that have been deemed inappropriate yet perpetuated.^38-41 Clinical leadership skills training would address the hidden curriculum by explicitly redefining appropriate standards of conduct and actively engaging physicians, ultimately leading to improved clinical outcomes.^2,3,42

Although we have successfully identified clinical leadership training needs, we understand that our focus groups face several limitations. The needs assessment was performed with pediatric residents, so they may not apply universally across other specialties; however, our findings align with those in the current literature, which are not exclusive to the field of pediatrics. In addition, the generalizability of the findings to other settings might be limited for several reasons. First, these needs were identified by residents at a single institution; however, the high level of resident participation and the variety of different clinical settings of our residency program (eg, outpatient clinic, emergency department, inpatient team, intensive care units, etc.) are likely similar to other institutions and implementation at other programs can assess for the consistency of these needs. Additionally, our institution is a tertiary care center without inpatient subspecialty fellows, where the senior resident is truly the learner that is leading the team. Although this may limit generalizability, it likely adds to the breadth and depth of the themes. Furthermore, we have employed qualitative methods to assess training needs, as opposed to more robust methods that utilize both qualitative and quantitative data, which may have been beneficial in comparing and stratifying the relevance of specific needs.

Ultimately, the responses from our comprehensive needs assessment indicate that residents currently face gaps in clinical leadership skills and would benefit from additional training. Our next steps are to utilize the identified themes to develop a longitudinal and skills-based clinical leadership curriculum to address the gap in graduate medical education. We further plan to evaluate the impact of the curriculum utilizing skills-based domains, in addition to focusing on resident behavior, resilience, and wellbeing. Our goal is to ultimately empower residents, reduce the prevalence of depression and burnout within graduate medical education, and improve patient care outcomes.

Footnotes

Acknowledgements

We thank Dana Ramirez, MD, former Program Director at CHKD/EVMS Pediatric Residency, for assistance with recognizing and protecting the time to study clinical leadership within the residency structure, and Clarence W. Gowen, MD, Department Chair of Pediatrics at CHKD/EVMS for assistance with his vision for physician leadership and support in the development of clinical leadership training for residents.

Funding:

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Declaration of conflicting interests:

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Author Contributions

HN, PF, PM, and RK designed the study and reviewed the script prior to conducting the focus groups. PF and RK facilitated the focus groups as HN transcribed resident responses. RK and HN analyzed responses for thematic coding. All authors reviewed and discussed the results and contributed to the final manuscript.

ORCID iD

Daniel H Mai

References

Rotenstein

Sadun

Jena

. Why Doctors Need Leadership. Harvard Business Review. October 17, 2018. Accessed October 15, 2020. https://hbr.org/2018/10/why-doctors-need-leadership-training

Ham

. Improving the performance of health services: the role of clinical leadership. Lancet. 2003;361:1978-1980. doi:10.1016/S0140-6736(03)13593-3

Howieson

Thiagarajah

. What is clinical leadership? A journal-based meta-review. Int J Clin Pract. 2011;17:7-18.

Nieuwboer

van der Sande

van der Marck

Olde Rikkert

MGM

Perry

. Clinical leadership and integrated primary care: a systematic literature review. Eur J Gen Pract. 2019;25:7-18. doi:10.1080/13814788.2018.1515907

Montgomery

. The relationship between leadership and physician well-being: a scoping review. J Healthc Leadersh. 2016;8:71-80. doi:10.2147/JHL.S93896

Blumenthal

Bernard

Bohnen

Bohmer

. Addressing the leadership gap in medicine. Acad Med. 2012;87:513-522. doi:10.1097/ACM.0b013e31824a0c47

Stoller

Rose

Lee

Dolgan

Hoogwerf

. Teambuilding and leadership training in an internal medicine residency training program. J Gen Intern Med. 2004;19:692-697. doi: 10.1111/j.1525-1497.2004.30247.x

Jardine

Correa

Schultz

, et al. The need for a leadership curriculum for residents. J Grad Med Educ. 2015;7:307-309. doi:10.4300/JGME-07-02-31

Kiesewetter

Schmidt-Huber

Netzel

Krohn

Angstwurm

Fischer

. Training of Leadership Skills in Medical Education. GMS Z Med Ausbild. 2013;30:49.

10.

Taylor

Stoller

. The influence of mentorship and role modeling on developing physician-leaders: views of aspiring and established physician-leaders. J Gen Intern Med. 2009;24:1130-1134. doi:10.1007/s11606-009-1091-9

11.

Leatt

Porter

. Where are the healthcare leaders “the need for investment in leadership development”. Healthc Pap. 2003;4:14-31. doi:10.12927/hcpap.2003.16891

12.

Shanafelt

Noseworthy

. Executive leadership and physician well-being: nine organizational strategies to promote engagement and reduce burnout. Mayo Clin Proc. 2017;92:129-146. doi: 10.1016/j.mayocp.2016.10.004

13.

Fraser

Blumenthal

Bernard

Iyasere

. Assessment of leadership training needs of internal medicine residents at the Massachusetts General Hospital. Proc (Bayl Univ Med Cent). 2015;28:317-320. doi:10.1080/08998280.2015.11929260

14.

Danilewitz

McLean

. A landscape analysis of leadership training in postgraduate medical education training programs at the University of Ottawa. Can Med Educ J. 2016;7:e32-e50.

15.

Tausch

Menold

. Methodological aspects of focus groups in health research: results of qualitative interviews with focus group moderators. Glob Qual Nurs Res. 2016;3:2333393616630466. doi:10.1177/2333393616630466

16.

Stalmeijer

Mcnaughton

Van Mook

. Using focus groups in medical education research: AMEE guide No. 91. Med Teach. 2014;36:923-939. doi:10.3109/0142159X.2014.917165

17.

Moore

Wininger

Martin

. Leadership for all: an internal medicine residency leadership development program. J Grad Med Educ. 2016;8:587-591. doi:10.4300/JGME-D-15-00615.1

18.

Beigzadeh

Bahaadinbeigy

Adibi

Yamani

. Identifying the challenges to good clinical rounds: a focus-group study of medical teachers. J Adv Med Educ Prof. 2019;7:62-73. doi:10.30476/JAMP.2019.44710

19.

Sultan

Torti

Haddara

Inayat

Lingard

. Leadership development in postgraduate medical education: a systematic review of the literature. Acad Med. 2019;94:440-449. doi:10.1097/ACM.0000000000002503

20.

Biese

Leacock

Osmond

Hobgood

. Engaging senior residents as leaders: a novel structure for multiple chief roles. J Grad Med Educ. 2011;3:236-238. doi:10.4300/JGME-D-10-00045.1

21.

Doughty

Williams

Brigham

Seashore

. Experiential leadership training for pediatric chief residents: impact on individuals and organizations. J Grad Med Educ. 2010;2:300-305. doi:10.4300/JGME-02-02-30

22.

Blumenthal

Bernard

Fraser

Bohnen

Zeidman

Stone

. Implementing a pilot leadership course for internal medicine residents: design considerations, participant impressions, and lessons learned. BMC Med Educ. 2014;14:257. doi:10.1186/s12909-014-0257-2

23.

Levine

Chao

Brett

, et al; Chief resident immersion training in the care of older adults: an innovative interspecialty education and leadership intervention. J Am Geriatr Soc. 2008;56:1140-1145. doi:10.1111/j.1532-5415.2008.01710.x

24.

Lee

Tse

Naguwa

. Building leadership skills in paediatric residents. Med Educ. 2004;38:559-560. doi:10.1371/journal.pone.0183019

25.

Dickerman

Sánchez

Portela-Martinez

Roldan

. Leadership and academic medicine: preparing medical students and residents to be effective leaders for the 21st century. MedEdPORTAL. 2018;14:10677. doi:10.15766/mep_2374-8265.10677

26.

Hartzell

Cohee

Nelson

Wilson

. Moving beyond accidental leadership: a graduate medical education leadership curriculum needs assessment. Mil Med. 2017;182:e1815-e1822. doi:10.7205/MILMED-D-16-00365

27.

O’Brien

Harris

Deckman

, et al. MHPE standards for reporting qualitative research. Acad Med. 2014;89:1245-1251. doi:10.1097/ACM.0000000000000388

28.

Kern

Thomas

Hughes

, eds. Curriculum Development for Medical Education: A Six-Step Approach. 2nd ed. Baltimore, MD: Johns Hopkins University Press; 2009.

29.

Teufel-Shone

Williams

. Focus groups in small communities. Prev Chronic Dis. 2010;7(3):A67.

30.

Martin

Waring

. Leading from the middle: constrained realities of clinical leadership in healthcare organizations. Health (London). 2013;17(4):358-374. doi:10.1177/1363459312460704

31.

Elo

Kyngäs

. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115. doi:10.1111/j.1365-2648.2007.04569.x

32.

IsHak

Lederer

Madili

, et al. Burnout during residency training: a literature review. J Grad Med Educ. 2009;1:236-242. doi:10.4300/JGME-D-09-00054.1

33.

Fahrenkopf

Sectish

Barger

, et al. Rates of medication errors among depressed and burnt out residents: prospective cohort study. BMJ. 2008;336:488. doi:10.1136/bmj.39469.763218.BE

34.

Ito

Seo

Maeno

Ogawa

Maeno

. Relationship between depression and stress coping ability among residents in Japan: a two-year longitudinal study. J Clin Med Res. 2018;10:715-721. doi:10.14740/jocmr3512w

35.

Earle

Kelly

. Coping strategies, depression, and anxiety among Ontario family medicine residents. Can Fam Physician. 2005;51:242-243.

36.

McCue

Sachs

. A stress management workshop improves residents’ coping skills. Arch Intern Med. 1991;151:2273-2277. doi:10.1001/archinte.1991.00400110117023

37.

Oliveira

Chang

Fitzgerald

, et al. The prevalence of burnout and depression and their association with adherence to safety and practice standards: a survey of United States anesthesiology trainees. Anesth Analg. 2013;117:182-193. doi:10.1213/ANE.0b013e3182917da9

38.

Aultman

. Uncovering the hidden medical curriculum through a pedagogy of discomfort. Adv Health Sci Educ Theory Pract. 2005;10:263-273. doi:10.1007/s10459-004 4455-2

39.

Crapanzano

Schwartz

Sperber

Stagno

Tynes

. Using a group exercise to teach about the hidden curriculum. MedEdPORTAL. 2015;11:10223. doi:10.15766/mep_2374-8265.10223

40.

Gofton

Regehr

. What we don’t know we are teaching: unveiling the hidden curriculum. Clin Orthop Relat Res. 2006;449:20-27. doi:10.1097/01.blo.0000224024.96034.b2

41.

Mahood

. Medical education: beware the hidden curriculum. Can Fam Physician. 2011;57:983-985.

42.

Martinchek

Bird

Pincavage

. Building team resilience and debriefing after difficult clinical events: a resilience curriculum for team leaders. MedEdPORTAL. 2017;13:10601. doi:10.15766/mep_2374-8265.10601