Abstract
Abstract
Background:
Improving communication training for primary palliative care using a required palliative care rotation for internal medicine (IM) residents has not been assessed.
Objective:
To assess skills acquisition and acceptability for IM residents not selecting an elective.
Design:
A consecutive, single-arm cohort underwent preobjective structured clinical examination (OSCE) with learner-centric feedback, two weeks of clinical experience, and finally a post-OSCE to crystallize learner-centric take home points.
Setting/Subjects:
IM second year residents from Dartmouth-Hitchcock were exposed to a required experiential palliative care rotation.
Measurements:
Pre- and post-OSCE using a standardized score card for behavioral skills, including patient-centered interviewing, discussing goals of care/code status, and responding to emotion, as well as a confidential mixed qualitative and quantitative evaluation of the experience.
Results:
Twelve residents were included in the educational program (two were excluded because of shortened experiences) and showed statistically significant improvements in overall communication and more specifically in discussing code status and responding to emotions. General patient-centered interviewing skills were not significantly improved, but prerotation scores reflected pre-existing competency in this domain. Residents viewed the observed simulated clinical experience (OSCE) and required rotation as positive experiences, but wished for more opportunities to practice communication skills in real clinical encounters.
Conclusions:
A required palliative care experiential rotation flanked by OSCEs at our institution improved the acquisition of primary palliative care communication skills similarly to other nonclinical educational platforms, but may better meet the needs of the resident and faculty as well as address all required ACGME milestones.
Background
C
Primary palliative care training, particularly in communication, is considered critical for internal medicine (IM) residents. 19 Studies have shown improvement in communication skills with structured communication training,17,20–22 but it has been reported that IM residents themselves value more clinical experience with bedside learning to increase their confidence in delivering competent end-of-life care. 23 In addition, IM residents have improved palliative care knowledge and attitudes with clinical experience compared with didactic curricular components. 24 Only one study has reported on the effects of a required palliative care rotation during IM residency, but its focus was on evaluation with a written examination on core palliative care topics and its results were prone to selection bias. 25
Objective
We aimed to assess the acquisition of primary palliative care communication skills as well as acceptability in IM residents who were required to rotate on a palliative care inpatient service.
Design
At our institution, second year IM residents have been required to spend a two-week block with the inpatient palliative care consulting service at Dartmouth-Hitchcock Medical Center with a focus on communication and pain/symptom management (Table 1). This report was on a consecutive, single-arm cohort participating during October 21, 2014, through January 22, 2016. The IM palliative care rotation curriculum was created with specific activities that address a broad array of reporting submilestones, particularly those pertaining to system-based practice, professionalism, and interpersonal and communication skills (Table 2).
OSCE, observed simulated clinical experience.
Regarding the prerotation and postrotation observed simulated clinical experience (OSCEs), simulated patient (SP) training was performed by a palliative care faculty member using developed training materials (Supplementary Data; Supplementary Data are available online at www.liebertpub.com/jpm). Table 3 includes the prompt given to the residents just before both the pre- and post-OSCEs. The scenario was identical in pre- and post-OSCEs. Use of the simulation laboratory is offered at no cost to faculty members when used for educational purposes. Pre-OSCE learner-centric take home points were incorporated into the experiential part of the rotation.
AICD, automatic implantable cardioverter defibrillator; CHF, congestive heart failure; NSVT, non-sustained ventricular tachycardia; QOL, quality of life; VT, ventricular tachycardia.
This study received exempt status from the institutional review board.
Setting/Subjects
IM second year residents from Dartmouth-Hitchcock exposed to a required experiential palliative care rotation were included in this cohort. The IM residency program contains ∼19 second year residents, 9 of whom are nonprimary care track IM residents. Primary care track IM residents did not participate in the requirement for a palliative care rotation for logistical reasons, and, therefore, could not be included.
Measurements
The primary measure of acquired communication skills was obtained by comparison of the pre-OSCE and post-OSCE resident experience using a standardized OSCE score card (Table 4), which was modified with permission from other work done by Szmuilowicz et al. 22 Although the pre- and post-OSCE scenario was identical, the SP differed so that the resident experience was unique at each encounter.
Faculty scored each item as 0 (competency not demonstrated), 0.5 (competency partially demonstrated), or 1 (competency demonstrated). These score cards were not shared with the IM resident. The score cards were solely used for the purpose of trying to capture skills acquisition during the two-week rotation for quality improvement. The total scores were used as our primary outcome of efficacy and secondary outcomes included improvement in subscores (Table 4). A student's t test analysis was used to analyze statistical differences between preassessment and postassessment made of residents for mean total score and subscores.
To assess residents' perspectives on the required rotation, we were provided with confidential resident evaluations that were administered and managed within the IM residency program. These included quantitative data with regard to the numerical rating the resident gave our rotation overall on a 0–5 Likert scale. In addition, nonrequired comments made by residents about the rotation were also included. The categories were strengths, weaknesses, and suggestions for improvement. A narrative descriptive approach was used in reporting these data.
Results
We collected pre- and post-OSCE scoring on 12 out of 14 residents (86%). Two residents were excluded because they had very shortened palliative care rotation experiences, defined by spending <50% of the time expected on the rotation.
Total scores showed a statistically significant improvement from a mean of 8.2 (standard deviation [SD] 3.6; 95% confidence interval [CI] 5.9–10.5) for the pre-OSCE to a mean of 11.6 (SD 3.6; 95% CI 9.3–13.9) for the post-OSCE (p = 0.02) on an 18-point scale. The general patient-centered interviewing skills subscore showed a nonstatistically significant improvement from a mean of 4.1 (SD 1.3; 95% CI 0.5–2.1) for the pre-OSCE to 4.9 (SD 1.2; 95% CI 0.4–2) for the post-OSCE (p = 0.07) on a six-point scale. The discussing code status subscore showed a statistically significant improvement from a mean of 3.1 (SD 2; 95% CI 1.8–4.4) for the pre-OSCE to 4.8 (SD 2.1; 95% CI 3.4–6.2) for the post-OSCE (p = 0.03) on a nine-point scale. The responding to emotion subscore showed a statistically significant improvement from a mean of 1.1 (SD 0.8; 95% CI 0.6–1.6) for the pre-OSCE to 1.8 (SD 1; 95% CI 1.1–2.5) for the post-OSCE (p = 0.04) on a three-point scale. A summary of these results can be found in Table 5.
SD, standard deviation.
With regard to acceptability of the experience for the IM residents, the average confidential rating of this rotation by residents for 2014 and 2015 was 4.43 and 4.5 out of 5 possible points, respectively. Strengths (42%; n = 5) commented on the value of practice and direct observation by expert faculty during the OSCE, the opportunity to self-identify areas for improvement through the OSCE, the breadth of family meetings experienced during the clinical rotation, helpful online training modules, good team environment, the emphasis on communication skills training, and finally interacting with SPs. Weaknesses (27%; n = 3) commented on feeling the OSCE were a surprise, OSCE was the only major chance to practice communication skills during the rotation, and a desire to lead more clinical encounters during the rotation. Lastly, suggestions for improvements (27%; n = 3) commented on adding observed clinical encounters to the OSCEs and wishing the online video lectures were available after completion of the rotation.
Conclusions
This is the first study to our knowledge that has demonstrated that a required palliative care rotation during IM residency improves core communication skills, specifically skills for discussion of code status and responding to patient emotion, and is acceptable to the residents as a required curriculum. This minimizes selection bias because the residents were not self-selected by electing to rotate with the inpatient palliative care team. We did not find a change in patient-centered communication skills, but high baseline scores on this subscore may have contributed (4.1 out of 6 possible points). Other studies, using nonclinical educational methods, have also not found changes in general communication skills for IM residents, including a three-hour program focused on the SPIKES model, 20 a controlled study of a two-day retreat with five hours of dedicated communication training, 21 and a day-long retreat. 22 The effect of a longer elective palliative care rotation demonstrated improved communication and interviewing skills as well as the time spent with hospice and palliative care attending physicians who served as role models. 25
The educational value of the attending physician as a role model was well described by Dr. Kenny et al., 26 and our clinical educational experience encompasses many of the concepts they identify. Observational learning (i.e., clinical experience) and reflective practice (i.e., OSCE practice), including use of the OSCEs not as evaluative tools for grading purposes but rather diagnostic tools to identify a resident's specific learning goals as well as a tool for reinforcing practice change when repeated at the end of the rotation, were critical parts of our curriculum. These experiences are unique to the clinical setting and may represent an advantage of a clinical rotation over a didactic experience for improving communication skills in this group of learners.
Advantages to our model as compared with classroom-based or didactic methods include incorporating residents in the daily work of palliative care (to allow more robust teaching time by the attending), although the investment of faculty time in the OSCE experience may be a significant barrier with residency programs larger than ours.
Important limitations exist. Since this was only performed in IM residents at one institution, used only a heart failure case, and lacked inclusion of primary care track IM residents generalizability is in question. There is a natural trend of improved skills over the course of an academic year for an IM resident, but we found this to be non-significant (p = 0.20) when comparing beginning and end of the second year IM residents. Use of identical pre- and post-OSCE scenarios for evaluating our intervention make improvements from repetition of scenarios possible, particularly with the lack of a control group. Lastly, we lacked assessment of actual patient encounters or patient satisfaction although others have found structured communication training to have underwhelming results when patient evaluations were assessed, 27 calling into question the training method or the optimal assessment method for meaningful acquisition of these skills.
Footnotes
Acknowledgment
The authors thank Dr. Harley Friedman for his support in valuing this type of educational experience for his IM residents.
Author Disclosure Statement
No competing financial interests exist.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
