Associations of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey Scores with Interventions and Site,Provider,and Patient Factors: A Systematic Review of the Evidence

Abstract

Patient experience is a key aspect of care quality. Since the 2007 release of the Consumer Assessment of Healthcare Providers and Systems Clinician and Group (CG-CAHPS) survey, no systematic review of factors associated with CG-CAHPS scores has been reported. We reviewed 52 peer-reviewed English language articles published in the United States using CG-CAHPS data. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines and used the Checklist for Analytical Cross-Sectional Studies. We identified several interventions (eg, adding a care coordinator focused on chronic care management) associated with improved overall provider rating and 2 interventions (eg, peer shadow coaching) that improved provider communication scores. Studies evaluating the implementation of patient-centered medical homes or patient-reported outcomes found mixed results. We identified site-level factors (eg, better team communication) and provider-level factors (eg, physician empathy) associated with better patient experience. In contrast, patient-level factors (eg, medication adherence) found mixed associations with patient experience. Policymakers, clinicians, and healthcare leaders can leverage this evidence for quality improvement efforts and interventions supporting patient-centered care.

Keywords

patient experience clinician and group CAHPS survey ambulatory care quality of care

Key Points

Our review identified several interventions (eg, adding a care coordinator focused on chronic care management) associated with improvement in overall ratings of the provider and 2 interventions (eg, peer shadow coaching) that improved provider communication.

Patient experience was inconsistently associated with patient-centered medical homes and the use of patient-reported outcomes in care.

Several site-level factors (eg, better team communication) and provider-level factors (eg, physician empathy) were associated with better patient experience. In contrast, patient-level factors (eg, medication adherence) had mixed associations with patient experience.

Introduction

Patient experience is an integral aspect of care quality and is positively associated with the performance of recommended clinical processes.¹ The Consumer Assessment of Healthcare Providers and Systems Clinician and Group (CG-CAHPS^®) survey, which asks patients to report on their experiences with providers and staff in primary care and specialty care settings, was developed for public reporting, assessing the impact of care delivery interventions, facilitating patient selection of care provider, and providing actionable information to ambulatory care providers and stakeholders.^2,3 Multiple versions of the CG-CAHPS survey exist.^2,4–7 And they can be administered in several survey modes and languages.^8–10 Survey domains include provider communication, access to care, and care coordination. Optional, supplemental CG-CAHPS survey items are available for specific topics of interest: the patient-centered medical home (PCMH),¹¹ health literacy,¹² health information technology,¹³ cultural competence,¹⁴ and patient narratives.¹⁵

A recent review documented the types of studies using CG-CAHPS survey data since its 2007 release, of which 37 were cross-sectional, 9 case-control comparisons, 3 cohort studies, and 3 randomized control trials.¹⁶ The review also found that CG-CAHPS data was used primarily to evaluate interventions (24 studies) and cross-sectional associations (21 studies), with 4 studies examining disparities in patient experience. The authors concluded that the widespread use of CG-CAHPS data indicates its value in measuring and improving care quality. They suggested that policymakers, researchers, clinicians, and healthcare leaders leverage CG-CAHPS data in quality improvement (QI) efforts and interventions that support patient-centered care. However, no systematic review has examined the evidence on associations of CG-CAHPS patient experience measures with interventions and site-level, provider-level, and patient-level factors.

We examine studies using CG-CAHPS data in the United States since 2007 to identify interventions and associations with CG-CAHPS scores. This information can help policymakers, researchers, clinicians, and healthcare leaders use CG-CAHPS survey data for QI, and interventions to improve patient-centered care.

Methods

This paper extends the systematic review of how US research has used CG-CAHPS data.¹⁶ It identifies interventions and factors associated with patient experiences measured by CG-CAHPS data. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines^17,18 and we have updated the reporting of our review based on PRISMA 2020^19,20 (see Supplemental Digital Content 1 for the PRISMA Checklist).

Search Strategy and Selection Criteria

We searched 6 databases (PubMed (using Ovid Medline^®), Web of Science, Scopus, Cochrane Database of Systematic Reviews (CDSR) (via Wiley), American Psychological Association PsycInfo, and Cumulative Index of Nursing and Allied Health Literature (CINAHL)) using a structured search strategy involving terms including patient experience, outcomes, surveys, and CG-CAHPS to identify peer-reviewed US English-language articles published from January 1, 2007, to July 31, 2023. Two reviewers independently screened each abstract using standardized eligibility criteria to identify articles for full-text review.

We excluded articles that did not use CG-CAHPS (n = 66), only concerned the measurement properties of CAHPS surveys (n = 24), used CG-CAHPS but not as an outcome (n = 21), were not conducted in the United States (n = 10), involved only pediatric care (n = 4), were a literature review (n = 5), were before 2007 (n = 2), or were not empirical studies (ie, commentaries) (n = 14).

Data Abstraction and Quality Assessment

One reviewer reviewed and abstracted each article; another reviewed the abstracted information to ensure accuracy. Abstracted information included the study's objective, use of CG-CAHPS, study design and type, statistical methods, and main findings.¹⁶

Most of the articles were cross-sectional, so we used the Joanna Briggs Institute (JBI) Checklist for Analytical Cross-Sectional Studies to assess study quality and risk of bias. We also excluded 12 studies because they did not possess at least 6 of the 8 JBI-Critical Appraisal Tool Checklist elements. These 12 studies reported information about exposure and outcomes but did not describe information on sample selection or did not control for confounding factors.

We grouped articles by study type (eg, intervention, association), by CG-CAHPS measure(s), and by statistical significance found (P-values < .05). We also reviewed them by year published.

Results

This search identified 210 unique articles. Following screening and full-text review, we included 52 in our synthesis. The methods, population, measures, and main topic for each included study are described elsewhere.¹⁶ Most studies (27 of 52) involved primary care settings (either general populations, people with diabetes, or Medicare beneficiaries). Since 2012, an average of 5 studies have been published annually, 2 to 9 each year.

Overall provider rating (n = 42 studies) and the provider communication composite (n = 41) were the most commonly used CG-CAHPS measures. Access measures were also used often (n = 22), as were the global recommendation (n = 17), office staff courteousness (n = 12), and PCMH items (n = 9).

Many studies used CG-CAHPS data to assess the impact of interventions (n = 24 studies) or identify associations between patient experience and factors of interest (n = 21 studies). Six studies compared subgroups, and 1 conducted external benchmarking. Table 1 presents studies using CG-CAHPS data grouped by setting.

Table 1.

Included Studies’ Main Use of CG-CAHPS Survey by CG-CAHPS Measure and Grouped by Setting.

Use of CG- CAHPS	Overall provider rating (N = 42)	Would recommend (N = 17)	Provider communication (N = 41)	Access (N = 22)	Care coordination (N = 7)	Follow-up on test results (N = 6)	Courteous, office staff (N = 12)	PCMH item set (N = 9)	Other CAHPS items (N = 3)
Impact of Intervention (N = 24)	Primary & Specialty Care: Fareed 2022^*V Hays 2022^6 Primary Care:* Behl-Chadha 2017^12 Dale 2016^12 De Leon 2012^V DiCapua 2017^12 Dorr 2016^12 Kern 2013^12 Nembhard 2012^V Quigley 2021^V Quigley 2023a^V Sarinopoulos 2017^6 Setodji 2017^V Swankoski 2017^12 Swankoski 2018^12 Ortho/Neuro: Bernstein 2019^V Bernstein 2023^V Oladeru 2017^V Zakare-Fagbamila 2019^*6 Rheumatology:* Honomichl 2020^**12	Primary & Specialty Care: Fareed 2022^*V Hays 2022^6 Primary Care:* De Leon 2012^V DiCapua 2017^12 Nembhard 2012^V Setodji 2017^V Ortho/Neuro: Bernstein 2019^V Oladeru 2017^V Rheumatology: Honomichl 2020^**12	Primary & Specialty Care: Boissy 2016^V Fareed 2022^V Hays 2022^*6 Primary Care:* Behl-Chadha 2017^12 Dale 2016^12 De Leon 2012^V Di Capua 2017^12 Dorr 2016^12 Kern 2013^12 Nembhard 2012^V Quigley 2021^V Quigley 2023a^v Sarinopoulos 2017^6 Setodji 2017^V Spiegel 2023^V Swankoski 2017^12 Swankoski 2018^*12 Ortho/Neuro:* Bernstein 2019^V Bernstein 2023^V Oladeru 2017^V Zakare-Fagbamila 2019^**6	Primary & Specialty Care: Fareed 2022^*V Hays 2022^6 Primary Care:* Behl-Chadha 2017^12 Dale 2016^12 De Leon 2012^V Di Capua 2017^12 Dorr 2016^12 Kern 2013^12 Lin 2020^12 Nembhard 2012^V Nembhard 2020^6 Sarinopoulos 2017^6 Setodji 2017^V Swankoski 2017^12 Swankoski 2018^*12	Primary & Specialty Care: Fareed 2022^*V Hays 2022^6 Primary Care:* Di Capua 2017^*12 Dorr 2016^12 Nembhard 2020^*6 Sarinopoulos 2017^*6	Primary Care: Behl-Chadha 2017^12 De Leon 2012^V Dorr 2016^12 Kern 2013^12 Setodji 2017^*V	Primary & Specialty Care: Fareed 2022^*V Hays 2022^6 Primary Care:* Behl-Chadha 2017^12 Di Capua 2017^12 Dorr 2016^12 Kern 2013^12 Nembhard 2012^V Setodji 2017^*V	Primary Care: Behl-Chadha 2017^12 Dale 2016^12 Dorr 2016^12 Kern 2013^12 Nembhard 2020^6 Sarinopoulos 2017^6 Swankoski 2017^12 Swankoski 2018^*12	Ortho/Neuro: Bernstein 2019^**V : Talked with provider about problems or concerns
Associations to Patient Experience (N = 21)	Primary & Specialty Care : Chaitoff 2017^12V Bosko 2016^1V Quigley 2014^*12 Primary Care* : Chung 2020^*6 Hasnain 2013^12 Willard-Grace 2021^**6 Ophthalmology:* Han 2021^*V Ortho/Neuro:* Hageman 2015^12 Johnson 2019^V Khan 2021^12 Lanz 2018^V Lapin 2019^V Matar 2021^6 Rabah 2021a^12 Rabah 2021b^12 Zakare-Fagbamila 2020^**6	Primary Care : Hasnain 2013^12 Willard-Grace 2021^6 Ortho/Neuro:* Hageman 2015^12 Johnson 2019^V Khan 2021^12 Lanz 2018^V Lapin 2019^**V	Primary & Specialty Care : Chaitoff 2017^12V Quigley 2014^12 Primary Care : Bauer 2014^*12 Chung 2020^6 Hasnain 2013^12 Lee 2020^12 Lin 2017^12 Ratanawongsa 2013^12 Willard-Grace 2021^6 Ortho/Neuro:* Hageman 2015^12 Khan 2021^12 Lanz 2018^V Lapin 2019^V Zakare-Fagbamila 2020^***6	Primary Care : Chung 2020^*6 Hasnain 2013^12 Nembhard 2015^*V Ortho/Neuro:* Khan 2021^12 Zakare-Fagbamila 2020^*6		Primary Care : Nembhard 2015^**V	Primary Care : Hasnain 2013^**12		Primary Care : Bauer 2014^*12 : Shared decision making (SDM) score Hasnain 2013^12: SDM and provider interactions
Comparison of Subgroups (N = 6)	Primary Care : Kippenbrock 2019^12 Prasad 2021^6 Quigley 2023b^v Ortho/Neuro:* Agarwal 2019^*v Dermatology:* Cheng 2022^***12	Ortho/Neuro: Agarwal 2019^**v	Primary Care : Carvajal 2014^12 Kippenbrock 2019^12 Prasad 2021^*6 Quigley 2023b^v Ortho/Neuro: Agarwal 2019^*v Dermatology:* Cheng 2022^***12	Primary Care : Carvajal 2014^12 Prasad 2021^*6	Prasad 2021^***6		Primary Care : Carvajal 2014^12 Prasad 2021^*6	Primary Care : Prasad 2021***
External Benchmarking (N = 1)	Oncology : Kim 2021^***6

Note: *CG-CAHPS Version 1.0, **CG-CAHPS Version 2.0, ***CG-CAHPS Version 3.0 and ^V indicates visit survey,⁶ indicates 6-month reference period and¹² indicates 12-month reference period.

The composite measures differ between CG-CAHPS version 2.0 and 3.0 in the following ways:

• Provider Communication—Version 3.0 contains a 4-item subset of the 6 items on Version 2.0.

• Getting Timely Appointments, Care, and Information—Version 3.0 contains a subset of the items on Version 2.0.

• Providers’ Use of Information to Coordinate Patient Care—new composite for Version 3.0 that includes an item in the Version 2.0 provider communication composite and includes the previous single item on Follow-up on Test Results.

• Helpful, Courteous, and Respectful Office Staff—identical in Versions 2.0 and 3.0.

• Follow-up on Test Results—identical in Versions 2.0 (as a single item measure) and 3.0 (included in care coordination composite).

• Overall Rating of the Provider—identical in Versions 2.0 and 3.0.

Associations of Interventions With Changes in CG-CAHPS Measures

Twenty-four studies used CG-CAHPS data to assess improvement in patient experience following an intervention. Table 2 summarizes these intervention studies and the extent to which the interventions were associated with improvements. We highlight several patterns, using bold text to highlight the evaluated interventions.

Table 2.

Impact of Interventions on CG-CAHPS Measures, by Type of Ambulatory Care and Intervention (n = 24 Studies).

Author, Year	Intervention	Overall provider rating	Would recommend	Provider communication	Access	Care coordination	Follow-up on test results	Courteous office staff	PCMH item set	Other CAHPS items
Primary and Specialty Care
Boissy 2016	Communication training			↑
Hays 2022	Telehealth during COVID-19	↑	↑	↑	↑	↑		↑
Fareed 2022	Patient portal activation	↔	↔	↑	↔	↑		↔
Primary Care (PC)
Di Capua 2017	Care coordination	↔	↔	↔	↔	↓		↑
De Leon 2012	EHR implementation	↔	↓	M (see NOTE)	M		↔			↔K
Behl-Chadha 2017	PCMH for homeless patients	↔	↓	↓	↓		↔	↓	M:↑(+,%), ↔&
Dorr 2016	Received PCMH coaching and used PCMH-QI strategies	↑		↔	↓	↔	↑	↔	↔ (+,%)
Kern 2013	PCMH implementation	↔		M : ↔ with ↑S	↑		↔	M :↔ with ↑H	↔ (+,%)
Sarinopoulos 2017	PCMH type (multipayer/PCMH/not PCMH)	↔		M:↑multipayer, ↔ PCMH	↑	↑			↑(+,%)
Spiegel 2023	CDS versus patient education (PE)			↑ PE
Nembhard 2012	Quality collaborative focused on quality-oriented climate	↑	↔	↔	↓			↑
PC in Federally Qualified Health Centers
Nembhard 2020	Care coordination				↔	↔			↔%
Quigley 2021	Shadow coaching	↑		↑
Quigley 2023a	Follow-up shadow coaching	↑		↑
Setodji 2017	PCMH with high use of chronic care management	↑	↔	↑	↓		↔	↓
PC for Medicare Beneficiaries
Dale 2016	Comprehensive Primary Care	↔		↔	↔				M:↑ (+,%),↔$
Lin 2020	Access interventions^∼ in CPC				↔
Swankoski 2017	Comprehensive Primary Care	↔		↔	↑				M:↑(+,%),↔$
Swankoski 2018	Comprehensive Primary Care	↔		↔	↔				↔ (+,%)
Ortho/Neuro
Bernstein 2019	Use of PROM assessment	↑	↑	M :↔ with ↑S						↔*
Bernstein 2023	Use and discuss PROM	↔		M :↔ with ↑E
Oladeru 2017	Communication training	↔	↔	↔
Zakare-Fagbamila 2019	Use of real-time feedback	↔		↔
Rheumatology
Honomichl 2020	PROM implementation	↔	↔

Note: We annotate significance on CAHPS measures using ↑ to indicate statistically significant improvements (P < .05); ↓ to indicate statistically significant decline/worsening (P < .05); ↔ to indicate no statistical significance found; and M for results that were both positive and negative within the composite measure (ie, mixed). CDS indicates physician-directed clinical decision support. Some of the research reported out by item. For provider communication items, E indicates Explained things, S indicates Spent enough time. H indicates aspect of office staff composite about Office staff is helpful. + indicates PCMH item about Self-management support. % indicates PCMH item about Provider paid attention to mental or emotional health. & indicates PCMH item about Provider discussed medication decisions. $ indicates PCMH item about Informed about care from other providers. * study used CAHPS item about Talked with provider about problems or concerns. For De Leon 2012, Provider Communication was mixed with ↓ in provider communication item about Listened carefully, ↔ for provider communication item about Explained things, ↓ in provider communication item about Spent enough time and ↓ in provider communication item Gave easy to understand information and also Access was mixed with. ↓ in access item about Got appointment for non-urgent care when needed, ↔ for access item about Got appointment for urgent care when needed; ↓ in access item about Got answers to medical questions same day; ↔ for access item about Got answers to medical questions after hours, and ↔ for access item about Seen within 15 min. ^∼ indicates interventions designed to enhance access of extended hours, flexible appointments, after-hours coverage, email, home visits, group visits, web visits, text messages, and telemedicine in CPC clinics (See Linn 2020).

Interventions that Improved Overall Provider Rating. Seven interventions were associated with statistically significant improvement in overall provider rating. One of these 7 studies was also related to improving all aspects of the measured patient experience. That intervention was tele-video visits during the COVID-19 pandemic for primary and specialty care, which had higher overall provider ratings than phone or office visits.²¹ Two other interventions—coaching and follow-up coaching—improved overall provider rating and provider communication scores. Specifically, medium-performing Federally Qualified Health Center (FQHC) providers saw increases in overall provider rating and provider communication scores after receiving peer shadow coaching²²; coaching improved care experiences primarily for English-preferring patients.²³ Also, follow-up coaching sessions improved patient experience even further.²⁴ Such gains eroded over time, implying that coaching should recur every 6 to 12 months.^22,24

Four interventions (of the 7) had statistically significant improvements in adjusted mean overall provider rating but mixed results on other measures. Primary care sites that joined QI collaboratives (such as Leading a Culture of Quality Action Group²⁵) focused on improving quality-oriented climate saw an increase in their overall provider rating and a decrease in access scores.²⁶ Primary care sites that received monthly coaching from a third-party PCMH liaison to encourage and monitor progress on PCMH goals and used PCMH-specific QI strategies saw an improvement in top-box scores (a summary measure of positive responses) for overall provider rating and in follow-up on test results scores, but a decrease in access scores.²⁷ PCMH sites with more activities related to chronic care management had more significant adjusted increases in mean overall provider rating but worsening scores for access and no change in patient recommendation of provider to friends and family.²⁸ Outpatient orthopedic or neurology surgery patients who received a Patient-Reported Outcomes Measurement Information System (PROMIS^®) assessment during routine care gave higher overall provider ratings, were more likely to recommend the office, and indicated they spent more time with their providers; other aspects of provider communication were similar whether a patient received the assessment (or not).²⁹ The PROMIS measures are patient self-reports of physical, mental, and social health.

Furthermore, there was no significant difference in overall provider rating for several interventions. These were a primary care homeless patient PCMH program³⁰; comprehensive primary care model^31,32; various comparisons of PCMH status³³; electronic health record implementation³⁴; outpatient patient portal activation³⁵; coordinated care with an additional coordinator to improve care for the most complex patients³⁶; resident communication training for orthopedic/neurology outpatient care³⁷; real-time provider feedback using the Clinic Satisfaction Tool (CST)³⁸; and, for rheumatology outpatient care, implementation of patient-reported outcomes measures (PROMs).³⁹

PCMH Interventions that Improved CG-CAHPS Measures. Nine studies^{27,28,30–34,40,41} evaluated the effect of PCMH on patient experience. Of these, 3 PCMH studies^33,34,40 showed improvements in access scores; 1³³ also showed improvements in care coordination scores, and the other 2^34,40 found no significant differences in other CG-CAHPS measures. Three other PCMH studies found significantly lower access scores: for homeless patients in a PCMH clinic program (compared to patients with non-PCMH primary care),³⁰ or for PCMH sites who added a care coordinator and had high use of chronic care management.^27,28 Of the remaining 3 PCMH studies, 1 found no significant difference-in-differences for PCMH (relative to other practices) regarding access incentives³¹; a second found no significant differences in access (or provider communication) scores for PCMH clinics (compared to matched non-PCMH clinics)³²; and the third found no significant differences in access scores in comprehensive primary care (CPC) clinics from several interventions, including extended hours, flexible appointments, after-hours coverage, email, home visits, group visits, web visits, text messages, and telemedicine.⁴¹

Three PCMH-studies found improvements in self-management support and comprehensiveness (ie, attention to mental and emotional health) measures,^30,33,34 but 4 did not^27,31,32,40; 1 PCMH-study did not include this measure. None found differences in the CG-CAHPS PCMH item regarding whether providers were informed about care from other providers.

Care Coordination Interventions that Improved CG-CAHPS Measures. Care coordination interventions (2 studies) had mixed results. One study found significant worsening on the care coordination composite in sites that added care coordinators to improve care for the most complex patients.³⁶ The other study, which added care coordination to nurses’ roles, showed no significant changes in care coordination scores or in the other outcomes measured (ie, access and provider attention to mental or emotional health).⁴²

Provider Communication Interventions that Improved CG-CAHPS Measures. Regarding provider communication interventions, only experiential relationship-centered communication skills training for primary and specialty care providers⁴³ and peer shadow coaching (and re-coaching) for primary care providers^22,24 resulted in significant improvements in provider communication scores. Resident communication training and use of the CST data to provide real-time feedback (within 24 hours of an encounter) to providers on provider–patient interactions within orthopedic/neurology clinics were not associated with changes in provider communication scores.^37,38

Patient Engagement Interventions that Improved CG-CAHPS Measures. Two strategies were studied to increase patient engagement in care. One study provided patients with an outpatient patient portal, providing 24/7 access to communicate with their providers and manage their healthcare; patient portal activation improved provider communication and care coordination scores but did not improve the overall provider rating, office recommendation, access, or office staff scores.³⁵ The dimensions of patient experience that were not improved by activated patient portal status were those that the study authors indicated were unlikely to be related to patient portal use, such as better experiences with office staff (ie, office staff courteousness scores).

The other study of patient engagement compared 2 strategies commonly used to promote appropriate opioid use for chronic pain and found that patient-directed education was more likely than physician-directed clinical decision support (via electronic health record) to be associated with better patient–provider communication scores.⁴⁴

PROMs Interventions that Improved CG-CAHPS Measures. Regarding PROMs, 2 studies found improvements with the use and discussion of PROM information by providers in the patient-provider encounter.^29,45 One study found that the use and discussion of PROM information by providers in the patient–provider encounter significantly increased the time providers spent talking about concerns during routine care for orthopedic/neurology patients.²⁹ The second study found that the use and discussion of PROM assessments by providers in the patient–provider encounter of physical function, pain interference, and depression for new outpatient orthopedic foot and ankle surgery patients reported worse experiences with surgeons explaining things in a way that was easy to understand; however, the overall provider rating and the other aspects of provider communication measured were similar to patients whose provider did not use or discuss PROMs.⁴⁵ A third study³⁹ found no effect from the use of PROM assessments.

Cross-sectional Associations With CAHPS Measures

Twenty-one studies examined relationships of patient experience with other variables, including patient-, provider-, and site-level factors. Additionally, 1 study examined associations with survey mode⁴⁶ and several others examined which CAHPS measures are most correlated with the overall provider rating.^46–49

Table 3 summarizes the 21 cross-sectional studies and the statistical associations with patient experience by CG-CAHPS measures used. We review the findings of the cross-sectional associations by site-level, provider-level, and patient-level factors, using bold text to identify the examined factor.

Table 3.

CG-CAHPS Measures Used in Association Studies, by Type of Ambulatory Care (n = 21 Studies).

Author, Year	Association with patient experience	Overall provider rating	Would recommend	Provider communication	Access	Follow-up on test results	Courteous office staff	Other CAHPS items
Primary and Specialty Care
Bosko 2016	Clinical quality performance	M
Chaitoff 2017	Provider empathy	M		M
Quigley 2014	Provider specialty	↑		↑
Primary Care (PC)
Chung 2020	Provider burnout	↔		↓-inverse	↔
Hasnain 2013	Acculturation/Hispanic ethnicity	M	M	M	M		M	M: SDM, PI
Nembhard 2015	Organizational climate				M	M
Willard-Grace 2021	Provider burnout & engagement	M	M	M
PC in Federally Qualified Health Centers
Lee 2020	PCP-team communication and chronic disease management			↑
Lin 2017	Received colorectal screening			↔
Primary Care for Adult Diabetes Patients
Bauer 2014	Antidepressant adherence			M				M:SDM
Ratanawongsa 2013	Cardiometabolic medication refill adherence			↑
Ophthalmology
Han 2021	Patient demographics, visual acuity and appointment factors	M
Ortho/Neuro
Hageman 2015	Coworker feedback on awareness of impact on others	↑	↑	M
Johnson 2019	Patient demographics and survey mode	M	M
Khan 2021	Preoperative depression for patients after lumbar surgery	↓-inverse	↓-inverse	M	↔
Lanz 2018	Emotional stability	↑	↑	↔
Lapin 2019	Patient reported outcome measures (PROMs)	↑	↑	↑
Matar 2021	Pre-operative/surgical factors	↔
Rabah 2021a	Lumbar postoperative outcomes	M
Rabah 2021b	Provider communication	↑		↑
Zakare-Fagbamila 2020	Clinic performance metrics (eg, waiting-room times)	M		M	M

Note: In some studies, we can also annotate significance on CAHPS measures using ↑ to indicate positive statistically significant associations (P < .05); ↓ to indicate negative statistically significant associations (P < .05); ↔ to indicate no statistical significance found; and M for results that were both positive and negative within the composite measure (ie, mixed). SDM indicates the shared decision-making item about involvement in decisions. PI indicates items about provider interactions.

Site-level factors associated with CAHPS Measures. Four studies examined site-level factors. Leader-reported quality-oriented organizational climate (rather than reported by frontline staff) was negatively associated with getting an appointment for care when needed and having someone from the office follow up and give test results; staff-reported quality-oriented organizational climate (rather than reported by leaders) was positively associated with timely access scores and the measure of having someone follow up and give test results.⁵⁰ Better primary care practice team communication and chronic disease management were associated with better patient–provider communication scores.⁵¹ Co-worker feedback on physician's awareness of their impact on others (ie, co-workers belief that a physician understands how his/her behaviors impact others) were positively associated with overall provider rating and would recommend provider, as well as with provider communication measures of showed respect and explained things.⁵² Less waiting room time and higher clinic-level patient volume (ie, clinic monthly total visits) were associated with better overall provider rating, and access and provider communication scores; less in-room wait time was associated only with better access scores (ie, seen within 15 min of appointment time).⁵³

Provider-level factors associated with CG-CAHPS Measures. Seven studies examined provider-level factors. Two of these examined associations between CG-CAHPS measures and provider burnout. One of the burnout articles found provider burnout was negatively associated with provider communication scores.⁵⁴ The other burnout article found that clinicians who had both high burnout and high engagement in the care and treatment of their patients had better provider communication scores, would recommend the office, and overall provider rating scores than clinicians with the 3 other combinations of high/low burnout and high/low engagement in the care and treatment of their patients.⁵⁵ A third study (of the 7 on provider-level factors) on provider empathy found a positive association with overall provider ratings on the CG-CAHPS Visit survey 2.0 and with some provider communication items.⁵⁶ A fourth study investigated associations of orthopedic surgeon's personality traits and found a positive association of surgeon's emotional stability with overall provider rating and would recommend provider, but no association of other surgeon personality traits with overall provider rating and would recommend provider.⁴⁸ A fifth study found that better physician clinical quality performance on 3 Healthcare Effectiveness Data and Information Set (HEDIS) measures were positively associated with overall provider rating.⁴⁹ HEDIS measures assess the percentage of time that the physicians perform a specific action for their patients; for example, the antibiotics measures assess a physician's appropriate antibiotic prescribing for 3 targeted clinical diagnoses: bronchitis, upper respiratory infection, and pharyngitis. The sixth study in a community health center found no association between provider communication scores and whether patients had received colorectal cancer screening.⁵⁷

The seventh study found that for 23 out of 28 provider ambulatory care specialties showing respect was most strongly related to overall provider rating among all CAHPS communication items, and explained things was the least correlated of the communication items.⁵⁸ However, the importance of specific aspects of communication varied significantly by specialty. For example, spending enough time had the highest correlation to the overall provider rating for interventional radiology, giving easy-to-understand information had the highest correlation to the overall provider rating for geriatric medicine and pulmonary disease, and showing respect had the highest correlation to the overall provider rating for plastic surgery.

Patient-level factors associated with CAHPS Measures. Ten studies examined patient-level factors across several care settings.

Three primary care studies were conducted in a community health center primary care setting, and 2 were specific to diabetic patients. For general primary care, the degree of acculturation for Hispanic patients had mixed associations with the patient's primary care experience.⁵⁹ The authors found that unacculturated Hispanic patients reported higher scores for overall provider rating, would recommend provider, office staff courteousness, and shared decision-making, whereas bi-cultural Hispanic patients reported higher scores for office staff courteousness and shared decision-making. Neither Hispanic identity was associated with provider communication, access, and supplemental items about provider interactions.

Two studies examined the medication adherence of diabetic patients. One found that antidepressant adherence levels had mixed associations with provider communication and shared decision-making scores.⁶⁰ Specifically, early non-persistence and primary non-adherence for diabetic patients were associated with lower involvement with shared decision-making but not with provider communication scores. The other study found that refill adherence to cardiometabolic medication was positively associated with improved provider communication scores for diabetic patients.⁶¹

Four studies examined patients who had lumbar surgery. Pre-operative and surgical factors for lumbar surgery patients such as patient diagnosis, location of surgery (ie, Level I office surgery where anesthesia is local, topical, or none conducted in exam room; or Level III surgery which requires use of a general anesthesia), and discharge disposition were not associated with differences in overall provider ratings.⁶² Pre-operative depression among lumbar surgery patients was not associated with CAHPS access scores.⁶³ However, 1 study (and an associated commentary)⁶⁴ found lower back pain after 1 year post-operation was associated with better overall provider rating, but not with patient-reported general physical or mental health.⁶⁵ Lastly, 1 outpatient spine surgery study examined associations of nonmodifiable demographic factors and insurance with patient experience.⁴⁶

For spine surgeons in the outpatient setting, 1 study also examined the relationship between overall rating and aspects of provider communication to identify the specific “drivers” of patient overall rating⁴⁷; they found more positive overall provider rating was most associated with when the spine surgeon showed respect and least associated with having spent enough time and giving easy-to-understand information.

One study found that better patient self-reported PROM scores were associated with better overall provider rating, would recommend, and provider communication items in outpatient care in neurology clinics.⁶⁶

For ophthalmology, appointment characteristics such as being seen in optometry clinic (vs in a Comprehensive, Cornea, and Glaucoma clinic), having orders (or not) of different types placed for each visit such as a procedure order, surgery order, refraction order, or eye testing order, and patient factors such as higher overall appointment attendance, being a new patient, or having high corrected visual acuity were positively associated with overall provider rating.⁶⁷

Assessment of Subgroups Using CG-CAHPS Measures

Six studies used CG-CAHPS measures to assess differences by subgroups. Four of these studies found significant subgroup differences. At the site level, ambulatory clinics associated with teaching hospitals had better access scores than non-teaching hospitals but did not differ in provider communication and office staff courteousness scores.⁶⁸ At the provider level, a national study of primary care providers found that Doctors of osteopathic medicine and nurse practitioners had better overall provider ratings and provider communication scores than medical doctors (MD) and physician assistants (PA).^69,70 Also, cranial surgeons (vs spinal surgeons) had better-unadjusted top-box scores for overall provider rating, would recommend provider, and provider communication scores, and reported significantly better scores on showed respect and listened carefully.⁷¹ At the patient level, adult patients with acne (vs not) had significantly worse adjusted top-box scores for the provider listened carefully, explained things, and spent enough time.^69,70

There were no differences by provider–patient gender concordance in adjusted overall provider rating and adjusted scores measuring provider communication, access, care coordination, office staff courteousness, and PCMH-items about self-management support, got information about needed care on evenings/weekends/holidays, and informed about care from specialists.⁷²

CG-CAHPS Measures and External Benchmarking

One study conducted external benchmarking. Kim et al 2021⁷³ identified differences in the overall provider rating of the same provider, whether measured by CAHPS versus external physician-review websites for outpatient visits with oncology physicians; the ratings were higher for CAHPS measures.

Supplemental Table 1 provides detailed study findings for each CG-CAHPS measure and rating (see Supplemental Digital Content 2).

Discussion

This review builds on a previous systematic review, which documented the types of studies that used CG-CAHPS survey data since its inception but did not review study findings. It systematically examines the evidence on which factors are significantly associated with CG-CAHPS measures and which interventions significantly changed CG-CAHPS measures as outcomes. We identified several interventions and site-level or provider-level factors that practice leaders can implement as strategies to improve patient experience measured by CG-CAHPS.

Interventions that significantly improved the CG-CAHPS overall provider rating included participation in QI collaboratives focused on improving quality-oriented climate, implementing PCMH-specific QI strategies, increased chronic care management activities, using peer shadow coaching for providers, offering tele-video visits as an encounter option (other than office or phone visits), and performing PROMIS^® assessments during routine care. Experiential relationship-centered communication skills training and peer shadow coaching significantly improved provider communication. PCMH interventions, use and discussion of patient-reported outcomes during an encounter, and care coordination interventions had mixed improvements on patient experience.

Site-level factors associated with better patient experience included better team communication. Better primary care practice team communication and increased chronic disease management activities were associated with better provider communication. Co-worker feedback on physicians’ awareness of their impact on others was associated with a higher overall provider rating, and the provider showed respect and explained things. Less in-room wait time was associated with better access scores. Less waiting room time and higher clinic-level patient volume (ie, clinic monthly total visits) were associated with better overall provider rating, access, and communication. Provider-level factors associated with better patient experience included more empathy and emotional stability. More physician empathy was associated with better provider communication, whereas the emotional stability of orthopedic surgeons was associated with higher provider ratings. Better physician performance on clinical quality measures was associated with better overall provider ratings. Provider burnout had mixed associations with patient experience and may be mediated by provider engagement in the care and treatment of their patients.

Our search focused on peer-reviewed literature with adequate study quality since we were interested in studies with broad generalizability. This approach excluded non-peer-reviewed work, such as foundation reports, single-case evaluation of QI, and other healthcare-driven patient-centered initiatives, since they are hard to publish in peer-reviewed journals but often contain helpful lessons. Future work that includes a grey literature review identifying and describing existing QI strategies for rural or small practices may help the field, as would work summarizing the evidence for interventions targeting specific CG-CAHPS domains or item sets.

This examination of research evidence using CG-CAHPS data has several implications. CG-CAHPS survey data have been consistently and widely used in research as valid measures of patient experiences of ambulatory care to assess overall care and specific aspects of care. CG-CAHPS measures are related to and reflect site changes and provider-level and patient-level factors. Importantly, CG-CAHPS measures are sensitive to changes in outcomes and associations across a wide range of ambulatory settings, including general primary and specialty care, care at community health centers (ie, FQHCs), primary care specific to diabetic patients, primary care for Medicare beneficiaries, outpatient care for orthopedic, spine and neurological surgical patients and multiple specialties (eg, Ophthalmology, Rheumatology, Dermatology). Despite this, CG-CAHPS surveys are not required by the Centers for Medicare and Medicaid Services (CMS) for performance-based payment adjustments to clinicians’ Medicare payments; however, the CMS Merit-based Incentive Payment System (MIPS) uses the CAHPS for MIPS survey, which includes the 10 core CG-CAHPS measures, as an optional quality measure. This evidence review demonstrates the broad use of CG-CAHPS survey data for measuring patient experience of ambulatory care.

Our review has limitations. First, we found inconsistent use of the same specific metrics of patient experience across the studies. There was heterogeneity across study settings (ie, about half of the studies took place in primary care settings [27 of 52]), selected outcome measures of patient experience (ie, overall provider rating was in 42 of 52 studies, whereas access scores were in 22 of 52 studies), and calculation of measure scores (ie, some studies calculated case mix adjusted mean scores while others used top-box scores), restricting our ability to perform a meta-analysis. We also by design limited our review to studies using patient's quantitative assessment of their experience using the CG-CAHPS survey data and did not include studies assessing the use of the open-ended narrative text responses from the CG-CAHPS survey, as we were assessing evidence from interventions and associations using CG-CAHPS. We have published on the potential use of CG-CAHPS open-ended responses for QI.⁷⁴ However, qualitative studies based on narrative text responses are not appropriate for understanding significant improvements related to an intervention or for assessing associated factors or directionality of findings with aspects of patient experience. Our review, however, highlighted possible interventions and factors that merit more attention based on studies using CG-CAHPS scores.

Conclusion

Since its release in 2007, the CG-CAHPS survey has been used by healthcare providers to assess a wide range of pre-post interventional changes in global ratings. CG-CAHPS data is also widely used to understand important cross-sectional relationships with patient experience of care at the site, provider, and patient levels, in addition to assessing differences across patient and provider groups. Our review identified several promising interventions and site-level or provider-level factors that practice leaders can implement to improve patient experience. Policymakers, researchers, clinicians, and healthcare leaders can leverage this evidence for QI efforts and selecting interventions that support patient-centered care.

Supplemental Material

sj-docx-1-jpx-10.1177_23743735241283204 - Supplemental material for Associations of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey Scores with Interventions and Site, Provider, and Patient Factors: A Systematic Review of the Evidence

Supplemental material, sj-docx-1-jpx-10.1177_23743735241283204 for Associations of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey Scores with Interventions and Site, Provider, and Patient Factors: A Systematic Review of the Evidence by Denise D. Quigley, Marc N. Elliott, Nabeel Qureshi, Zachary Predmore and Ron D. Hays in Journal of Patient Experience

Supplemental Material

sj-docx-2-jpx-10.1177_23743735241283204 - Supplemental material for Associations of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey Scores with Interventions and Site, Provider, and Patient Factors: A Systematic Review of the Evidence

Supplemental material, sj-docx-2-jpx-10.1177_23743735241283204 for Associations of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey Scores with Interventions and Site, Provider, and Patient Factors: A Systematic Review of the Evidence by Denise D. Quigley, Marc N. Elliott, Nabeel Qureshi, Zachary Predmore and Ron D. Hays in Journal of Patient Experience

Footnotes

Acknowledgements

We acknowledge the time and support of Jody Larkin who assisted with the literature searches conducted in this study and Lynn Polite for her administrative support.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by a cooperative agreement from the Agency for Healthcare and Research Quality (AHRQ) (Contract number U18HS025920, U18HS029321).

ORCID iDs

Denise D. Quigley

Ron D. Hays

Supplemental Material

Supplemental material for this article is available online.

References

Anhang Price

Elliott

Cleary

Zaslavsky

Hays

. Should health care providers be accountable for patients’ care experiences? J Gen Intern Med. 2015;30(2):253-6. doi:https://doi.org/10.1007/s11606-014-3111-7.

Dyer

Sorra

Smith

Cleary

Hays

. Psychometric properties of the consumer assessment of healthcare providers and systems (CAHPS(r)) clinician and group adult visit survey. Med Care. 2012;50(Suppl):S28-34. doi:https://doi.org/10.1097/MLR.0b013e31826cbc0d.

Solomon

Hays

Zaslavsky

Ding

Cleary

. Psychometric properties of a group-level consumer assessment of health plans study (CAHPS) instrument. Med Care. 2005;43(1):53-60.

Drake

Hargraves

Lloyd

Gallagher

Cleary

. The effect of response scale, administration mode, and format on responses to the CAHPS clinician and group survey. Health Serv Res. 2014;49(4):1387-99. doi:https://doi.org/10.1111/1475-6773.12160.

Hargraves

Cosenza

Elliott

Cleary

. The effect of different sampling and recall periods in the CAHPS clinician & group (CG-CAHPS) survey. Health Serv Res. 2019;54(5):1036-44. doi:https://doi.org/10.1111/1475-6773.13173.

Mukherjee

Rodriguez

Elliott

Crane

. Modern psychometric methods for estimating physician performance on the clinician and group CAHPS® survey. Health Serv Outcomes Res Methodol. 2013;13:109-23. doi:https://doi.org/10.1007/s10742-013-0111-8.

Setodji

Burkhart

Hays

Quigley

Skootsky

Elliott

. Differences in consumer assessment of healthcare providers and systems clinician and group survey scores by recency of the last visit: implications for comparability of periodic and continuous sampling. Med Care. 2019;57(12):e80-6. doi:https://doi.org/10.1097/MLR.0000000000001134.

Anastario

Rodriguez

Gallagher

, et al. A randomized trial comparing mail versus in-office distribution of the CAHPS clinician and group survey. Health Serv Res. 2010;45(5Pt 1):1345-59. doi:https://doi.org/10.1111/j.1475-6773.2010.01129.x.

Bergeson

Gray

Ehrmantraut

Laibson

Hays

. Comparing web-based with mail survey administration of the consumer assessment of healthcare providers and systems (CAHPS) clinician and group survey. Primary Health Care : Open Access. 2013;3, doi:https://doi.org/10.4172/2167-1079.1000132.

10.

Fowler

Jr Cosenza

Cripps

Edgman-Levitan

Cleary

PD.

The effect of administration mode on CAHPS survey response rates and results: a comparison of mail and web-based approaches. Health Serv Res. 2019;54(3):714-21. doi:https://doi.org/10.1111/1475-6773.13109.

11.

Scholle

Vuong

Ding

, et al. Development of and field test results for the CAHPS PCMH survey. Med Care. 2012;50(Suppl):S2-10. doi:https://doi.org/10.1097/MLR.0b013e3182610aba.

12.

Weidmer

Cleary

Keller

, et al. Development and evaluation of the CAHPS (consumer assessment of healthcare providers and systems) survey for in-center hemodialysis patients. Am J Kidney Dis. 2014;64(5):753-60. doi:https://doi.org/10.1053/j.ajkd.2014.04.021.

13.

McInnes

Brown

Hays

, et al. Development and assessment of CAHPS questions to assess the impact of health information technology on patient experiences with care. Med Care. 2012;50:S11-19. doi:https://doi.org/10.1097/MLR.0b013e3182610a50.

14.

Weech-Maldonado

Carle

Weidmer

Hurtado

Ngo-Metzger

Hays

RD.

The consumer assessment of healthcare providers and systems (CAHPS) cultural competence (cc) item set. Med Care. 2012;50(9 Suppl 2):S22-31. doi:https://doi.org/10.1097/MLR.0b013e318263134b.

15.

Schlesinger

Grob

Shaller

, et al. A rigorous approach to large-scale elicitation and analysis of patient narratives. Med Care Res Rev. 2020;77(5):416-27. doi:https://doi.org/10.1177/1077558718803859.

16.

Quigley

Elliott

Qureshi

Predmore

Hays

. How the CAHPS clinician and group patient experience survey data have been used in research: a systematic review. J Patient Cent Res Rev. 2024;11(2):88-96.

17.

Liberati

Altman

Tetzlaff

, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100. doi:https://doi.org/10.1371/journal.pmed.1000100.

18.

Moher

Liberati

Tetzlaff

Altman

Group

. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi:https://doi.org/10.1371/journal.pmed.1000097.

19.

Page

McKenzie

Bossuyt

, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Rev Esp Cardiol (Engl Ed). 2021;74(9):790-9. Declaracion PRISMA 2020: una guia actualizada para la publicacion de revisiones sistematicas. doi:https://doi.org/10.1016/j.rec.2021.07.010.

20.

Page

Moher

Bossuyt

, et al. PRISMA 2020 Explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. Br Med J. 2021;372:n160. doi:https://doi.org/10.1136/bmj.n160.

21.

Hays

Skootsky

. Patient experience with in-person and telehealth visits before and during the COVID-19 pandemic at a large integrated health system in the United States. J Gen Intern Med. 2022;37(4):847-52. doi:https://doi.org/10.1007/s11606-021-07196-4.

22.

Quigley

Elliott

Slaughter

, et al. Shadow coaching improves patient experience with care, but gains erode later. Med Care. 2021;59(11):950-60.

23.

Quigley

Elliott

Slaughter

Talamantes

Hays

RD.

Shadow coaching improves patient experience for English-preferring patients but not for Spanish-preferring patients. J Gen Intern Med. 2023b. doi:https://doi.org/10.1007/s11606-023-08045-2.

24.

Quigley

Elliott

Slaughter

Talamantes

Hays

. Follow-up shadow coaching improves primary care provider-patient interactions and maintains improvements when conducted regularly: a spline model analysis. J Gen Intern Med. 2023a;38(1):221-7. doi:https://doi.org/10.1007/s11606-022-07881-y.

25.

Institute for Clinical Systems Improvement. Annual report 2004: Quality in action across Minnesota. 2004.

26.

Nembhard

Northrup

Shaller

Cleary

PD.

Improving organizational climate for quality and quality of care: does membership in a collaborative help?

Med Care. 2012;50(Suppl):S74-82. doi:https://doi.org/10.1097/MLR.0b013e31826b1087.

27.

Dorr

Anastas

Ramsey

, et al. Effect of a pragmatic, cluster-randomized controlled trial on patient experience with care: the transforming outcomes for patients through medical home evaluation and redesign (TOPMED) study. Med Care. 2016;54(8):745-51. doi:https://doi.org/10.1097/MLR.0000000000000552.

28.

Setodji

Quigley

Elliott

, et al. Patient experiences with care differ with chronic care management in a federally qualified community health center. Popul Health Manag. 2017;20(6):442-8. doi:https://doi.org/10.1089/pop.2017.0003.

29.

Bernstein

Fear

Mesfin

, et al. Patient-reported outcomes use during orthopaedic surgery clinic visits improves the patient experience. Musculoskeletal Care. 2019;17:120-5. doi:https://doi.org/10.1002/msc.1379.

30.

Behl-Chadha

Savageau

Bharel

Gagnon

Lei

Hillerns

. Comparison of patient experience between a practice for homeless patients and other practices engaged in a patient-centered medical home initiative. J Health Care Poor Underserved. 2017;28(3):1151-64. doi:https://doi.org/10.1353/hpu.2017.0103.

31.

Dale

Ghosh

Peikes

, et al. Two-year costs and quality in the comprehensive primary care initiative. N Engl J Med. 2016;374(24):2345-56. doi:https://doi.org/10.1056/NEJMsa1414953.

32.

Swankoski

Peikes

Morrison

, et al. Patient experience during a large primary care practice transformation initiative. Am J Manag Care. 2018;24(12):607-13.

33.

Sarinopoulos

Bechel-Marriott

Malouin

Zhai

Forney

Tanner

. Patient experience with the patient-centered medical home in Michigan's statewide multi-payer demonstration: a cross-sectional study. J Gen Intern Med. 2017;32(11):1202-9. doi:https://doi.org/10.1007/s11606-017-4139-2.

34.

Swankoski

Peikes

Dale

, et al. Patient experience midway through a large primary care practice transformation initiative. Am J Manag Care. 2017;23(3):178-84.

35.

Fareed

MacEwan

Vink

Jonnalagadda

McAlearney

. Relationships between patient portal activation and patient satisfaction scores among CG-CAHPS and HCAHPS respondents. Am J Manag Care. 2022;28(1):25-31. doi:https://doi.org/10.37765/ajmc.2022.88813.

36.

Di Capua

Clarke

Tseng

, et al. The effect of implementing a care coordination program on team dynamics and the patient experience. Am J Manag Care. 2017;23(8):494-500.

37.

Oladeru

Hamadu

Cleary

, et al. House staff communication training and patient experience scores. J Patient Exp. 2017;4(1):28-36. doi:https://doi.org/10.1177/2374373517694533.

38.

Zakare-Fagbamila

Howell

Choi

, et al. Clinic satisfaction tool improves communication and provides real-time feedback. Neurosurgery. 2019;84(4):908-18. doi:https://doi.org/10.1093/neuros/nyy137.

39.

Honomichl

Katzan

Thompson

, et al. The influence of collecting patient-reported outcome measures on visit satisfaction in rheumatology clinics. Rheumatol Adv Pract. 2020;4(2):rkaa046. doi:https://doi.org/10.1093/rap/rkaa046.

40.

Kern

Dhopeshwarkar

Edwards

Kaushal

. Patient experience over time in patient-centered medical homes. Am J Manag Care. 2013;19(5):403-10.

41.

Lin

MacDonald

Jin

Reddy

. Association between care delivery interventions to enhance access and patients’ perceived access in the comprehensive primary care initiative. Healthc (Amst). 2020;8(2):100412. doi:https://doi.org/10.1016/j.hjdsi.2020.100412.

42.

Nembhard

Buta

Lee

YSH

Anderson

Zlateva

Cleary

. A quasi-experiment assessing the six-months effects of a nurse care coordination program on patient care experiences and clinician teamwork in community health centers. BMC Health Serv Res. 2020;20(1):137. doi:https://doi.org/10.1186/s12913-020-4986-0.

43.

Boissy

Windover

Bokar

, et al. Communication skills training for physicians improves patient satisfaction. J Gen Intern Med. 2016;31(7):755-61. doi:https://doi.org/10.1007/s11606-016-3597-2.

44.

Spiegel

BMR

Fuller

Liu

, et al. Cluster-randomized comparative effectiveness trial of physician-directed clinical decision support versus patient-directed education to promote appropriate use of opioids for chronic pain. J Pain. 2023. doi:https://doi.org/10.1016/j.jpain.2023.06.001

45.

Bernstein

Jones

CMC

Flemister

DiGiovanni

Baumhauer

. Does patient-reported outcome measures use at new foot and ankle patient clinic visits improve patient activation, experience, and satisfaction? Foot Ankle Int. 2023;44(6):481-7. doi:https://doi.org/10.1177/10711007231163119.

46.

Johnson

Vasquez-Montes

Steinmetz

, et al. Association between nonmodifiable demographic factors and patient satisfaction scores in spine surgery clinics. Orthopedics. 2019;42(3):143-8. doi:https://doi.org/10.3928/01477447-20190424-05.

47.

Rabah

Khan

Winkelman

Levin

Mroz

Steinmetz

. Key drivers of patient satisfaction with spine surgeons in the outpatient setting. J Neurosurg Spine. 2021b;33:871-8. doi:https://doi.org/10.3171/2020.9.Spine201292.

48.

Lanz

Gregory

Menendez

. Congeniality: understanding the importance of surgeons’ nontechnical skills through 360 degrees feedback. J Surg Educ. 2018;75(4):984-92. doi:https://doi.org/10.1016/j.jsurg.2017.12.006.

49.

Bosko

Wilson

. Assessing the relationship between patient satisfaction and clinical quality in an ambulatory setting. J Health Organ Manag. 2016;30(7):1063-80. doi:https://doi.org/10.1108/JHOM-11-2015-0181.

50.

Nembhard

Yuan

Shabanova

Cleary

. The relationship between voice climate and patients’ experience of timely care in primary care clinics. Health Care Manage Rev. 2015;40(2):104-15. doi:https://doi.org/10.1097/hmr.0000000000000017.

51.

Lee

YSH

King

Anderson

Cleary

Nembhard

. The how matters: how primary care provider communication with team relates to patients’ disease management. Med Care. 2020;58(7):643-50. doi:https://doi.org/10.1097/mlr.0000000000001342.

52.

Hageman

MGJS

Ring

Gregory

Rubash

Harmon

. Do 360-degree feedback survey results relate to patient satisfaction measures? Clin Orthop Relat Res. 2015;473(5):1590-7. Comment in: Clin Orthop Relat Res. 2015 May;473(5):1598-9; PMID: 25421959. doi:https://doi.org/10.1007/s11999-014-3981-3.

53.

Zakare-Fagbamila

Park

Dickson

Cheng

Gottfried

. The true penalty of the waiting room: the role of wait time in patient satisfaction in a busy spine practice. J Neurosurg Spine. 2020;33:95-105. doi:https://doi.org/10.3171/2019.12.Spine191257.

54.

Chung

Dillon

Meehan

Nordgren

Frosch

. The relationship between primary care physician burnout and patient-reported care experiences: a cross-sectional study. J Gen Intern Med. 2020;35(8):2357-64. doi:https://doi.org/10.1007/s11606-020-05770-w.

55.

Willard-Grace

Knox

Huang

Hammer

Kivlahan

Grumbach

. Primary care clinician burnout and engagement association with clinical quality and patient experience. J Am Board Fam Med. 2021;34(3):542-52. doi:https://doi.org/10.3122/jabfm.2021.03.200515.

56.

Chaitoff

Sun

Windover

, et al. Associations between physician empathy, physician characteristics, and standardized measures of patient experience. Acad Med. 2017;92(10):1464-71. doi:https://doi.org/10.1097/ACM.0000000000001671.

57.

Lin

McKinley

Sripipatana

Makaroff

. Colorectal cancer screening at US community health centers: examination of sociodemographic disparities and association with patient-provider communication. Cancer. 2017;123(21):4185-92. doi:https://doi.org/10.1002/cncr.30855.

58.

Quigley

Elliott

Farley

Burkhart

Skootsky

Hays

. Specialties differ in which aspects of doctor communication predict overall physician ratings. Article. J Gen Intern Med. 2014;29(3):447-54. doi:https://doi.org/10.1007/s11606-013-2663-2.

59.

Hasnain

Schwartz

Girotti

Bixby

Rivera

. Differences in patient-reported experiences of care by race and acculturation status. J Immigr Minor Health. 2013;15(3):517-24. doi:https://doi.org/10.1007/s10903-012-9728-x.

60.

Bauer

Parker

Schillinger

, et al. Associations between antidepressant adherence and shared decision-making, patient–provider trust, and communication among adults with diabetes: diabetes study of northern California (distance). J Gen Intern Med. 2014;29(8):1139-47. doi:https://doi.org/10.1007/s11606-014-2845-6.

61.

Ratanawongsa

Karter

Parker

, et al. Communication and medication refill adherence: the diabetes study of northern California. JAMA Intern Med. 2013;173(3):210-8. doi:https://doi.org/10.1001/jamainternmed.2013.1216.

62.

Matar

Shah

Vincent

Rayos Del Sol

Grawe

. Factors that influence inpatient satisfaction after shoulder arthroplasty. J Shoulder Elbow Surg. 2021;30(4):e165-72. doi:https://doi.org/10.1016/j.jse.2020.07.022.

63.

Khan

Rabah

Winkelman

Levin

Mroz

Steinmetz

. The impact of preoperative depression on patient satisfaction with spine surgeons in the outpatient setting. Spine (Phila Pa 1976). 2021;46(3):184-90. doi:https://doi.org/10.1097/brs.0000000000003763.

64.

Hays

RD.

Patient self-rated health and rating of their spine surgeon. J Neurosurg Spine. 2021. doi:https://doi.org/10.3171/2021.1.SPINE21166.

65.

Rabah

Khan

Levin

Winkelman

Mroz

Steinmetz

. The association between patient rating of their spine surgeon and quality of postoperative outcome. J Neurosurg Spine. 2021a;34:449-55. doi:https://doi.org/10.3171/2020.7.Spine20478.

66.

Lapin

Honomichl

Thompson

, et al. Association between patient experience with patient-reported outcome measurements and overall satisfaction with care in neurology. Value Health. 2019;22(5):555-63. doi:https://doi.org/10.1016/j.jval.2019.02.007.

67.

Han

Hsueh

Chen

, et al. Ophthalmology provider ratings and patient, disease, and appointment factors. J Patient Exp. 2021;8:23743735211033750. doi:https://doi.org/10.1177/23743735211033750.

68.

Carvajal

Blank

Lechuga

Schechter

McKee

. Do primary care patient experiences vary by teaching versus nonteaching facility? J Am Board Fam Med. 2014;27(2):239-48. doi:https://doi.org/10.3122/jabfm.2014.02.130222.

69.

Cheng

Silverberg

. Patient satisfaction scores in adults with psoriasis. Arch Dermatol Res. 2022;314:573-81. doi:https://doi.org/10.1007/s00403-021-02260-9.

70.

Kippenbrock

Emory

Lee

Odell

Buron

Morrison

. A national survey of nurse practitioners’ patient satisfaction outcomes. Nurs Outlook. 2019;67(6):707-12. doi:https://doi.org/10.1016/j.outlook.2019.04.010.

71.

Agarwal

Faramand

Bellon

, et al. Limitations of patient experience reports to evaluate physician quality in spine surgery: analysis of 7485 surveys. J Neurosurg Spine. 2019;30:520-3. doi:https://doi.org/10.3171/2018.8.SPINE18104.

72.

Prasad

Buta

Cleary

. Is patient-physician gender concordance related to the quality of patient care experiences? J Gen Intern Med. 2021;36(10):3058-63. doi:https://doi.org/10.1007/s11606-020-06411-y.

73.

Kim

Chisholm

Bevolo

, et al. Comparison of internal patient satisfaction scores at a cancer center with star ratings on online physician-rating websites. JCO Oncol Pract. 2021:Op2000564. doi:https://doi.org/10.1200/op.20.00564.

74.

Quigley

Predmore

Martino

Qureshi

Hays

. Patient comments on the consumer assessment of healthcare providers and systems clinician and group (CG-CAHPS) survey reflect improvements in provider behaviors from coaching. J Healthc Manag. 2023;68(4):251-67. doi:https://doi.org/10.1097/JHM-D-22-00140.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.03 MB

0.08 MB