Unidimensional or Multidimensional? Understanding Burnout of Counseling Trainees Using Item Response Theory

Abstract

This study aimed to investigate the construct of burnout in counseling trainees using item response theory. The psychometric properties of the Maslach Burnout Inventory-General Survey for Students (MBI-GS(S)) were examined with a sample of counseling trainees (N = 246). Based on the graded response model, the results supported only the three-factor solution of counseling trainees’ burnout and provided little evidence for general burnout as a potential construct. Specific item-level information from multidimensional item response theory analysis is also presented, including item discrimination parameters, item difficulty location parameters, test information, and reliability. Implications for assessing and addressing counseling trainees’ burnout in terms of educating future mental health professionals are discussed.

Keywords

burnout Maslach Burnout Inventory item response theory counseling trainees psychometric evaluation

Get full access to this article

View all access options for this article.

References

Allan

B. A.

Owens

R. L.

Douglass

R. P.

(2019). Character strengths in counselors: Relations with meaningful work and burnout. Journal of Career Assessment, 27(1), 151–166. https://doi.org/10.1177/1069072717748666

Baker

F. B.

(2001). The basics of item response theory (2nd ed.). ERIC Clearinghouse on Assessment and Evaluation. https://files.eric.ed.gov/fulltext/ED458219.pdf

Bardhoshi

Niles

Han

Brown

(2022). Novice school counselors’ burnout profiles and professional experiences: A mixed-methods study. Professional School Counseling, 26(1). https://doi.org/10.1177/2156759X221126686

Beckstead

J. W.

(2002). Confirmatory factor analysis of the Maslach Burnout Inventory among Florida nurses. International Journal of Nursing Studies, 39(8), 785–792. https://doi.org/10.1016/S0020-7489(02)00012-3

Brady

K. J.

Sheldrick

R. C.

Trockel

M. T.

Shanafelt

T. D.

Rowe

S. G.

Schneider

J. I.

Kazis

L. E.

(2020). Describing the emotional exhaustion, depersonalization, and low personal accomplishment symptoms associated with Maslach Burnout Inventory subscale scores in US physicians: An item response theory analysis. Journal of Patient-Reported Outcomes, 4(1), 42. https://doi.org/10.1186/s41687-020-00204-x

Cook

K. F.

Kallen

M. A.

Amtmann

(2009). Having a fit: Impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 18(4), 447–460. https://doi.org/10.1007/s11136-009-9464-4

De Beer

L. T.

Bianchi

(2017). Confirmatory factor analysis of the Maslach Burnout Inventory. European Journal of Psychological Assessment, 35(2), 217–224. https://doi.org/10.1027/1015-5759/a000392

De Hert

(2020). Burnout in healthcare workers: Prevalence, impact and preventative strategies. Local and Regional Anesthesia, 13, 171–183. https://doi.org/10.2147/LRA.S240564

Edelen

M. O.

Reeve

B. B.

(2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 16(Suppl 1), 5–18. https://doi.org/10.1007/s11136-007-9198-0

10.

Finch

French

B. F.

(2019). A comparison of estimation techniques for IRT models with small samples. Applied Measurement in Education, 32(2), 77–96. https://doi.org/10.1080/08957347.2019.1577243

11.

Gnilka

P. B.

Karpinski

A. C.

Smith

H. J.

(2015). Factor structure of the counselor burnout inventory in a sample of professional school counselors. Measurement and Evaluation in Counseling and Development, 48(3), 177–191. https://doi.org/10.1177/0748175615578758

12.

Golembiewski

R. T.

Munzenrider

(1981). Efficacy of three versions of one burn-out measure: MBI as total score, sub-scale scores, or phases? Journal of Health & Human Resources Administration, 4(2), 228–246. https://www-jstor-org-443.web.bisu.edu.cn/stable/25780059

13.

Hays

R. D.

Morales

L. S.

Reise

S. P.

(2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38(9), 28–42. https://doi.org/10.1097/00005650-200009002-00007

14.

Jordan

Steingen

Volker Harth

C. T.

(2018). The Maslach burnout inventory: A test dimensionality assessment via item response theory. Testing, Psychometrics, Methodology in Applied Psychology, 25(1), 101–120. https://doi.org/10.4473/TPM25.1.6.

15.

Keim

Olguin

D. L.

Marley

S. C.

Thieman

(2008). Trauma and burnout: Counselors in training. Compelling Counseling Interventions. VISTAS 2008 . https://www.counseling.org/resources/library/vistas/2008-V-Printcomplete-PDFs-for-ACA/Keim_Article_28.pdf

16.

Kovach Clark

Murdock

N. L.

Koetting

(2009). Predicting burnout and career choice satisfaction in counseling psychology graduate students. The Counseling Psychologist, 37(4), 580–606. https://doi.org/10.1177/0011000008319985

17.

Lee

Bardhoshi

Yoon

Sandersfeld

Rush

R. D.

Priest

J. B.

(2018). Attributional style and burnout of counselors‐in‐training. Counselor Education and Supervision, 57(4), 285–300. https://doi.org/10.1002/ceas.12117

18.

Lee

S. M.

Cho

S. H.

Kissinger

Ogle

N. T.

(2010). A typology of burnout in professional counselors. Journal of Counseling and Development, 88(2), 131–138. https://doi.org/10.1002/j.1556-6678.2010.tb00001.x

19.

Leiter

M. P.

Maslach

(2016). Latent burnout profiles: A new approach to understanding the burnout experience. Burnout Research, 3(4), 89–100. https://doi.org/10.1016/j.burn.2016.09.001

20.

Loera

Converso

Viotti

(2014). Evaluating the psychometric properties of the Maslach Burnout Inventory-Human Services Survey (MBI-HSS) among Italian nurses: How many factors must a researcher consider? PLoS One, 9(12), Article e114987. https://doi.org/10.1371/journal.pone.0114987

21.

Marôco

Campos

J. A. D. B.

(2012). Defining the student burnout construct: A structural analysis from three burnout inventories. Psychological Reports, 111(3), 814–830. https://doi.org/10.2466/14.10.20.PR0.111.6.814-830

22.

Mészáros

Ádám

Szabó

Szigeti

Urbán

(2014). The bifactor model of the Maslach Burnout Inventory–Human Services Survey (MBI‐HSS)—an alternative measurement model of burnout. Stress and Health, 30(1), 82–88. https://doi.org/10.1002/smi.2481

23.

Obregon

Luo

Shelton

Blevins

MacDowell

(2020). Assessment of burnout in medical students using the Maslach burnout inventory-student survey: A cross-sectional data analysis. BMC Medical Education, 20(1), 1–10. https://doi.org/10.1186/s12909-020-02274-3

24.

Pereira

S. D. S.

Fornés-Vives

Unda-Rojas

S. G.

Pereira-Junior

G. A.

Juruena

M. F.

Cardoso

(2021). Confirmatory factorial analysis of the Maslach burnout inventory–human services survey in health professionals in emergency services. Revista Latino-Americana de Enfermagem, 29, Article e3386. https://doi.org/10.1590/1518-8345.3320.3386

25.

Poghosyan

Aiken

L. H.

Sloane

D. M.

(2009). Factor structure of the Maslach burnout inventory: An analysis of data from large scale cross-sectional surveys of nurses from eight countries. International Journal of Nursing Studies, 46(7), 894–902. https://doi.org/10.1016/j.ijnurstu.2009.03.004

26.

Puig

Yoon

Callueng

Lee

S. M.

(2014). Burnout syndrome in psychotherapists: A comparative analysis of five nations. Psychological Services, 11(1), 87–96. https://doi.org/10.1037/a0035285

27.

Reise

S. P.

Horan

W. P.

Blanchard

J. J.

(2011). The challenges of fitting an item response theory model to the Social Anhedonia Scale. Journal of Personality Assessment, 93(3), 213–224. https://doi.org/10.1080/00223891.2011.558868

28.

Richardsen

A. M.

Martinussen

(2004). The Maslach Burnout Inventory: Factorial validity and consistency across occupational groups in Norway. Journal of Occupational and Organizational Psychology, 77(3), 377–384. https://doi.org/10.1348/0963179041752691

29.

Schaufeli

W. B.

Desart

De Witte

(2020). Burnout Assessment Tool (BAT)—development, validity, and reliability. International Journal of Environmental Research and Public Health, 17(24), 9495. https://doi.org/10.3390/ijerph17249495

30.

Schaufeli

W. B.

Leiter

M. P.

Maslach

Jackson

S. E.

(1996). The MBI general survey: MBI-GS. In Maslach

Jackson

S. E.

Leiter

M. P.

(Eds.), The Maslach burnout Inventory manual (4th ed., pp. 37–50). Mind Garden.

31.

Schaufeli

W. B.

Martinez

I. M.

Pinto

A. M.

Salanova

Bakker

A. B.

(2002). Burnout and engagement in university students: A cross-national study. Journal of Cross-Cultural Psychology, 33(5), 464–481. https://doi.org/10.1177/0022022102033005003

32.

Sharp

Burkart

K. M.

(2017). Trainee wellness: Why it matters, and how to promote it. Annals of the American Thoracic Society, 14(4), 505–512. https://doi.org/10.1513/AnnalsATS.201612-1006PS

33.

Shi

Gugiu

P. C.

Crowe

R. P.

Way

D. P.

(2019). A Rasch analysis validation of the Maslach burnout inventory–student survey with preclinical medical students. Teaching and Learning in Medicine, 31(2), 154–169. https://doi.org/10.1080/10401334.2018.1523010

34.

Stalker

C. A.

Harvey

Frensch

Mandell

Adams

G. R.

(2008). Confirmatory factor analysis of the Maslach burnout inventory: A replication with Canadian child welfare workers. Journal of Public Child Welfare, 1(3), 77–94. https://doi.org/10.1300/J479v01n03_05

35.

Svetina Valdivia

Dai

(2024). Number of response categories and sample size requirements in polytomous IRT models. The Journal of Experimental Education, 92(1), 154–185. https://doi.org/10.1080/00220973.2022.2153783

36.

Thomas

M. L.

(2019). Advances in applications of item response theory to clinical assessment. Psychological Assessment, 31(12), 1442–1455. https://doi.org/10.1037/pas0000597

37.

Turhan

Scheunemann

Schnettler

Bäulke

Thies

D. O.

Dresel

Fries

Leutner

Wirth

Grunschel

(2021). Psychometric properties of the German short version of the Maslach burnout inventory–student survey. European Journal of Health Psychology, 28(2), 45–58. https://doi.org/10.1027/2512-8442/a000067

38.

(2024). Psychometric properties of the Utrecht Work Engagement Scale-9 in a School Counselor Sample using classical test theory and item response theory. Measurement and Evaluation in Counseling and. Development, 57(4), 336–350. https://doi.org/10.1080/07481756.2023.2301288

39.

Nam

(2024). Social resources and professional identity: Predicting counselors‐in‐training’s burnout and engagement. Counselor Education and Supervision, 63(1), 26–40. https://doi.org/10.1002/ceas.12289

40.

Seon

(2024). Counseling trainees’ academic burnout, meaningful work, and career choice satisfaction: A resilience framework. The Career Development Quarterly, 72(1), 18–31. https://doi.org/10.1002/cdq.12341

41.

Yavuz

Dogan

(2014). Maslach burnout inventory-student survey (MBI-SS): A validity study. Procedia - Social and Behavioral Sciences, 116, 2453–2457. https://doi.org/10.1016/j.sbspro.2014.01.590