Development of a Shorten Version of the 22-Item Level of Self-Criticism Scale: Using Item Response Theory and Factor Analysis

Abstract

Purpose

Excessive self-criticism, along with negative self-evaluation and perceived unfavorable judgments from others, often leads to emotional distress. The Levels of Self-Criticism (LOSC) scale identifies two distinct forms of self-criticism: comparative self-criticism and internalized self-criticism, yet with varying psychometric stability across different populations.

Method

This study developed a shortened, psychometrically robust version of the LOSC by employing item response theory (IRT) and factor analysis to enhance the practicality and reliability of the scale.

Results

415 participants completed the baseline survey, and 232 completed the post-test, engaging 83% of females with Mage = 39.73. IRT analysis eliminated 11 items, with the remaining items demonstrating optimal item performance and significant concurrent validity with related measures. This shortened LOSC showed strong test–retest reliability and construct validity.

Discussion

This streamlined scale provides a precise tool for assessing self-criticism, contributing to better psychological practice and research.

Keywords

Self-criticism item response theory shorten version factor analysis

Get full access to this article

View all access options for this article.

References

Ahmad

Jhajj

A. K.

Stewart

D. E.

Burghardt

Bierman

A. S.

(2014). Single item measures of self-rated mental health: A scoping review. BMC Health Services Research, 14(1), 398. https://doi.org/10.1186/1472-6963-14-398

Aruta

J. J. B. R.

Antazo

B. G.

Paceño

J. L.

(2021). Self-stigma is associated with depression and anxiety in a collectivistic context: The adaptive cultural function of self-criticism. In Mental Health and Psychopathology (pp. 34–52). Routledge. https://www-taylorfrancis-com-443.web.bisu.edu.cn/chapters/edit/10.4324/9781003243601-2/self-stigma-associated-depression-anxiety-collectivistic-context-adaptive-cultural-function-self-criticism-john-jamir-benzon-aruta-benedict-antazo-judith-pace%C3%B1o.

Beck

A. T.

(1964). Thinking and depression: II. Theory and therapy. Archives of General Psychiatry, 10(6), 561–571. https://doi.10.1001/archpsyc.1964.01720240015003

Beck

A. T.

(1983). Cognitive therapy of depression: New perspectives. Treatment of Depression: Old Controversies and New Approaches/Raven.

Beck

A. T.

Alford

B. A.

(2009). Depression: Causes and treatment. University of Pennsylvania Press. https://books.google.com/books?hl=zh-TW&lr=&id=Ntw8AwAAQBAJ&oi=fnd&pg=PR17&dq=Beck,+A.+T.,+%26+Alford,+B.+A.+(2009).+Depression:+Causes+and+treatment.+University+of+Pennsylvania+Press.&ots=I26EzAcMCS&sig=8bNBcQHGP3LAj5QScWXPmS8bhX8.

Biermann

Bohus

Gilbert

Vonderlin

Cornelisse

Osen

Graser

Brüne

Ebert

Kleindienst

(2021). Psychometric properties of the German version of the forms of self-criticizing/attacking and self-reassuring scale (FSCRS). Psychological Assessment, 33(1), 97. https://doi.org/10.1037/pas0000956

Blatt

S. J.

(1974). Levels of object representation in anaclitic and introjective depression. The Psychoanalytic Study of the Child, 29(1), 107–157. https://doi.org/10.1080/00797308.1974.11822616

Blatt

S. J.

Homann

(1992). Parent-child interaction in the etiology of dependent and self-critical depression. Clinical Psychology Review, 12(1), 47–91. https://doi.org/10.1016/0272-7358(92)90091-L

Boateng

G. O.

Neilands

T. B.

Frongillo

E. A.

Melgar-Quiñonez

H. R.

Young

S. L.

(2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149.

10.

Castilho

Pinto-Gouveia

Duarte

(2015). Exploring self-criticism: Confirmatory factor analysis of the FSCRS in clinical and nonclinical samples. Clinical Psychology & Psychotherapy, 22(2), 153–164. https://doi.org/10.1002/cpp.1881

11.

Chan

Fung

H. W.

Choi

T. M.

Ross

C. A.

(2017). Using online methods to develop and examine the Hong Kong Chinese translation of the dissociative experiences scale. Journal of Evidence-Informed Social Work, 14(2), 70–85. https://doi.org/10.1080/23761407.2017.1298073

12.

Chen

Yan

Zhou

(2011). Reliability and validity of Chinese version of Self-compassion Scale. Chinese Journal of Clinical Psychology, 19(6), 734–736. https://psycnet.apa.org/record/2012-05439-005

13.

Edelen

M. O.

Reeve

B. B.

(2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(S1), 5–18. https://doi.org/10.1007/s11136-007-9198-0

14.

Floyd

F. J.

Widaman

K. F.

(1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286. https://doi.org/10.1037/1040-3590.7.3.286

15.

Fung

H. W.

Lam

S. K. K.

Chien

W. T.

Ling

H. W. H.

Z. Y.

Ross

C. A.

Chau

A. K. C.

(2024). Reliability and mental health correlates of a single-item measure of self-rated mental health (SRMH) in the Chinese context. Healthcare, 12(1), 122. https://doi.org/https://www.mdpi.com/2227-9032/12/1/122

16.

Gilbert

Clarke

Hempel

Miles

J. N. V.

Irons

(2004). Criticizing and reassuring oneself: An exploration of forms, styles and reasons in female students. British Journal of Clinical Psychology, 43(1), 31–50. https://doi.org/10.1348/014466504772812959

17.

Halamová

Kanovskỳ

Pacúchová

(2017). Robust psychometric analysis and factor structure of the forms of self–criticizing/attacking and self–reassuring scale. Ceskoslovenská Psychologie, 61(4), 331.

18.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

19.

Joeng

J. R.

Turner

S. L.

(2015). Mediators between self-criticism and depression: Fear of compassion, self-compassion, and importance to others. Journal of Counseling Psychology, 62(3), 453. https://doi.org/10.1037/cou0000071

20.

Kannan

Levitt

H. M.

(2013). A review of client self-criticism in psychotherapy. Journal of Psychotherapy Integration, 23(2), 166. https://doi.org/10.1037/a0032355

21.

Khosravani

Dastjerdi

H. V.

(2013). Back translation vs. Collaborative translation: A comparative study of Persian subtitles in English movies. Lebende Sprachen, 58, 2. https://doi.org/10.1515/les-2013-0021

22.

Lam

S. K. K.

A. S. Y.

Zhou

C. R.

Hung

S. L.

Fung

H. W.

(2024). Persistence and psychological predictors of ICD-11 complex PTSD: A six-month longitudinal study in Hong Kong. Journal of Loss and Trauma, 29(5), 544–564. https://doi.org/10.1080/15325024.2023.2267433

23.

Loew

C. A.

Schauenburg

Dinger

(2020). Self-criticism and psychotherapy outcome: A systematic review and meta-analysis. Clinical Psychology Review, 75, 101808. https://doi.org/10.1016/j.cpr.2019.101808

24.

Neff

K. D.

Tóth-Király

Yarnell

L. M.

Arimitsu

Castilho

Ghorbani

Guo

H. X.

Hirsch

J. K.

Hupfeld

Hutz

C. S.

(2019). Examining the factor structure of the self-compassion scale in 20 diverse samples: Support for use of a total score and six subscale scores. Psychological Assessment, 31(1), 27. https://doi.org/10.1037/pas0000629

25.

Rice

K. G.

Ashby

J. S.

Slaney

R. B.

(1998). Self-esteem as a mediator between perfectionism and depression: A structural equations analysis. Journal of Counseling Psychology, 45(3), 304. https://doi.org/10.1037/0022-0167.45.3.304

26.

Thompson

Zuroff

D. C.

(2004). The levels of self-criticism scale: Comparative self-criticism and internalized self-criticism. Personality and Individual Differences, 36(2), 419–430. https://doi.org/10.1016/S0191-8869(03)00106-5

27.

Warren

Smeets

Neff

(2016). Self-criticism and self-compassion: Risk and resilience: Being compassionate to oneself is associated with emotional resilience and psychological well-being. Current Psychiatry, 15(12), 18–28. https://link.gale.com/apps/doc/A474714850/AONE?u=anon~4581c4d9&sid=googleScholar&xid=010cedc6

28.

Weissman

A. N.

Beck

A. T.

(1978). Development and validation of the dysfunctional attitude scale: A preliminary investigation. https://eric.ed.gov/?id=ED167619 .

29.

Whelton

W. J.

Greenberg

L. S.

(2005). Emotion in self-criticism. Personality and Individual Differences, 38(7), 1583–1595. https://doi.org/10.1016/j.paid.2004.09.024

30.

Widaman

K. F.

Grimm

K. J.

(2014). Advanced psychometrics: Confirmatory factor analysis, item response theory, and the study of measurement invariance. https://psycnet.apa.org/record/2014-12227-020 .

31.

Xia

Tang

Wang

(2019). Use of item response theory to develop a shortened version of the EORTC QLQ-BR23 scales. Scientific Reports, 9(1), 1764. https://doi.org/10.1038/s41598-018-37965-x

32.

Zhang

C. Q.

Chung

P. K.

Liu

J. D.

(2014). Psychometric properties of the acceptance and action questionnaire–II for Chinese college students and elite Chinese athletes. Measurement and Evaluation in Counseling and Development, 47(4), 256–270. https://doi.org/10.1177/0748175614538064

33.

Zuroff

D. C.

(1994). Depressive personality styles and the five-factor model of personality. Journal of Personality Assessment, 63(3), 453–472. https://doi.org/10.1207/s15327752jpa6303_5

34.

Zuroff

D. C.

Fitzpatrick

D. K.

(1995). Depressive personality styles: Implications for adult attachment. Personality and Individual Differences, 18(2), 253–265. https://doi.org/10.1016/0191-8869(94)00136-G