Psychometric Evaluation of the Social Phobia Inventory (SPIN) in Algeria: A Comprehensive Approach Utilizing Network Analysis,Confirmatory Factor Analysis,and the Polytomous Rasch Model

Abstract

This study aimed to evaluate the psychometric characteristics of the Social Phobia Inventory (SPIN) by employing network analysis, confirmatory factor analysis, and the Polytomous Rasch Model. A cross-sectional data set was collected comprising 1,530 participants, with 959 being women and 571 being men. The Bootstrap Exploratory Graph Analysis unveiled the presence of two dimensions, with Items 17, 15, 5, 14, 6, and 9 exhibiting the highest strength centrality index. Notably, the Network Comparison Test indicated no differences in Network Invariance and global strength between the networks of women and men. Furthermore, the confirmatory factor analysis results demonstrated that the two extracted dimensions displayed an acceptable goodness of fit. In addition, the reliability coefficient values were acceptable, exceeding the threshold of 0.70. The Rasch analysis results suggested an overall fit, but some items exhibited overlap, suggesting their potential removal. Furthermore, it was recommended to develop new items to address gaps between existing items, particularly for measuring the lower levels of Social Anxiety Disorder. In conclusion, these findings provide robust evidence supporting the reliability and validity of the SPIN as a tool for measuring Social Anxiety Disorder in Algeria.

Keywords

social anxiety disorder social phobia network analysis network model factor analysis Rasch model

Get full access to this article

View all access options for this article.

References

Aghekyan

(2020). Validation of the sieve instrument using the Rasch analysis. International Journal of Educational Research, 103, 101619.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing.

Andrich

(1978). Application of a psychometric rating model to ordered categories, which are scored with successive integers. Applied Psychological Measurement, 2(4), 581–594.

Beard

Millner

A. J.

Forgeard

M. J.

Fried

E. I.

Hsu

K. J.

Treadway

M. T.

Leonard

C. V.

Kertz

Björgvinsson

(2016). Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychological Medicine, 46(16), 3359–3369.

Bentler

P. M.

(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246.

Bernstein

E. E.

Heeren

McNally

R. J.

(2017). Unpacking rumination and executive control: A network perspective. Clinical Psychological Science, 5(5), 816–826.

Bond

Yan

Heene

(2020). Applying the Rasch model: Fundamental measurement in the human sciences (4th ed.). Routledge.

Boone

W. J.

(2016). Rasch analysis for instrument development: Why, when, and how? CBE—Life Sciences Education, 15(4), rm4.

Boone

W. J.

Staver

J. R.

(2020). Advances in Rasch analyses in the human sciences. Springer.

10.

Borgatti

S. P.

(2005). Centrality and network flow. Social Networks, 27(1), 55–71.

11.

Browne

M. W.

Cudeck

(1993). Alternative ways of assessing model fit. In Bollen

K. A.

Long

J. S.

(Eds.), Testing structural equation models (pp. 136–162). Sage.

12.

Butcher

N. J.

Mosch

C. S.

Tsai

Nezami

(2006). Cross-cultural applications of the MMPI-2. In Butcher

J. N.

(Ed.), MMPI-2 a practitioner’s guide (pp. 505–537). American Psychological Association.

13.

Carleton

R. N.

Collimore

K. C.

Asmundson

G. J.

McCabe

R. E.

Rowa

Antony

M. M.

(2010). Spinning factors: Factor analytic evaluation of the social phobia inventory in clinical and nonclinical undergraduate samples. Journal of Anxiety Disorders, 24(1), 94–101.

14.

Cho

Choi

Kim

Hong

(2018). Factor structure and other psychometric properties of the social phobia inventory in Korean Samples. Measurement and Evaluation in Counseling and Development, 51(4), 263–280.

15.

Christensen

A. P.

Golino

(2021). Estimating the stability of psychological dimensions via bootstrap exploratory graph analysis: A Monte Carlo simulation and tutorial. Psych, 3(3), 479–500.

16.

Connor

K. M.

Davidson

J. R.

Churchill

L. E.

Sherwood

Weisler

R. H.

Foa

(2000). Psychometric properties of the Social Phobia Inventory (SPIN): New self-rating scale. The British Journal of Psychiatry, 176(4), 379–386.

17.

Costantini

Perugini

(2014). Generalization of clustering coefficients to signed correlation networks. PLOS ONE, 9(2), Article e88669.

18.

DeVellis

R. F.

Thorpe

C. T.

(2021). Scale development: Theory and applications. Sage.

19.

Diamantopoulos

Siguaw

J. A.

Siguaw

J. A.

(2000). Introducing LISREL: A guide for the uninitiated. Sage.

20.

Dogaheh

E. R.

(2013). Psychometric properties of Farsi version of the Social Phobia Inventory (SPIN). Procedia-Social and Behavioral Sciences, 84, 763–768.

21.

Dryman

M. T.

Gardner

Weeks

J. W.

Heimberg

R. G.

(2016). Social anxiety disorder and quality of life: How fears of negative and positive evaluation relate to specific domains of life satisfaction. Journal of Anxiety Disorders, 38, 1–8.

22.

Epskamp

Borsboom

Fried

E. I.

(2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50, 195–212.

23.

Epskamp

Cramer

A. O.

Waldorp

L. J.

Schmittmann

V. D.

Borsboom

(2012). Qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48, 1–18.

24.

Epskamp

Fried

E. I.

(2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617–634.

25.

Forbes

M. K.

Wright

A. G.

Markon

K. E.

Krueger

R. F.

(2017). Evidence that psychopathology symptom networks have limited replicability. Journal of Abnormal Psychology, 126(7), 969–988.

26.

Fried

E. I.

Cramer

A. O.

(2017). Moving forward: Challenges and directions for psychopathological network theory and methodology. Perspectives on Psychological Science, 12(6), 999–1020.

27.

Furr

R. M.

(2018). Psychometrics: an introduction. SAGE publications.

28.

Garcia-Lopez

L. J.

Bermejo

R. M.

Hidalgo

M. D.

(2010). The social phobia inventory: Screening and cross-cultural validation in Spanish adolescents. The Spanish Journal of Psychology, 13(2), 970–980.

29.

Glück

T. M.

Knefel

Lueger-Schuster

(2017). A network analysis of anger, shame, proposed ICD-11 post-traumatic stress disorder, and different types of childhood trauma in foster care settings in a sample of adult survivors. European Journal of Psychotraumatology, 8(Suppl. 3), 1372543.

30.

Golino

H. F.

Epskamp

(2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLOS ONE, 12(6), Article e0174035.

31.

Gori

Giannini

Socci

Luca

Dewey

D. E.

Schuldberg

Craparo

(2013). Assessing social anxiety disorder: Psychometric properties of the Italian Social Phobia Inventory (I-SPIN). Clinical Neuropsychiatry, 10(1), 37–42.

32.

Hevey

(2018). Network analysis: A brief overview and tutorial. Health Psychology and Behavioral Medicine, 6(1), 301–328.

33.

L.-t.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.

34.

Jones

P. J.

Mair

Riemann

B. C.

Mugno

B. L.

McNally

R. J.

(2018). A network perspective on comorbid depression in adolescents with obsessive-compulsive disorder. Journal of Anxiety Disorders, 53, 1–8.

35.

Kessler

R. C.

Petukhova

Sampson

N. A.

Zaslavsky

A. M.

Wittchen

H.-U.

(2012). Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. International Journal of Methods in Psychiatric Research, 21(3), 169–184.

36.

Levinson

C. A.

Brosof

L. C.

Vanzhula

Christian

Jones

Rodebaugh

T. L.

Langer

J. K.

White

E. K.

Warren

Weeks

J. W.

Menatti

Lim

M. H.

Fernandez

K. C.

(2018). Social anxiety and eating disorder comorbidity and underlying vulnerabilities: Using network analysis to conceptualize comorbidity. International Journal of Eating Disorders, 51(7), 693–709.

37.

Linacre

J. M.

(1998). Structure in Rasch residuals: Why principal components analysis (PCA)? Rasch Measurement Transactions, 12(2), 636.

38.

Linacre

J. M.

(2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85–106.

39.

Linacre

J. M.

(2012). Winsteps Rasch tutorial 2. https://www.winsteps.com/a/winsteps-tutorial-2.pdf

40.

McDonald

R. P.

(1999). Test theory: A unified treatment. Lawrence Erlbaum Associates.

41.

McNally

R. J.

(2016). Can network analysis transform psychopathology? Behaviour Research and Therapy, 86, 95–104.

42.

Moitra

Beard

Weisberg

R. B.

Keller

M. B.

(2011). Occupational impairment and social anxiety disorder in a sample of primary care patients. Journal of Affective Disorders, 130(1–2), 209–212.

43.

Mörtberg

Jansson Fröjmark

(2019). Psychometric evaluation of the social phobia inventory and the mini-social phobia inventory in a Swedish university student sample. Psychological Reports, 122(1), 323–339.

44.

Nagata

Nakajima

Teo

A. R.

Yamada

Yoshimura

(2013). Psychometric properties of the Japanese version of the Social Phobia Inventory. Psychiatry and Clinical Neurosciences, 67(3), 160–166.

45.

Opsahl

Agneessens

Skvoretz

(2010). Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, 32(3), 245–251.

46.

Osório

F. L.

Crippa

J. A. S.

Loureiro

S. R.

(2010). Evaluation of the psychometric properties of the Social Phobia Inventory in university students. Comprehensive Psychiatry, 51(6), 630–640.

47.

Radomsky

A. S.

Ashbaugh

A. R.

Saxe

M. L.

Ouimet

A. J.

Golden

E. R.

Lavoie

S. L.

O’Connor

K. P.

(2006). Psychometric properties of the French and English versions of the social phobia inventory. Canadian Journal of Behavioural Science/Revue Canadienne des Sciences du Comportement, 38(4), 354–360.

48.

Ranta

Kaltiala-Heino

Koivisto

A.-M.

Tuomisto

M. T.

Pelkonen

Marttunen

(2007). Age and gender differences in social anxiety symptoms during adolescence: The Social Phobia Inventory (SPIN) as a measure. Psychiatry Research, 153(3), 261–270.

49.

Sick

(2010). Assumptions and requirements of Rasch measurement. Shiken: JALT Testing & Evaluation SIG Newsletter, 14(2), 23–29.

50.

Sosic

Gieler

Stangier

(2008). Screening for social phobia in medical in-and outpatients with the German version of the Social Phobia Inventory (SPIN). Journal of Anxiety Disorders, 22(5), 849–859.

51.

Stein

D. J.

Lim

C. C.

Roest

A. M.

De Jonge

Aguilar-Gaxiola

Al-Hamzawi

Alonso

Benjet

Bromet

E. J.

Bruffaerts

de Girolamo

Florescu

Gureje

Haro

J. M.

Harris

M. G.

Hinkov

Horiguchi

. . .Scott

K. M.

(2017). The cross-national epidemiology of social anxiety disorder: Data from the world mental health survey initiative. BMC Medicine, 15(1), 1–21.

52.

Talib

Iahad

N. A.

Ashari

Z. M.

Rameli

M. R. M.

Bakar

Z. A.

Dollah

(2019). Rasch strategies for evaluating the quality of the conceptions and alternative assessment survey (CETAS). Universal Journal of Educational Research, 7(12A), 10–17.

53.

Tsai

C.-F.

Wang

S.-J.

Juang

K.-D.

Fuh

J.-L.

(2009). Use of the Chinese (Taiwan) version of the Social Phobia Inventory (SPIN) among early adolescents in rural areas: Reliability and validity study. Journal of the Chinese Medical Association, 72(8), 422–429.

54.

Urbina

(2014). Essentials of psychological testing. John Wiley.

55.

Van Borkulo

C. D.

van Bork

Boschloo

Kossakowski

J. J.

Tio

Schoevers

R. A.

Borsboom

Waldorp

L. J

. (2023). Comparing network structures on three aspects: A permutation test. Psychological Methods, 28, 1273–1285.

56.

Vilaplana-Pérez

Pérez-Vigil

Sidorchuk

Brander

Isomura

Hesselmark

Kuja-Halkola

Larsson

Mataix-Cols

de la Cruz

L. F.

(2021). Much more than just shyness: The impact of social anxiety disorder on educational performance across the lifespan. Psychological Medicine, 51(5), 861–869.

57.

Wang

Shi

H.-s.

Liu

W.-h.

Zheng

Wong

K. K.-Y.

Cheung

E. F.

Chan

R. C.

(2020). Applying network analysis to investigate the links between dimensional schizotypy and cognitive and affective empathy. Journal of Affective Disorders, 277, 313–321.

58.

C.-Y.

(2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. (Doctoral dissertation). University of California, Los Angeles, CA.