Measurement Equivalence of Four Psychological Questionnaires in Native-Born Germans,Russian-Speaking Immigrants,and Native-Born Russians

Abstract

Psychological constructs depend on cultural context. It is therefore important to show the equivalence of measurement instruments in cross-cultural research. There is evidence that in Russian-speaking immigrants, cultural and language issues are important in health care. We examined measurement equivalence of the Patient Health Questionnaire-9 (PHQ-9), the Patient Health Questionnaire-15 (PHQ-15), the Hamburg Self-Care Questionnaire (HamSCQ), and the questionnaire on communication preferences of patients with chronic illness (KOPRA) in native-born Germans, Russian-speaking immigrants living in Germany, and native-born Russians living in the former Soviet Union (FSU). All four questionnaires fulfilled requirements of measurement equivalence in confirmatory factor analyses and analyses of differential item functioning. The Russian translations can be used in Russian-speaking immigrants and native-born Russians. This offers further possibilities for cross-cultural research and for an improvement in health care research in Russian-speaking immigrants in Germany. The most pronounced differences occurred in the KOPRA, which point to differences in German and Russian health care systems.

Keywords

immigrants questionnaires methodology confirmatory factor analysis differential item functioning

Get full access to this article

View all access options for this article.

References

Abedalaziz

(2011). Detecting DIF using item characteristic curve approaches. International Journal of Educational and Psychological Assessment, 8(2), 1-15.

American Psychological Association. (2002). Ethical principles of psychologists and code of conduct. The American Psychologist, 57, 1060-1073.

Aparicio

M. L.

Doring

Mielck

Holle

(2005). Differences between Eastern European immigrants of German origin and the rest of the German population in health status, health care use and health behaviour: A comparative study using data from the KORA-Survey 2000. Soz Praventivmed, 50, 107-118.

Arbuckle

J. L.

(2008). Amos 17.0 user’s guide. Chicago, IL: SPSS.

Arroll

Goodyear-Smith

Crengle

Gunn

Kerse

Fishman

Hatcher

(2010). Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population. Annals of Family Medicine, 8, 348-353.

Baas

K. D.

Cramer

A. O.

Koeter

M. W.

van de Lisdonk

E. H.

van Weert

H. C.

Schene

A. H.

(2011). Measurement invariance with respect to ethnicity of the Patient Health Questionnaire-9 (PHQ-9). Journal of Affective Disorders, 129, 229-235.

Bingenheimer

J. B.

Raudenbush

S. W.

Leventhal

Brooks-Gunn

(2005). Measurement equivalence and differential item functioning in family psychology. Journal of Family Psychology, 19, 441-455.

Blunch

(2008). Introduction to structural equation modeling using SPSS and AMOS. London, England: Sage.

Breslau

Javaras

K. N.

Blacker

Murphy

J. M.

Normand

S. L.

(2008). Differential item functioning between ethnic groups in the epidemiological assessment of depression. Journal of Nervous and Mental Disease, 196, 297-306.

10.

Cohen

(1988). Statistical power analysis for the behavioral sciences. Hillsdale, MI: Erlbaum.

11.

Crane

P. K.

Gibbons

L. E.

Willig

J. H.

Mugavero

M. J.

Lawrence

S. T.

Schumacher

J. E.

Crane

H. M.

(2010). Measuring depression levels in HIV-infected patients as part of routine clinical care using the nine-item Patient Health Questionnaire (PHQ-9). AIDS Care, 22, 874-885.

12.

Culhane

S. E.

Morera

O. F.

Watson

P. J.

Millsap

R. E.

(2009). Assessing measurement and predictive invariance of the Toronto Alexithymia Scale-20 in U.S. Anglo and U.S. Hispanic student samples. Journal of Personality Assessment, 91, 387-395.

13.

Culhane

S. E.

Morera

O. F.

Watson

P. J.

Millsap

R. E.

(2011). The Bermond-Vorst Alexithymia Questionnaire: A measurement invariance examination among U.S. Anglos and U.S. Hispanics. Assessment, 18, 88-94.

14.

Dohan

Levintova

(2007). Barriers beyond words: Cancer, culture, and translation in a community of Russian speakers. Journal of General Internal Medicine, 22(Suppl. 2), 300-305.

15.

Doran

Aldridge

Roesch

Myers

(2011). Factor structure and invariance of the Behavioral Undercontrol Questionnaire. Testing for differences across gender and ethnicity. European Journal of Psychological Assessment, 27, 145-152.

16.

Enders

C. K.

(2010). Applied missing data analysis. New York, NY: Guilford.

17.

Farin

Gramm

Kosiol

(2011). Development of a questionnaire to assess communication preferences of patients with chronic illness. Patient Education and Counseling, 82, 81-88.

18.

Gilbody

Richards

Brealey

Hewitt

(2007). Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): A diagnostic meta-analysis. Journal of General Internal Medicine, 22, 1596-1602.

19.

Gräfe

Zipfel

Herzog

Löwe

(2004). Screening psychischer Störungen mit dem Gesundheitsfragebogen für Patienten (PHQ-D). Ergebnisse der deutschen Validierungsstudie [Screening of mental disorders with the Patient Health Questionnaire (PHQ-D). Results of the German validation study]. Diagnostica, 50(4), 171-181.

20.

Griner

Smith

T. B.

(2006). Culturally adapted mental health interventions: A meta-analytic review. Psychotherapy: Theory, Research, Practice, Training, 43, 531-548.

21.

Hambrick

J. P.

Rodebaugh

T. L.

Balsis

Woods

C. M.

Mendez

J. L.

Heimberg

R. G.

(2010). Cross-ethnic measurement equivalence of measures of depression, social anxiety, and worry. Assessment, 17, 155-171.

22.

Han

Pae

C. U.

Patkar

A. A.

Masand

P. S.

Kim

K. W.

Joe

S. H.

Jung

I. K.

(2009). Psychometric properties of the Patient Health Questionnaire-15 (PHQ-15) for measuring the somatic symptoms of psychiatric outpatients. Psychosomatics, 50, 580-585.

23.

Harfst

Ghods

Mosko

Schulz

(2009). Measuring positive behaviour and experience in inpatients with mental disorders—The Hamburg Self-Care Questionnaire (HamSCQ). Rehabilitation, 48, 277-282.

24.

Huang

F. Y.

Chung

Kroenke

Delucchi

K. L.

Spitzer

R. L.

(2006). Using the Patient Health Questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. Journal of General Internal Medicine, 21, 547-552.

25.

Interian

Allen

L. A.

Gara

M. A.

Escobar

J. I.

Diaz-Martinez

A. M.

(2006). Somatic complaints in primary care: Further examining the validity of the Patient Health Questionnaire (PHQ-15). Psychosomatics, 47, 392-398.

26.

Kamata

Vaughn

B. K.

(2004). An introduction to differential item functioning analysis. Learning Disabilities: A Contemporary Journal, 2(2), 49-69.

27.

Kirkcaldy

B. D.

Siefen

R. G.

Wittig

Schüller

Brähler

Merbach

(2005). Health and emigration: Subjective evaluation of health status and physical symptoms in Russian-speaking migrants. Stress and Health, 21, 295-309.

28.

Kline

R. B.

(2005). Principles and practice of structural equation modeling. New York, NY: Guilford.

29.

Korber

Frieser

Steinbrecher

Hiller

(2011). Classification characteristics of the Patient Health Questionnaire-15 for screening somatoform disorders in a primary care setting. Journal of Psychosomatic Research, 71, 142-147.

30.

Kroenke

Spitzer

R. L.

Williams

J. B.

(2002). The PHQ-15: Validity of a new measure for evaluating the severity of somatic symptoms. Psychosomatic Medicine, 64, 258-266.

31.

Kroenke

Spitzer

R. L.

Williams

J. B.

Lowe

(2010). The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review. General Hospital Psychiatry, 32, 345-359.

32.

Lai

J. S.

Teresi

Gershon

(2005). Procedures for the analysis of differential item functioning (DIF) for small sample sizes. Evaluation & the Health Professions, 28, 283-294.

33.

Lassetter

J. H.

Callister

L. C.

(2009). The impact of migration on the health of voluntary migrants in western societies. Journal of Transcultural Nursing, 20, 93-104.

34.

Lowe

Kroenke

Herzog

Grafe

(2004). Measuring depression outcome with a brief self-report instrument: Sensitivity to change of the Patient Health Questionnaire (PHQ-9). Journal of Affective Disorders, 81, 61-66.

35.

Martin

Rief

Klaiberg

Braehler

(2006). Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the general population. General Hospital Psychiatry, 28, 71-77.

36.

Mehler

P. S.

Lundgren

R. A.

Pines

Doll

(2004). A community study of language concordance in Russian patients with diabetes. Ethnicity and Disease, 14, 584-588.

37.

Mewes

Christ

Rief

Brähler

Martin

Glaesmer

(2010). Sind Vergleiche im Depressions- und Somatisierungsausmaß zwischen Migranten und Deutschen möglich? Eine Überprüfung der Messinvarianz für den PHQ-9 und PHQ-15 [Is it possible to compare magnitude of depression and somatisation between migrants and Germans? Examination of measurement invariance of PHQ-9 and PHQ-15]. Diagnostica, 56, 230-239.

38.

Millsap

R. E.

(2006). Comments on methods for the investigation of measurement bias in the Mini-Mental State Examination. Medical Care, 44, S171-S175.

39.

Millsap

R. E.

(2007). Invariance in measurement and prediction revisited. Psychometrika, 72, 461-473.

40.

Mirsky

(2009). Mental health implications of migration: A review of mental health community studies on Russian-speaking immigrants in Israel. Social Psychiatry and Psychiatric Epidemiology, 44, 179-187.

41.

Mosko

M. O.

Pradel

Schulz

(2011). The care of people with a migration background in psychosomatic rehabilitation. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz, 54, 465-474.

42.

Nagl-Cupal

Rappold

(2007). Gesundheitssysteme im Vergleich: Russische Föderation [Comparing health care systems: Russian Federation]. Österreichische Pflegezeitschrift, 11, 24-25.

43.

Petersen

M. A.

Groenvold

Bjorner

J. B.

Aaronson

Conroy

Cull

, . . . European Organisation for Research and Treatment of Cancer Quality of Life Group. (2003). Use of differential item functioning analysis to assess the equivalence of translations of a questionnaire. Quality of Life Research, 12, 373-385.

44.

Raju

N. S.

Laffitte

L. J.

Byrne

B. M.

(2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517-529.

45.

Raykov

Marcoulides

G. A.

(2006). A first course in structural equation modeling. Mahwah, NJ: Erlbaum.

46.

Richardson

Katsakou

Torres-Gonzalez

Onchev

Kallert

Priebe

(2011). Factorial validity and measurement equivalence of the Client Assessment of Treatment Scale for psychiatric inpatient care—A study in three European countries. Psychiatry Research, 188, 156-160.

47.

Salzberger

Sinkovics

R. R.

Schlegelmilch

B. B.

(1999). Data equivalence in cross-cultural research: A comparison of classical test theory and latent trait theory based approaches. Australasian Marketing Journal, 7(2), 23-38.

48.

Schenk

Neuhauser

(2005). Methodische Standards fuer eine migrantensensible Forschung in der Epidemiologie [Methodological standards for migrant-sensitive epidemiological research]. Bundesgesundheitsblatt, 48, 279-286.

49.

Scott

N. W.

Fayers

P. M.

Aaronson

N. K.

Bottomley

de Graeff

Groenvold

, . . . Quality of Life Cross-Cultural Meta-Analysis Group. (2009). The practical impact of differential item functioning analyses in a health-related quality of life instrument. Quality of Life Research, 18, 1125-1130.

50.

Scott

N. W.

Fayers

P. M.

Aaronson

N. K.

Bottomley

de Graeff

Groenvold

, . . . Quality of Life Cross-Cultural Meta-Analysis Group. (2010). Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health and Quality of Life Outcomes, 8, 1125-1130.

51.

Spiess

Kilcher

(2003). Doctor-patient interaction in the context of migration. Praxis (Bern 1994), 92, 697-705.

52.

Spitzer

R. L.

Kroenke

Williams

J. B.

(1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA, 282, 1737-1744.

53.

Steinbrecher

Koerber

Frieser

Hiller

(2011). The prevalence of medically unexplained symptoms in primary care. Psychosomatics, 52, 263-271.

54.

Stommel

Wang

Given

C. W.

Given

(1992). Confirmatory factor analysis (CFA) as a method to assess measurement equivalence. Research in Nursing & Health, 15, 399-405.

55.

van Ravesteijn

Wittkampf

Lucassen

van de Lisdonk

van den Hoogen

van Weert

Speckens

. (2009). Detecting somatoform disorders in primary care with the PHQ-15. Annals of Family Medicine, 7, 232-238.

56.

Weiber

Mühlhaus

(2009). Strukturgleichungsmodellierung [Structural equation modeling]. Berlin, Germany: Springer.

57.

Wolff

H. G.

Schneider-Rahm

C. I.

Forret

M. L.

(2011). Adaptation of a German multidimensional networking scale into English. European Journal of Psychological Assessment, 27, 244-250.

58.

Zumbo

B. D.

(1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa, Ontario, Canada: Directorate of Human Resources Research and Evaluation, Department of National Defense.