A Meta-Analysis of Coefficient Alpha for the Impact of Event Scales: A Reliability Generalization Study

Abstract

We conducted a score reliability meta-analysis across studies using the Impact of Event Scales. Five hundred and ninety-four studies using the measure were located through electronic database searches and then separated to identify studies that had calculated and reported reliability coefficients from their own data. The 66 articles that remained were then coded to identify potential study characteristics that might influence the variation in reliability estimates. Results indicate adequate internal consistency estimates for all subscales across both scale versions. Furthermore, coefficient alpha was positively correlated with studies involving war and abuse victims for the IES Avoidance subscale. The alpha coefficient was also positively correlated with the percentage of female participants for the Intrusion subscale and negatively correlated to journal type for the composite reliability estimate. Results from this study provide useful information, in terms of scale performance, for researchers interested in using the scale for future academic pursuits and for school psychologists. In particular, implications for school psychologists are considered.

Keywords

IES Impact of Event Scale meta-analysis PTSD reliability reliability generalization

Get full access to this article

View all access options for this article.

References

Allen

Console

Brethour

Huntoon

Fulz

Stein

(2000). Screening for trauma-related sleep disturbance in women admitted for specialized inpatient treatment. Journal of Trauma & Dissociation, 3, 59–85.

Allwood

Bell-Dolan

Husain

(2002). Children's trauma and adjustment reactions to violent and nonviolent war experiences. Journal of American Academic Child and Adolescent Psychiatry, 4, 27–35.

American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders. Fourth Edition, Text Revision. Washington, D.C.: Author.

Anders

Dyregrov

Lilled

(2005). The Gothenburg discotheque fire: Posttraumatic stress and school adjustment as reported by the primary victims 18 months later. Psychology & Psychiatry, 46, 1279–1286.

Baider

Peretz

Hadani

Koch

(2001). Psychological intervention in cancer patients: A randomized study. General Hospital Psychiatry, 23, 272–277.

Baider

Peretz

(2000). Transmission of response to trauma? Second-generation Holocaust survivors' reactions to cancer. American Journal of Psychiatry, 157, 904–1000.

Baider

Walach

Perry

(1998). Cancer in married couples: Higher or lower distress? Journal of Psychosomatic Research, 45, 239–248.

Bailley

Kral

(1999). Survivors of suicide do grieve differently: Empirical support for a common sense proposition. Suicide & Life-Threatening Behavior, 29, 256–275.

Banyard

Shelvin

(2001). Responses of football fans to relegation of their team from the English Premier League: PTS? International Journal of Psychological Medicine, 18, 66–67.

10.

Barnes

L. L. B.

Harp

Jung

W. S.

(2002). Reliability generalization of scores on the Spielberger State-Trait Anxiety Inventory. Educational and Psychological Measurement, 62, 603–618.

11.

Baumert

Simon

Gundel

(2004). The impact of event scale-revised: Evaluation of the subscales to psychophysiological startle response patterns in survivors of a life-threatening event: An analysis of 129 patients with an implanted cardioverter defibrillator. Journal of Affective Disorders, 82, 29–41.

12.

Beretvas

S. N.

Meyers

J. L.

Leite

W. L.

(2002). A reliability generalization study of the Marlowe-Crown Social Desirability Scale. Educational & Psychological Measurement, 62, 570–589.

13.

Braunt

St-Hilaire

Jehel

King

(2003). Validation of a French version of the impact of event scale-revised. Canadian Journal of Psychiatry, 48, 56.

14.

Briere

Elliott

(1998). Clinical utility of the impact of event scale: Psychometrics in the general population. Assessment, 5, 171–180.

15.

Chen

Yang

Yen

(2005). Validation of events scale in nurses under threat of contagion by severe acute respiratory syndrome. Neurosciences, 59, 135–139.

16.

Cheung

M. C.

Easthope

Eaton

McHugh

(1999). Describing traumatic responses and distress of community residents directly and indirectly exposed to an aircraft crash. Psychiatry, 62, 126–137.

17.

Cohen

Moor

Devine

Baum

Amato

(2001). Endocrine levels at the start of treatment are associated with subsequent psychological adjustment in cancer patients with metastatic disease. Psychosomatic Medicine, 63, 951–958.

18.

Costello

E. J.

Erkanli

Fairbank

J. A.

Angold

(2002). The prevalence of potentially traumatic events in childhood and adolescence. Journal of Traumatic Stress, 15, 99–112.

19.

D'Errico

Galassi

Schanger

(1999). Journal of Psychosocial Oncology, 17, 119–137.

20.

De Jongh

Van der Burg

Van Overmeir

Aartman

Van Zuuren

(2002). Trauma-related sequel in individuals with a high level of dental anxiety. Does this interfere with treatment outcome? Behavior Research & Therapy, 40, 1017.

21.

Dyregrov

Gjestad

(2003). A maritime disaster: Reactions and follow-up. International Journal of Emergency Mental Health, 5, 3–14.

22.

Dyregrov

Frykholm

Lilled

(2003). The Goteborg discotheque fire, 1998. Scandinavian Journal of Psychology, 44, 449–457.

23.

Dyregrov

Gjestad

Raundalen

(2002). Children exposed to warfare: A longitudinal study. Journal of Traumatic Stress, 15, 59–68.

24.

Eid

Johnson

Thayer

(2001). Post-traumatic stress symptoms following shipwreck of a Norwegian navy frigate — An early follow-up. Personality and Individual Differences, 30, 1283–1295.

25.

Eid

Thayer

Johnson

(1999). Measuring post-traumatic stress: A psychometric evaluation of symptom and coping questionnaires based on a Norwegian sample. Scandinavian Journal of Psychology, 40, 101–108.

26.

Everly

G. S.

Mitchell

J. T.

(1999). Critical Incident Stress Management: A New Era and Standard of Care in Crisis Intervention. Ellicott City, MD: Chevron Publishing.

27.

Fletcher

K. E.

(2003). Childhood Postraumatic Stress Disorder. In Mash

E. J.

Barkley

R. A.

, Child Psychopathology (pp. 330–371). New York; Guilford.

28.

Friedberg

Adonis

Von Bergen

(2005). Short communication: September 11th related stress and trauma in New Yorkers. Stress and Health: Journal of the International Society for the Investigation of Stress, 21, 53–60.

29.

Glassen

Butler

Koopman

Miller

DiMiceli

Giese-Davis

Fobair

Carlson

Kraemer

Spiegel

(2001). Supportive-expressive group therapy and distress with metastatic breast cancer. Archives of General Psychiatry, 58, 494–501.

30.

Grossman

Lee

Van Neste

McHarg

Godin

Chambers-Evans

(2000). Psychological adjustment of critically injured patients three months after an unexpected, potentially life-threatening accident. Journal of Clinical Nursing, 9, 801–815.

31.

Gullicksen

(1950). Theory of mental tests. New York: Wiley.

32.

Helgeson

Cohen

Shultz

(1999). Education and peer discussion group interventions and adjustment to breast cancer. Archives of General Psychiatry, 56, 340–347.

33.

Henson

R. K.

Thompson

(2002). Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113–127.

34.

Horowitz

Wilner

Alvarez

(1979). Impact of event scale: a measure of psychological stress. Psychosomatic Medicine, 41, 209–218.

35.

Jacobson

Ting

Sanders

Harrington

(2004). Prevalence of and reactions to fatal and nonfatal client suicidal behavior: A national study of mental health social workers. Journal of Death & Dying, 49, 231–248.

36.

Janson

Hazler

(2004). Trauma reactions of bystanders and victims to repetitive abuse experiences. Violence and Victims, 19, 239–255.

37.

Joseph

(2000). Psychometric evaluation of Horowitz's impact of event scale: A review. Journal of Traumatic Stress, 13, 101–113.

38.

Kagee

(2005). Symptoms of distress and posttraumatic stress among South African former political detainees. Ethnicity & Health, 10, 169–179.

39.

Kamphuis

Emmelkamp

(2001). Traumatic distress among support-seeking female victims of stalking. The American Journal of Psychiatry, 158, 795–798.

40.

Kamphuis

Emmelkamp

(1998). Crime-related trauma: Psychological distress in victims of bank robbery. Journal of Anxiety Disorders, 12, 199–208.

41.

Kazak

Alderfer

Rourke

(2004). Posttraumatic stress disorder (PTSD) and posttraumatic stress symptoms (PTSS) in families of adolescent childhood cancer survivors. Journal of Pediatric Psychology, 29, 211–219.

42.

Kimerling

Calhoun

Forehand

(1999). Traumatic stress in HIV-infected women. Education and Prevention, 11, 321–330.

43.

Leskin

G. A.

Kaloupek

D. G.

Kean

T. M.

(1998). Treatment for traumatic memories: review and recommendations. Clinical Psychology Review, 18, 983–1002.

44.

McClatchey

Vonk

(2005). An exploratory study of post-traumatic stress disorder symptoms among bereaved children. Journal of Death & Dying, 51, 285–300.

45.

McNally

R. J.

(1996). Assessment of posttraumatic stress disorder in children and adolescents. Journal of School Psychology, 34, 147–161.

46.

McNally

R. J.

(1991). Assessment of posttraumatic stress disorder in children. Psychological Assessment, 3, 531–537.

47.

Mercklebach

Dekkers

Wessel

Roefs

(2003). Disscociative symptoms and amnesia in dutch concentration camp survivors. Comprehensive Psychiatry, 44, 65–69.

48.

Metcalfe

Liede

Trinkaus

Hanna

Narod

(2002). Evaluation of the needs of spouses of female carriers of mutations in BRCA1 and BRCA2. Clinical Genetics, 62, 464–469.

49.

Mitzota

Ozawa

Yamazaki

Inoue

(2005). Psychosocial problems of bereaved families of HIV-infected hemophiliacs in Japan. Social Science & Medicine, 62, 2397–2410.

50.

Motta

R. W.

(1995). Childhood posttraumatic stress disorder and school psychology. The School Psychologist, 49(1), 15–17.

51.

Murphy

Beaton

Pike

Occupational stressors, stress responses, and alcohol consumption among professional firefighters: A prospective, longitudinal analysis. International Journal of Stress Management, 6, 179–196.

52.

Newcomer

Frank

(2003). Features of posttraumatic distress among adolescent athletes. Journal of Athletic Training, 38, 163–166.

53.

Norris

F. H.

(1988). Toward establishing a database for the prospective study of traumatic stress. Paper presented at the National Institute of Mental Health workshop Traumatic Stress: Defining Terms and Instruments, Uniformed Services University of the Health Sciences, Bethesda, MD.

54.

Perrin

Meiser-Stedman

Smith

(2005). The Children's Revised Impact of Event Scale (CRIES): Validity as a screening instrument for PTSD. Behavioural and Cognitive Psychotherapy, 33, 487–498.

55.

Pietrantonio

Gennaro

Di Paolo

(2003). The impact of event scale: Validation of an Italian version. Journal of Psychosomatic Research, 55, 389–393.

56.

Pope

Adler

Tschann

(2001). Post-abortion psychological adjustment: Are minors at increased risk? Journal of Adolescent Health, 29, 2–11.

57.

Quinnell

Hynan

(1999). Convergent and discriminant validity of the Prenatal PTSD questionnaire (PPQ): A preliminary study. Journal of Traumatic Stress, 12, 193–199.

58.

Read

(2004). Using the impact of event scale to evaluate psychological response to being a phenylketonuria gene carrier. Journal of Genetic Counseling, 13, 207–219.

59.

Renck

Weisaeth

Skarbo

(2002). Stress reactions in police officers after a disaster rescue operation. Nordic Journal of Psychiatry, 56, 7–14.

60.

Richmond

Kauder

(2000). Predictors of psychological distress following serious injury. Journal of Traumatic Stress, 13, 681–692.

61.

Sack

Seeley

Him

(1998). Psychometric properties of the Impact of Events Scale in traumatized Cambodian refugee youth. Personality and Individual Differences, 25, 57–67.

62.

Scott

Dua

(1999). Development of a scale to assess posttraumatic stress disorder. International Journal of Stress Management, 6(3), 149–165.

63.

Schnyder

Hanspeter

(2002). German version of clinician-administered PTSD scale. Journal of Traumatic Stress, 15, 487–492.

64.

Schnyder

Moegeli

Klaghofer

Buddeberg

(2001). Incidence and prediction of posttraumatic stress disorder symptoms in severely injured accident victims. The American Journal of Psychiatry, 158, 594–599.

65.

Schreiber

Soskolne

Kozohovitch

(2004). Holocaust survivors coping with open heart surgery decades later. Posttraumatic symptoms and quality of life. General Hospital Psychiatry, 26, 443–452.

66.

Segerstrom

Solomon

Kemeny

(1998). Relationship of worry to immune sequel of the Northridge earthquake. Journal of Behavioral Medicine, 21, 433–450.

67.

Shapinsky

Rapport

Hederson

Axelrod

(2005). Civilian PTSD scales. Assessment, 12, 220–230.

68.

Shelvin

Hunt

(2000). A confirmatory factor analysis of the impact of event scale using a sample of World War II and Korean War veterans. Psychological Assessment, 12, 414.

69.

Shields

A. L.

Caruso

J. C.

(2004). A reliability induction and reliability generalization study of the CAGE Questionnaire. Educational and Psychological Measurement, 64, 254–270.

70.

Smith

Perrin

Dyregrov

Yule

(2003). Principal components analysis of the impact of event scale with children in war. Personality and Individual Differences, 34, 315–322.

71.

Sondergaard

Theorell

(2004). Language acquisition in relation to cumulative posttraumatic stress disorder symptom load over time in a sample of resettled refugees. Psychotherapy and Psychosomatics, 73, 320–323.

72.

Steed

Bicknell

(2001). Trauma and the therapist: The experience of therapists working with the perpetrators of sexual abuse. The Australasian Journal of Disaster, 1, 1–10.

73.

Sundin

Horowitz

(2002). Impact of event scale: Psychometric properties. British Journal of Psychiatry, 180, 205–209.

74.

Thatcher

Krikorian

(2005). Exploratory factor analysis of two measures of posttraumatic stress disorder (PTSD) symptoms in a non-clinical sample of college students. Journal of Anxiety Disorders, 19, 904–914.

75.

Thewes

Meiser

Hickie

(2001). Psychometric properties of the impact of event scale amongst women at increased risk for hereditary breast cancer. Psycho-Oncology, 10, 459–468.

76.

Thompson

Vacha-Haase

(2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174–195.

77.

Thulesius

Alveblom

Hakansson

(2004). Post-traumatic stress associated with low self-rated well-being in primary care attenders. Nordic Journal of Psychiatry, 58, 261–266.

78.

Timman

Roos

Maat-Kievit

(2004). Adverse effects of predictive testing for Huntington disease underestimated: Long-term effects 7–10 years after the test. Health Psychology, 23, 189–197.

79.

Ting

Sanders

Smith

(2002). The teachers' reactions to school violence scale: Psychometric properties and scale development. Educational and Psychological Measurement, 62, 1006–1019.

80.

Ulrich

Lutgendorf

Stapelton

(2002). Social constraints and depression in HIV infection: Effects of sexual orientation and area of residence. Journal of Social and Clinical Psychology, 21, 46–66.

81.

Vacha-Haase

(1998). Reliability Generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 60, 174–195.

82.

Van der Ploeg

Mooren

Kleber

Van der Velden

Brom

(2004). Construct validation of the Dutch version of the impact of event scale. Psychological Assessment, 16, 16–26.

83.

Weiss

Marmar

(1997). The Impact of Event Scale-Revised. In Wilson

Keane

(Eds.), Assessing Psychological Trauma and PTSD. New York: Guilford.

84.

Willebrand

Wikehult

Ekselius

(2004). Acceptance of a trauma-focused survey: Do personality and health matter? General Hospital Psychiatry, 26, 70–77.

85.

Witteveen

Bransen

Hovens

Van der Ploeg

(2005). Utility of the impact of event scale in screening for posttraumatic stress disorder. Psychological Reports, 97, 297–308.

86.

Wohlfarth

Van den Brink

Winkel

Smitten

(2003). Screening for posttraumatic stress disorder: An evaluation of two self-report scales among crime victims. Psychological Assessment, 15, 101.

87.

(2002). Use of eye movement desensitization and reprocessing for treatment post-traumatic stress disorder after a motor vehicle accident. Hong Kong Journal of Psychiatry, 12, 20–14.

88.

Sumee

(2004). Psychometric properties of the Chinese version of the impact of event scale-revised. Hong Kong Journal of Psychiatry, 14, 2–8.

89.

Chan

(2003). The development of the Chinese version of impact of event scale — revised (CIES-R). Social Psychiatry Epidemiology, 39, 94–98.

90.

Zilberg

Weiss

Horowitz

(1982). Impact of event scale: a cross-validation study and some empirical evidence supporting a model of stress response syndromes. Journal of Counseling and Clinical Psychology, 50, 407–414.