Measurement of Risk Factors Associated With bereavement Severity and Deterioration by COVID-19: A Spanish Validation Study of the Pandemic Grief Risk Factors

Abstract

The present study translated and evaluated the psychometric evidence of the Pandemic Grief Risk Factors (PGRF) in a sample of 363 people from the general population of Peru who suffered the death of a loved one by COVID-19 (63-4% women and 36.6% men, where 78.5% were between 18 and 29 years old). The findings indicated that the PGRF is a unidimensional and reliable measure. The PGRF items can differentiate between individuals with different levels of risk factors and thus cover a wide range of the latent construct. Also, a greater sense of distress for each of the risk factors for pandemic grief is necessary to answer the higher response categories. Risk factors significantly and positively predict COVID-19-associated dysfunctional grief. The results indicated that the PGRF in Spanish is a measure with adequate psychometric properties to measure risk factors for pandemic grief.

Keywords

COVID-19 pandemic grief risk factors unidimensional validity

Get full access to this article

View all access options for this article.

References

Arafat

S. Y.

Chowdhury

H. R.

Qusar

M. M. A. S.

Hafez

M. A.

(2016). Cross cultural adaptation & psychometric validation of research instruments: A methodological review. Journal of Behavioral Health, 5(3), 129–136. https://doi.org/10.5455/jbh.20160615121755

Boelen

P. A.

Eisma

M. C.

Smid

G. E.

Keijser

J. D.

Lenferink

L. I.

(2021). Remotely delivered cognitive behavior therapy for disturbed grief during the COVID-19 crisis: Challenges and opportunities. Journal of Loss and Trauma, 26(3), 211–219. https://doi.org/10.1080/15325024.2020.1793547

Breen

L. J.

Lee

S. A.

Neimeyer

R. A.

(2021). Psychological risk factors of functional impairment after COVID-19 deaths. Journal of Pain and Symptom Management, 61(4), e1–e4. https://doi.org/10.1016/j.jpainsymman.2021.01.006

Breen

L. J.

Mancini

V. O.

Lee

S. A.

Pappalardo

E. A.

Neimeyer

R. A.

(2022). Risk factors for dysfunctional grief and functional impairment for all causes of death during the COVID-19 pandemic: The mediating role of meaning. Death Studies, 46(1), 43–52. https://doi.org/10.1080/07481187.2021.1974666

Burke

L. A.

Neimeyer

R. A.

(2014). Complicated spiritual grief I: Relation to complicated grief symptomatology following violent death bereavement. Death Studies, 38(4), 259–267. https://doi.org/10.1080/07481187.2013.829372

Cai

Chung

S. W.

Lee

(2021). Incremental model fit assessment in the case of categorical data: Tucker–lewis index for item response theory modeling. Prevention Science. Online ahead of print. https://doi.org/10.1007/s11121-021-01253-4

Cai

Monroe

(2014). A new statistic for evaluating item response theory models for ordinal data. https://files.eric.ed.gov/fulltext/ED555726.pdf

Caycho-Rodríguez

Barboza-Palomino

Ventura-León

Carbajal-León

Noé-Grijalva

Gallegos

Reyes-Bossio

Vivanco-Vidal

(2020). Traducción al español y validación de una medida breve de ansiedad por la COVID-19 en estudiantes de ciencias de la salud. Ansiedad y Estrés, 26(2–3), 174–180. https://doi.org/10.1016/j.anyes.2020.08.001

Caycho-Rodríguez

Valencia

P. D.

Vilca

L. W.

Carbajal-León

Vivanco-Vidal

Saroli-Araníbar

Reyes-Bossio

White

Rojas-Jara

Polanco-Carrasco

Gallegos

Cervigni

Martino

Palacios

D. A.

Moreta-Herrera

Samaniego-Pinho

Lobos-Rivera

M. E.

Figares

A. B.

Puerta-Cortes

D. X.

Flores-Mendoza

(2022d). Cross-cultural validation of the new version of the Coronavirus Anxiety Scale in twelve Latin American countries. Current Psychology, 1–18. https://doi.org/10.1007/s12144-021-02563-0

10.

Caycho-Rodríguez

Valencia

P. D.

Vilca

L. W.

Lee

S. A.

Carbajal-León

Vivanco-Vidal

Saroli-Aranibar

Reyes-Bossio

White

Rojas-Jara

Polanco-Carrasco

Gallegos

Cervigni

Martino

Palacios

D. A.

Moreta-Herrera

Samaniego-Pinho

Rivera

M. E. L.

Figares

A. B.

Gallegos

W. L. A.

(2021a). COVID-19 bereavement in ten Latin American countries: Measurement invariance of the pandemic grief scale and its relation to suicidal ideation. OMEGA-Journal of Death and Dying. Advanced online publication, 00302228211048566. https://doi.org/10.1177/00302228211048566

11.

Caycho-Rodríguez

Vilca

L. W.

Valencia

P. D.

Carbajal-León

Vivanco-Vidal

Saroli-Araníbar

Reyes-Bossio

White

Rojas-Jara

Polanco-Carrasco

Gallegos

Cervigni

Martino

Palacios

D. A.

Moreta-Herrera

Samaniego-Pinho

Lobos-Rivera

M. E.

Ferrari

I. F.

Flores-Mendoza

Gallegos

W. L. A.

(2021d). Cross-cultural validation of a new version in Spanish of four items of the preventive COVID-19 infection behaviors scale (PCIBS) in twelve Latin American countries. Frontiers in Psychology, 12, 763993. https://doi.org/10.3389/fpsyg.2021.763993

12.

Caycho-Rodríguez

Vilca

L. W.

Vivanco-Vidal

Saroli-Araníbar

Carbajal-León

Gallegos

W. L. A.

White

Lee

S. A.

(2021b). Assessment of dysfunctional grief due to death from COVID-19 in Peru: Adaptation and validation of a Spanish version of the pandemic grief scale. Trends in Psychology, 29(4), 595–616. https://doi.org/10.1007/s43076-021-00091-1

13.

Caycho-Rodríguez

Vilca

L. W.

Carbajal-León

Heredia-Mongrut

Gallegos

Portillo

Reyes-Bossio

Barboza-Palomino

(2021c). Obsession with Covid-19 in Peruvian police and armed forces: Validation of the obsession with Covid-19 Scale in Spanish using SEM and IRT models. Death Studies, 46(9), 1–11. https://doi.org/10.1080/07481187.2021.1900453

14.

Caycho-Rodríguez

Valencia

P. D.

Gallegos

Intimayta-Escalante

White

(2022a). Dysfunctional grief related to COVID-19 in Latin America. Electronic Journal of General Medicine, 19(2), em344. https://doi.org/10.29333/ejgm/11543

15.

Caycho-Rodríguez

Vilca

L. W.

Peña-Calero

B. N.

Barboza-Palomino

White

Reyes-Bossio

(2022b). Measurement of coronaphobia in older adults: Validation of the Spanish version of the coronavirus anxiety scale. Revista Espanola de Geriatria y Gerontologia, 57(1), 20–27. https://doi.org/10.1016/j.regg.2021.09.001

16.

Caycho-Rodríguez

Vilca

L. W.

Carbajal-León

White

Vivanco-Vidal

Saroli-Araníbar

Pena-Calero

B. N.

Moreta-Herrera

(2022c). Coronavirus Anxiety Scale: New psychometric evidence for the Spanish version based on CFA and IRT models in a Peruvian sample. Death Studies, 46(5), 1090–1099. https://doi.org/10.1080/07481187.2020.1865480

17.

Chalmers

R. P.

(2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

18.

Cohen

J. A.

Mannarino

A. P.

Greenberg

Padlo

Shipley

(2002). Childhood traumatic grief: Concepts and controversies. Trauma, Violence, & Abuse, 3(4), 307–327. https://doi.org/10.1177/1524838002237332

19.

Coronavirus Resource Center (2021). COVID-19 dashboard by the center for systems science and engineering (CSSE) at. Johns Hopkins University (JHU). https://coronavirus.jhu.edu/map.html

20.

Cronbach

L. J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555

21.

De Ayala

R. J.

(1994). The influence of multidimensionality on the graded response model. Applied Psychological Measurement, 18(2), 155–170. https://doi.org/10.1177/014662169401800205

22.

Eisma

M. C.

Boelen

P. A.

Lenferink

L. I.

(2020). Prolonged grief disorder following the Coronavirus (COVID-19) pandemic. Psychiatry Research, 288, Article 113031. https://doi.org/10.1016/j.psychres.2020.113031

23.

Eisma

M. C.

Tamminga

(2022). Grief before and during the COVID-19 pandemic: Multiple group comparisons. Journal of Pain and Symptom Management, 60(6), e1–e4. https://doi.org/10.1016/j.jpainsymman.2020.10.004

24.

Embretson

S. E.

Reise

S. P.

(2000). Item response theory for psychologists. LEA.

25.

Ennis

Bottomley

Sawyer

Moreland

A. D.

Rheingold

A. A.

(2022). Measuring grief in the context of traumatic loss: A systematic review of assessment instruments. Trauma, Violence, & Abuse, 152483802210936. https://doi.org/10.1177/15248380221093694

26.

Finney

S. J

DiStefano

(2006). Non-normal and categorical data in SEM. In Hancock

G. R.

Mueller

R. O.

(Eds.), Structural equation modeling: A second course. Information Age Publishing.

27.

Gabay

Tarabeih

(2022). Death from COVID-19, muslim death rituals and disenfranchised grief–A patient-centered care perspective. OMEGA-Journal of Death and Dying, 00302228221095717. https://doi.org/10.1177/00302228221095717

28.

Griffiths

M. D.

(2010). The use of online methodologies in data collection for gambling and gaming addictions. International Journal of Mental Health and Addiction, 8(1), 8–20. https://doi.org/10.1007/s11469-009-9209-1

29.

Halford

E. A.

Lake

A. M.

Gould

M. S.

(2020). Google searches for suicide and suicide risk factors in the early stages of the COVID-19 pandemic. PloS One, 15(7), Article e0236777. https://doi.org/10.1371/journal.pone.0236777

30.

Hambleton

R. K.

Swaminathan

y Rogers

(1991). Fundamentals of item response theory. Sage.

31.

Hambleton

R. K.

van der Linden

W. J.

Wells

C. S.

(2010). IRT models for the analysis of polytomously scored data: Brief and selected history of model building advances. In Nering

M. L.

Ostini

(Eds.), Handbook of polytomous item response models (pp. 21–42). Routledge.

32.

Hays

R. D.

Morales

L. S.

Reise

S. P.

(2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38(9 Suppl), II28–II42. https://doi.org/10.1097/00005650-200009002-00007

33.

Jakoby

N. R.

(2012). Grief as a social emotion: Theoretical perspectives. Death Studies, 36(8), 679–711. https://doi.org/10.1080/07481187.2011.584013

34.

Joaquim

R. M.

Pinto

A. L.

Guatimosim

R. F.

de Paula

J. J.

Costa

D. S.

Diaz

A. P.

da Silva

A. G.

Pinheiro

M. I.

Serpa

A. L.

Miranda

D. M.

Malloy-Diniz

L. F.

(2021). Bereavement and psychological distress during COVID-19 pandemics: The impact of death experience on mental health. Current Research in Behavioral Sciences, 2, Article 100019. https://doi.org/10.1016/j.crbeha.2021.100019

35.

Jones

E. A.

Mitra

A. K.

Bhuiyan

A. R.

(2021). Impact of COVID-19 on mental health in adolescents: A systematic review. International Journal of Environmental Research and Public Health, 18(5), 2470. https://doi.org/10.3390/ijerph18052470

36.

Jordan

A. H.

Litz

B. T.

(2014). Prolonged grief disorder: Diagnostic, assessment, and treatment considerations. Professional Psychology: Research and Practice, 45(3), 180–187. https://doi.org/10.1037/a0036836

37.

Jorgensen

T. D.

Pornprasertmanit

Schoemann

A. M.

Rosseel

(2018). semTools: Useful tools for structural equation modeling. R package version 0.5-1 https://cran.r-project.org/package=semTools

38.

Keith

T. Z.

(2019). Multiple regression and beyond: An introduction to multiple regression and structural equation modeling. Routledge.

39.

Kline

R. B.

(2015). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.

40.

Kokou-Kpolou

C. K.

Fernández-Alcántara

Cénat

J. M.

(2020). Prolonged grief related to COVID-19 deaths: Do we have to fear a steep rise in traumatic and disenfranchised griefs? Psychological Trauma: Theory, Research, Practice, and Policy, 12(S1), S94–S95. https://doi.org/10.1037/tra0000798

41.

Kumar

R. M.

(2021). The many faces of grief: A systematic literature review of grief during the COVID-19 pandemic. Illness Crisis & Loss, Article 10541373211038084. https://doi.org/10.1177/10541373211038084

42.

Lee

S. A.

Neimeyer

R. A.

(2022). Pandemic grief scale: A screening tool for dysfunctional grief due to a COVID-19 loss. Death Studies, 46(1), 14–24. https://doi.org/10.1080/07481187.2020.1853885

43.

Lee

S. A.

Neimeyer

R. A.

Breen

L. J.

(2021). The utility of the Pandemic Grief Scale in identifying functional impairment from COVID-19 bereavement. Journal of Palliative Medicine, 24(12), 1783–1788. https://doi.org/10.1089/jpm.2021.0103

44.

C. H.

(2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. https://doi.org/10.3758/s13428-015-0619-7

45.

Lubbe

Schuster

(2019). A graded response model framework for questionnaires with uniform response formats. Applied Psychological Measurement, 43(4), 290–302. https://doi.org/10.1177/0146621618789394

46.

Lund

P. C.

(2021). Deconstructing grief: A sociological analysis of prolonged grief disorder. Social Theory & Health, 19(2), 115–186. https://doi.org/10.1057/s41285-020-00135-z

47.

Lundorff

Holmgren

Zachariae

Farver-Vestergaard

O’Connor

(2017). Prevalence of prolonged grief disorder in adult bereavement: A systematic review and meta-analysis. Journal of Affective Disorders, 212, 138–149. https://doi.org/10.1016/j.jad.2017.01.030

48.

Maercker

Neimeyer

R. A.

Simiola

(2017). Depression and complicated grief. In Gold

S. N.

(Ed.), APA handbook of trauma psychology: Foundations in knowledge (pp. 185–194). American Psychological Association. https://doi.org/10.1037/0000019-011

49.

Maydeu-Olivares

Joe

(2014). Assessing approximate fit in categorical data analysis. Multivariate Behavioral Research, 49(4), 305–328. https://doi.org/10.1080/00273171.2014.911075

50.

McDonald

R. P.

(1999). Test theory: A unified treatment. Taylor & Francis.

51.

Menzies

R. E.

Neimeyer

R. A.

Menzies

R. G.

(2020). Death anxiety, loss, and grief in the time of COVID-19. Behaviour Change, 37(3), 111–115. https://doi.org/10.1017/bec.2020.10

52.

Milman

Neimeyer

R. A.

Fitzpatrick

MacKinnon

C. J.

Muis

K. R.

Cohen

S. R.

(2019a). Prolonged grief and the disruption of meaning: Establishing a mediation model. Journal of Counseling Psychology, 66(6), 714–725. https://doi.org/10.1037/cou0000370

53.

Milman

Neimeyer

R. A.

Fitzpatrick

MacKinnon

C. J.

Muis

K. R.

Cohen

S. R.

(2019b). Rumination moderates the role of meaning in the development of prolonged grief symptomatology. Journal of Clinical Psychology, 75(6), 1047–1065. https://doi.org/10.1002/jclp.22751

54.

Min

Kim

Moon

Lee

Kim

J. Y.

Y. G.

(2022). Development and validation of COVID-19 impact scale. BMC Psychology, 10(1), 1–10. https://doi.org/10.1186/s40359-022-00793-w

55.

Morris

S. E.

Moment

Thomas

J. D.

(2020). Caring for bereaved family members during the COVID-19 pandemic: Before and after the death of a patient. Journal of Pain and Symptom Management, 60(2), e70–e74. https://doi.org/10.1016/j.jpainsymman.2020.05.002

56.

Murata

Rezeppa

Thoma

Marengo

Krancevich

Chiyka

Hayes

Goodfriend

Deal

Zhong

Brummit

Coury

Riston

Brent

D. A.

Melhem

N. M.

(2021). The psychiatric sequelae of the COVID-19 pandemic in adolescents, adults, and health care workers. Depression and Anxiety, 38(2), 233–246. https://doi.org/10.1002/da.23120

57.

Neimeyer

R. A.

Burke

L. A.

(2017). Spiritual distress and depression in bereavement: A meaning-oriented contribution. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 35(1), 38–59. https://doi.org/10.1007/s10942-017-0262-6

58.

Neimeyer

R. A.

Lee

S. A.

(2022). Circumstances of the death and associated risk factors for severity and impairment of COVID-19 grief. Death Studies, 46(1), 34–42. https://doi.org/10.1080/07481187.2021.1896459

59.

Nochaiwong

Ruengorn

Thavorn

Hutton

Awiphan

Phosuya

Ruanta

Wongpakaran

(2021). Global prevalence of mental health issues among the general population during the coronavirus disease-2019 pandemic: A systematic review and meta-analysis. Scientific Reports, 11(1), 1–18. https://doi.org/10.1038/s41598-021-89700-8

60.

Noe-Grijalva

Polo-Ambrocio

Gómez-Bedia

Caycho-Rodríguez

(2022). Spanish translation and validation of the COVID stress scales in Peru. Frontiers in Psychology, 13, 840302. https://doi.org/10.3389/fpsyg.2022.840302

61.

Petry

S. E.

Hughes

Galanos

(2021). Grief: The epidemic within an epidemic. American Journal of Hospice and Palliative Medicine, 38(4), 419–422. https://doi.org/10.1177/1049909120978796

62.

Ramírez-Soto

M. C.

Ortega-Cáceres

Arroyo-Hernández

(2022). Excess all-cause deaths stratified by sex and age in Peru: A time series analysis during the COVID-19 pandemic. BMJ Open, 12(3), Article e057056. https://doi.org/10.1136/bmjopen-2021-057056

63.

Raykov

Hancock

G. R.

(2005). Examining change in maximal reliability for multiple-component measuring instruments. British Journal of Mathematical and Statistical Psychology, 58(1), 65–82. https://doi.org/10.1348/000711005X38753

64.

R Core Team (2019). A language and environment for statistical computing (version 3.6.1). RR Foundation for Statistical Computing. http://www.r-project.org/

65.

Robinson

Sutin

A. R.

Daly

Jones

(2022). A systematic review and meta-analysis of longitudinal cohort studies comparing mental health before versus during the COVID-19 pandemic in 2020. Journal of Affective Disorders, 296, 567–576. https://doi.org/10.1016/j.jad.2021.09.098

66.

Roccato

(2006). L’inchiesta e il sondaggio nella ricerca psicosociale. Il Mulino.

67.

Rosseel

(2012). Lavaan : An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

68.

RStudio Team (2018). RStudio: Integrated Development Environment for R. RStudio, Inc. http://www.rstudio.com/

69.

Rynearson

E. K.

Salloum

(2011). Restorative retelling: Revisiting the narrative of violent death. In Neimeyer

R. A.

Harris

Winokuer

Thornton

(Eds.), Grief and bereavement in contemporary society: Bridging research and practice (pp. 177–188). Routledge.

70.

Schumacker

R. E.

Lomax

R. G.

(2015). A beginner’s guide to structural equation modeling (4th ed.). Routledge.

71.

Shear

M. K.

Simon

Wall

Zisook

Neimeyer

Duan

Reynolds

Lebowitz

Sung

Ghesquiere

Gorscak

Clayton

Ito

Nakajima

Konishi

Melhem

Meert

Schiff

O'Connor

M. F.

Keshaviah

(2011). Complicated grief and related bereavement issues for DSM-5. Depression and Anxiety, 28(2), 103–117. https://doi.org/10.1002/da.20780

72.

Sijtsma

Emons

W. H.

Bouwmeester

Nyklíček

Roorda

L. D.

(2008). Nonparametric IRT analysis of quality-of-life scales and its application to the world health organization quality-of-life scale (WHOQOL-Bref). Quality of Life Research, 17(2), 275–290. https://doi.org/10.1007/s11136-007-9281-6

73.

Silverman

G. S.

Baroiller

Hemer

S. R.

(2021). Culture and grief: Ethnographic perspectives on ritual, relationships and remembering. Death Studies, 45(1), 1–8. https://doi.org/10.1080/07481187.2020.1851885

74.

Skalski

Konaszewski

Dobrakowski

Surzykiewicz

Lee

S. A.

(2021). Pandemic grief in Poland: Adaptation of a measure and its relationship with social support and resilience. Current Psychology, 1–9. https://doi.org/10.1007/s12144-021-01731-6

75.

Sousa

V. D.

Rojjanasrirat

(2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268–274. https://doi.org/10.1111/j.1365-2753.2010.01434.x

76.

Stage

F. K.

Carter

H. C.

Nora

(2004). Path analysis: An introduction and analysis of a decade of research. The Journal of Educational Research, 98(1), 5–13. https://doi.org/10.3200/JOER.98.1.5-13

77.

Tabachnick

B. G

Fidell

L. S.

(2001). Using multivariate statistics. Allyn and Bacon.

78.

Tang

Chen

Fan

Eisma

M. C.

(2021). Correlates of mental health after COVID-19 bereavement in Mainland China. Journal of Pain and Symptom Management, 61(6), e1–e4. https://doi.org/10.1016/j.jpainsymman.2021.02.016

79.

Tobroni

Rizqi

Pelana

Sianipar

Fathurrochman

(2020). Covid 19: Political cooperation and ritual modification of religious worship through large-scale social restrictions. Systematic Reviews in Pharmacy, 11(12), 644–648.

80.

Ventura-León

(2020). Dos formas fáciles de interpretar las famosas cargas factoriales. Gaceta Sanitaria, 33(6), 599–599. https://doi.org/10.1016/j.gaceta.2019.04.002

81.

Verdery

A. M.

Smith-Greenaway

Margolis

Daw

(2020). Tracking the reach of COVID-19 kin loss with a bereavement multiplier applied to the United States. Proceedings of the National Academy of Sciences, 117(30), 17695–17701. https://doi.org/10.1073/pnas.2007476117

82.

Wand

A. P. F.

Zhong

B. L.

Chiu

H. F. K.

Draper

De Leo

(2020). COVID-19: The implications for suicide in older adults. International Psychogeriatrics, 32(10), 1225–1230. https://doi.org/10.1017/S1041610220000770

83.

Wilson Van Voorhis

C. R.

Morgan

B. L.

(2007). Understanding power and rules of thumb for determining sample sizes. Tutorial in Quantitative Methods for Psychology, 3(2), 43–50. https://doi.org/10.20982/tqmp.03.2.p043

84.

Jia

Shi

Niu

Yin

Xie

Wang

(2021). Prevalence of mental health problems during the COVID-19 pandemic: A systematic review and meta-analysis. Journal of Affective Disorders, 281, 91–98. https://doi.org/10.1016/j.jad.2020.11.117

85.

Zisook

Simon

N. M.

Reynolds

C. F.

III Pies

Lebowitz

Young

I. T.

Madowitz

Shear

M. K.

(2010). Bereavement, complicated grief, and DSM, part 2: Complicated grief. The Journal of Clinical Psychiatry, 71(8), 1098–1869. https://doi.org/10.4088/jcp.10ac06391blu