Effects of Question Methods in Assessing Fear of Hate Crimes

Abstract

This study examined episodic measures that assess frequency and magnitude of perceived threat of hate crime over the last six months compared to standard methods that address diffuse threat. Framing effects of question wording, worry- versus fear- versus safety-based, were also assessed. Using Amazon’s Mechanical Turk, a sample of 1,824 adults vulnerable to hate crime completed one of the three randomly assigned survey questionnaires that varied the question wording. Results show that standard measures tend to yield higher levels of perceived threat of hate crime across different bias motivations than episodic measures. Worry- and fear-based questions were also associated with higher odds of perceived threat of hate crime than safety-based questions. Findings, implications, and future directions are discussed.

Keywords

fear of crime threat of crime victimization hate crime question method methodology

Get full access to this article

View all access options for this article.

References

Altarriba

Bauer

L. M.

(2004). The distinctiveness of emotion concepts: A comparison between emotion, abstract, and concrete words. The American Journal of Psychology, 117(3), 389–410.

Bandalos

D. L.

(2018). Measurement theory and applications for the social sciences. Guilford Publications.

Bills

M. A.

Vaughn

M. S.

(2022). A contemporary review of hate crime legislation in the United States. Criminal Justice Policy Review, 34(2), 115–139.

Boeckmann

R. J.

Turpin-Petrosino

(2002). Understanding the harm of hate crime. Journal of Social Issues, 58(2), 207–225.

CDC. (2020). Disability and health overview. https://www.cdc.gov/ncbddd/disabilityandhealth/disability.html

Chataway

M. L.

Hart

T. C.

Bond

(2019). The social-psychological process of fearing crime: Developing and testing a new momentary model of victimisation worry. Australian & New Zealand Journal of Criminology, 52(4), 462–482.

Chongatera

(2013). Hate-crime victimization and fear of hate crime among racially visible people in Canada: The role of income as a mediating factor. Journal of Immigrant & Refugee Studies, 11(1), 44–64.

Coppock

McClellan

O. A.

(2019). Validating the demographic, political, psychological, and experimental results from a new source of online survey respondents. Research and Politics, 6(1), 1–14.

Cossman

J. S.

Rader

N. E.

(2011). Fear of crime and personal vulnerability: Examining self-reported health. Sociological Spectrum, 31(2), 141–162.

10.

Craig-Henderson

Sloan

L. R.

(2006). After the hate: Helping psychologists help victims of racist hate crime. Clinical Psychology: Science and Practice, 10(4), 481–490.

11.

Eitle

Taylor

(2008). Are Hispanics the new ‘Threat’? Minority group threat and fear of crime in Miami-Dade County. Social Science Research, 37(4), 1102–1115.

12.

Etopio

A. L.

Berthelot

E. R.

(2022). Defining and measuring fear of crime: A new validated scale created from emotion theory, qualitative interviews, and factor analyses. Criminology, Criminal Justice, Law & Society, 23(1), 46–67.

13.

Farrall

(2004) Revisiting crime surveys: Emotional responses without emotions. International Journal of Social Research Methodology 7(2), 157–71.

14.

Farrall

Gadd

(2004). Evaluating crime fears: A research note on a pilot study to improve the measurement of the ‘fear of crime’ as a performance indicator. Evaluation, 10(4), 493–502.

15.

Fay

R. E.

(2010). Effects of unbounded interviews, time in sample, and recency on reported crimes in the national crime victimization survey [Conference session]. Proceedings of the Section on Survey Research Methods, American Statistical Association, Alexandria, VA (pp. 1687–1700). http://www.asasrms.org/Proceedings/y2010/Files/306795_57200.pdf

16.

Federal Bureau of Investigation. (2020). Uniform crime report hate crime statistics, 2019. https://ucr.fbi.gov/hate-crime/2019/topic-pages/incidents-and-offenses.pdf

17.

Federal Bureau of Investigation. (n.d.). Hate crime statistics. https://www.fbi.gov/services/cjis/ucr/hate-crime

18.

Gibson

Fernandez

(2018) Gender diversity and non-binary inclusion in the workplace: The essential guide for employers. Jessica Kingsley.

19.

Goffman

(1974). Frame analysis. Harvard University Press.

20.

Graham

Cullen

F. T.

Pickett

J. T.

Jonson

C. L.

(2021). A new generation of survey research in criminology: Online opt-in surveys. The Criminologist 46(6), 5–9.

21.

Gray

Jackson

Farrall

(2008). Reassessing the fear of crime. European Journal of Criminology, 5(3), 363–380.

22.

Gray

Jackson

Farrall

(2011). Feelings and functions in the fear of crime: Applying a new approach to victimisation insecurity. British Journal of Criminology, 51(1), 75–94.

23.

Herek

G. M.

Gillis

J. R.

Cogan

J. C.

(1999). Psychological sequelae of hate-crime victimization among lesbian, gay, and bisexual adults. Journal of Consulting and Clinical Psychology, 67(6), 945–951.

24.

Hinkle

J. C.

(2015). Emotional fear of crime vs. perceived safety and risk: Implications for measuring “fear” and testing the broken windows thesis. American Journal of Criminal Justice, 40(1), 147–168.

25.

Intravia

Wolff

K. T.

Paez

Gibbs

B. R.

(2017). Investigating the relationship between social media consumption and fear of crime: A partial analysis of mostly young adults. Computers in Human Behavior, 77, 158–168.

26.

Jamal

(2018). Transphobic hate crime. Palgrave Macmillan.

27.

Jackson

(2005). Validating new measures of the fear of crime. International Journal of Social Research Methodology, 8(4), 297–315.

28.

Jackson

(2006) Introducing fear of crime to risk research. Risk Analysis, 26(1), 253–64.

29.

Kahneman

Tversky

(1984). Choices, values, and frames. American Psychologist, 39(4), 341–350.

30.

Kim

Lee

C. S.

Lim

(2022). Hate-motivated crime/incidents against Asians in the United States of America: A systematic review. Race and Justice, 13(1), 9–31.

31.

Knauper

(1998). Filter questions and question interpretation: Presuppositions at work. Public Opinion Quarterly, 62(1), 70–78.

32.

Krulichová

(2019). The relationship between fear of crime and risk perception across Europe. Criminology & Criminal Justice, 19(2), 197–214.

33.

Lambert

E. G.

(2004). Assessing the crime and punishment views of criminal justice majors: How different are they from other majors? Criminal Justice Studies, 17(3), 245–257.

34.

Lantz

Wenger

M. R.

(2023). Anti-Asian xenophobia, hate crime victimization, and fear of victimization during the COVID-19 pandemic. Journal of Interpersonal Violence, 38, NP1088–NP1116. https://doi.org/10.1177/08862605221086651

35.

Lantz

Wenger

M. R.

Mills

J. M.

(2022). Fear, political legitimization, and racism: Examining anti-Asian xenophobia during the COVID-19 pandemic. Race and Justice, 13(1), 80–104.

36.

Lee

Jackson

Ellis

J. R.

(2020). Functional and dysfunctional fear of crime in inner Sydney: Findings from the quantitative component of a mixed-methods study. Australian & New Zealand Journal of Criminology, 53(3), 311–332.

37.

Madson

(2005). Demonstrating the importance of question wording on surveys. Teaching of Psychology, 32(1), 40–43.

38.

Malcom

Z. T.

Lantz

(2021). Hate crime victimization and weapon use. Criminal Justice and Behavior, 48(8), 1148–1165.

39.

Maule

Villejoubert

(2007). What lies beneath: Reframing framing effects. Thinking & Reasoning, 13(1), 25–44.

40.

Maxfield

M. G.

Babbie

E. R.

(2018). Research methods for criminal justice and criminology (8th ed.). Cengage Learning.

41.

May

D. C.

Rader

N. E.

Goodrum

(2010). A gendered assessment of the ‘‘threat of victimization’’: Examining gender differences in fear of crime, perceived risk, avoidance, and defensive behaviors. Criminal Justice Review, 35(2), 159–182.

42.

McDevitt

Iwama

J. A.

(2016). Challenges in measuring and understanding hate crime. In Huebner

B. M.

Bynum

T. S.

(Eds.), The handbook of measurement issues in criminology and criminal justice (pp. 131–156). John Wiley & Sons.

43.

Muris

Merckelbach

Gadet

Moulaert

(2000). Fears, worries, and scary dreams in 4- to 12-year-old children: Their content, developmental pattern, and origins. Journal of Clinical Child Psychology, 29(1), 43–52.

44.

Myers

Lantz

(2020). Reporting racist hate crime victimization to the police in the United States and the United Kingdom: A cross-national comparison. The British Journal of Criminology, 60(4), 1034–1055.

45.

Ren

(2019). Social disorder and residence-based fear of crime: The differential mediating effects of police effectiveness. Journal of Criminal Justice, 63, 1–11.

46.

Payne

S. L. B.

(1951). The art of asking questions. Princeton University Press.

47.

Perry

Alvi

(2012). “We are all vulnerable” The in terrorem effects of hate crimes. International Review of Victimology, 18(1), 57–71.

48.

Pezzella

F. S.

Fetzer

M. D.

Keller

(2019). The dark figure of hate crime underreporting. American Behavioral Scientist. Advance online publication. https://doi.org/10.1177/0002764218823844

49.

Pickett

J. T.

Graham

Cullen

F. T.

(2022). The American racial divide in fear of the police. Criminology, 60(2), 291–320.

50.

Pogarsky

Roche

S. P.

Pickett

J. T.

(2017). Heuristics and biases, rational choice, and sanction perceptions. Criminology, 55(1), 85–111.

51.

Pyo

Maxfield

M. G.

(2021). Cognitive effects of inattentive responding in an MTurk sample. Social Science Quarterly, 102(4), 2020–2039.

52.

Rader

N. E.

(2004). The threat of victimization: A theoretical reconceptualization of fear of crime. Sociological Spectrum, 24(6), 689–704.

53.

Schuldt

J. P.

Konrath

S. H.

Schwarz

(2011). “Global warming” or “climate change”? Whether the planet is warming depends on question wording. Public Opinion Quarterly, 75(1), 115–124.

54.

Sheehan

K. B.

Pittman

(2016). Amazon’s mechanical Turk for academics: The HIT handbook for social science research. Melvin & Leigh, Publishers.

55.

Skogan

(1981) Issues in the measurement of victimisation. US Department of Justice, US Government Printing Office.

56.

Sloan

M. M.

Haner

Cullen

F. T.

Graham

Aydin

Kulig

T. C.

Jonson

C. L.

(2021). Using behavioral strategies to cope with the threat of terrorism: A national-level study. Crime & Delinquency, 67(12), 2011–2042.

57.

Stacey

Carbone-López

Rosenfeld

(2011). Demographic change and ethnically motivated crime: The impact of immigration on anti-Hispanic hate crime in the United States. Journal of Contemporary Criminal Justice, 27(3), 278–298.

58.

Sterngold

Warland

R. H.

Herrmann

R. O.

(1994). Do surveys overstate public concerns? Public Opinion Quarterly, 58(2), 255–263.

59.

Szabó

(2007). Do children differentiate worry from fear? Behaviour Change, 24(4), 195–204.

60.

Thomas

K. A.

Clifford

(2017). Validity and mechanical Turk: An assessment of exclusion methods and interactive experiments. Computers in Human Behavior, 77, 184–197.

61.

Tversky

Kahneman

(1981). The framing of decisions and the psychology of choice. Science, 211(4481), 453–458.

62.

Warr

(2000). Fear of crime in the United States: Avenues for research and policy. Criminal Justice, 4(4), 451–489.

63.

Wenger

M. R.

Lantz

Gallardo

(2022). The role of hate crime victimization, fear of victimization, and vicarious victimization in COVID-19-related depression. Criminal Justice and Behavior, 49(12), 1746–1762.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.03 MB