Understanding Police Gang Data at the Aggregate Level: An Examination of the Reliability of National Youth Gang Survey Data (Research Note)

Abstract

The National Youth Gang Survey (NYGS) is an annual survey of a nationally representative sample of police agencies administered by the National Gang Center that provides data on the number of gangs, gang members, and gang homicides across jurisdictions. The focus of the current study is the reliability of key measures of gang behavior measured by the NYGS. Specifically, the current study assesses NYGS data from 2005 to 2009 in terms of missing data, test-retest reliability, internal consistency reliability, and inter-observer reliability. Results showed low levels of missing data for number of gangs and number of gang homicides in jurisdictions with fewer than 200,000 people, while measures of number of gang members and gang homicides in jurisdictions over 200,000 people had missing data from about 30% of participating jurisdictions. The findings also suggest that the NYGS data on gangs and gang members are generally highly reliable. Data on gang homicides also exhibited a high degree of reliability, but only for jurisdictions with populations over 200,000. Implications of the findings and recommendations for future research are discussed.

Get full access to this article

View all access options for this article.

References

Allison

P. D.

(2001). Missing data. Thousand Oaks: Sage.

Barrows

, & Huff

C. R.

(2009). Gangs and public policy: constructing and de constructing gang databases. Criminology & Public Policy, 8(4), 675–704.

Burrell

(1990). Gang evidence: Issues for criminal defense. Santa Clara Law Review, 30, 739–790.

Chesney-Lind

Rockwell

Marker

, & Reyes

(1994). Gangs and delinquency. Crime, Law, and Social Change, 21, 201–228.

Crew

(1997). Memo to Orange County District Attorney's Office. San Fran cisco: American Civil Liberties Union.

Curry

G. D.

Ball

Fox

, & Stone

(1992). National assessment of law enforcement anti-gang information resources. Washington, DC: National Institute of Justice.

Curry

G. D.

Ball

R. A.

, & Fox

R. J.

(1994). Gang crime and law enforcement recordkeeping. Washington, DC: National Institute of Justice.

Decker

, & Pyrooz

(2010). On the validity and reliability of gang statistics. Homicide Studies, 14(4), 359–376.

Egley

Howell

J. C.

, & Moore

J. P.

(2010). Highlights of the 2008 National Youth Gang Survey. Washington, DC: Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention.

10.

Fox

(2004). Missing data problems in the SHR imputing offender and relationship characteristics. Homicide Studies, 8, 214–254.

11.

Hagedorn

J. H.

(1990). Back in the field again: Gang research in the nineties. In Huff

C. R.

(Ed.), Gangs in America (pp. 240–262). Newbury Park: Sage.

12.

Hassell

, & Zhao

(2003). Structural arrangements in large municipal police organizations. Policing, 26(2), 231–250.

13.

Horton

, & Lipsitz

(2001). Multiple imputation in practice. American Statistician, 55, 244–254.

14.

Katz

C. M.

(2003). Issues in the production and dissemination of gang statistics: An ethnographic study of a large Midwestern police gang unit. Crime and Delinquency, 49(3), 485–516.

15.

Katz

C. M.

Maguire

, & Roncek

(2002). The creation of specialized police gang units: Testing contingency, social threat, and resource-dependency explanations. Policing: An International Journal of Police Strategies and Management, 25(3), 472–506.

16.

Katz

C. M.

, & Schnebly

(2011). Neighborhood variation in gang member concentrations. Crime & Delinquency, 57(3), 377–407.

17.

Katz

C. M.

, & Webb

V. J.

(2006). Policing gangs in America. Cambridge University Press: New York.

18.

Katz

C. M.

Webb

V. J.

Gartin

P. R.

, & Marshall

C. E.

(1997). The validity of self-reported marijuana and cocaine use. Journal of Criminal Justice, 25(1), 31–42.

19.

Katz

C. M.

Webb

, & Schaefer

(2000). The validity of police gang intelligence lists: Examining differences in delinquency between documented gang members and non-documented delinquent youth. Police Quarterly, 3(4), 413–437.

20.

Kennedy

D. M.

(2009). Comment on “Gangs and public policy: constructing and deconstructing gang databases.” Criminology & Public Policy, 8(4), 711–716.

21.

King

(2000). Measuring police innovation: Issues and measurement. Policing, 23(3), 303–317.

22.

Klein

M. W.

(1995). The American street gang. New York: Oxford University Press.

23.

Klein

M. W.

(2009). Street gang databases: A view from the gang capitol of the United States. Criminology & Public Policy, 8(4), 717–722.

24.

Klein

M. W.

, & Maxson

C. L.

(2006). Street gang patterns and policies. Oxford: Oxford University Press.

25.

Landis

J. R.

, & Koch

G. G.

(1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.

26.

Langton

(2010). Gang units in large local law enforcement agencies, 2007. Washington DC: U.S. Department of Justice, Office of Justice Programs, Bureau of Justice Statistics.

27.

Langworthy

, & Travis

(1994). Policing in America. New York: MacMillian.

28.

Maguire

, & Katz

C. M.

(2002). Loose coupling, sensemaking, and community policing in American police agencies. Justice Quarterly, 19(3), 501–534.

29.

Maxfield

M. G.

, & Babbie

E. R.

(2011). Research methods for criminal justice and criminology (6th Ed.). Belmont, CA: Wadsworth Cengage Learning.

30.

Maxson

C. L.

(1999). Gang homicide: A review and extension of the literature. In Smith

M. D.

& Zahn

M. A.

(Eds.), Homicide: A sourcebook of social research (pp. 239–254). Thousand Oaks, CA: Sage.

31.

Maxson

C. L.

, & Klein

M. W.

(1990). Street gang violence: Twice as great, or half as great? In Huff

C. R.

(Ed.), Gangs in America (pp. 71–100). Newbury Park, CA: Sage.

32.

Maxson

C. L.

, & Klein

M. W.

(1996). Defining gang homicide: An updated look at member and motive approaches. In Huff

C. R.

(Ed.), Gangs in America (2nd Ed., pp. 2–20). Newbury Park, CA: Sage.

33.

McCorkle

, & Miethe

(1998). The political and organizational response to gangs: An examination of a “moral panic” in Nevada. Justice Quarterly, 15(1), 41–64.

34.

Meehan

(2000). The organizational career of gang statistics: The politics of policing gangs. The Sociology Quarterly 41(3), 337–370.

35.

Meng

X. L.

(1994). Multiple imputation inferences with uncongenial source of input. Statistical Science, 9(4), 538–573.

36.

Miller

W. B.

(1982). Crime by youth gangs and groups in the United States. Washington DC: U.S. Department of Justice, Office of Juvenile Justice and Delinquency Prevention.

37.

National Youth Gang Center. (2008). National Youth Gang Survey Analysis. Available online at http://www.nationalgangcenter.gov/Survey-Analysis

38.

National Youth Gang Center. (2009). National Youth Gang Survey Analysis. Available online at http://www.nationalgangcenter.gov/Survey-Analysis

39.

Nunnally

(1978). Psychometric theory. New York: McGraw-Hill.

40.

Pyrooz

D. C.

(2011). Structural covariates of gang homicide in large U.S. cities. Journal of Research in Crime and Delinquency. Prepublished at Online First, DOI:10.1177/0022427811415535.

41.

Pyrooz

D. C.

Fox

A. M.

, & Decker

S. H.

(2010). Racial and ethnic heterogeneity, economic disadvantage, and gangs: A macro-level study of gang membership in urban America. Justice Quarterly, 27(6), p. 867–892.

42.

Roth

(1994). Missing data. Personnel Psychology, 47(3), 537–560.

43.

Rubin

D. B.

(1987). Multiple imputation for nonresponse in surveys. New York: J. Wiley & Sons.

44.

Short

J. F.

(2009). Gangs, law enforcement, and the academy. Criminology & Public Policy, 8(4), 723–732.

45.

Steel

, & Lovrich

(1987). Equality and efficiency tradeoffs in affirmative action—Real or imagined? The case of women in policing. The Social Science Journal, 24(1), 53–70.

46.

Taylor

(1990). Interpretation of the correlation coefficient: A basic review. Journal of Diagnostic Medical Sonography, 6, 35–39.

47.

Trochim

W. M.

(2006). The research methods knowledge base (2nd Ed.). Available online at http://www.socialresearchmethods.net/kb/.

48.

Walker

, & Katz

C. M.

(2005). Less than meets the eye: Police department bias crime units. American Journal of Police 14 (1), 29–48.

49.

Webb

V. J.

, & Katz

C. M.

(2003). Policing gangs in an era of community policing. In Decker

(Ed.), Policing gangs and youth violence (pp. 17–49). Wadsworth: Belmont.

50.

Webb

V. J.

, & Katz

C. M.

(2006). A study of police gang units in six cities. In Egley

Maxson

Miller

, & Klein

(Eds.), The modern gang reader (3rd Ed., pp. 349–360.) Los Angeles: Roxbury Publishing.

51.

Webb

Katz

C. M.

, & Decker

(2006). Assessing the validity of self-reports by gang members: Results from the Arrestee Drug-Abuse Monitoring program. Crime & Delinquency, 52(2), 232–252.

52.

Weisburd

, & Britt

(2003). Statistics in criminal justice (2nd Ed.). Belmont: Wadsworth.

53.

Weisburd

, & Britt

(2007). Statistics in criminal justice (3rd Ed.). Belmont: Wadsworth.

54.

Weiss

(1997). The communication of innovation in American policing. Policing, 20, 292–310.

55.

Wells

L. E.

, & Weisheit

R. A.

(2001). Gang problems in nonmetropolitan areas: A longitudinal assessment. Justice Quarterly, 18(4), 801–833.

56.

Wilson

J. Q.

(1968). Varieties of police behavior. Cambridge: Harvard University Press.

57.

Zatz

(1985). Los cholos: Legal processing of Chicano gang members. Social Problems, 33(1), 13–30.

58.

Zatz

(1987). Chicano youth gangs and crime: The creation of a moral panic. Contemporary Crises, 11, 129–158.