Prediction effect sizes such as ROC area are important for demonstrating a risk assessment's generalizability and utility. How a study defines recidivism might affect predictive accuracy. Nonrecidivism is problematic when predicting specialized violence (e.g., domestic violence). The present study cross-validates the ability of the Ontario Domestic Assault Risk Assessment (ODARA) to distinguish subsequent recidivists and nonrecidivists among 391 new cases with less extensive criminal records than previous cross-validation samples, base rate = 27%, ROC area = .67. Excluding ambiguous nonrecidivists increases the base rate to 33%, ROC area = .74. Random samples of 50 recidivists and 50 unambiguous nonrecidivists yield ROC areas from .71 to .80. Published norms significantly underestimate official recidivism. Ambiguous nonrecidivism is prevalent and leads to underestimating base rates and predictive accuracy.
Ægisdóttir, S., White, M.J., Spengler, P.M., Maugherman, A.S., Anderson, L.A., Cook, R.S., et al. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34, 341-382.
2.
Cavanaugh, M.M., & Gelles, R.J. (2005). The utility of male domestic violence offender typologies. Journal of Interpersonal Violence, 20, 155-166.
3.
Cumming, G., & Finch, S. (2005). Inference by eye. American Psychologist , 60, 170-180.
4.
Farrington, D.P., Coid, J.W., Harnett, L., Jollife, D., Soteriou, N., Turner, R., et al. (2006). Criminal careers up to age 50 and life success up to age 48: New findings from the Cambridge Study in Delinquent Development (Home Office Research Study No. 299). London: Home Office.
5.
Grove, W.M., Zald, D.H., Lebow, S., Snitz, B.E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis . Psychological Assessment, 12, 19-30.
6.
Hanlon, M., Larson, S., & Zacher, S. (1999). The Minnesota SOST and sexual reoffending in North Dakota: A retrospective study. International Journal of Offender Therapy and Comparative Criminology, 43, 71-77.
7.
Hanson, R., & Harris, A. (2000). Where should we intervene?: Dynamic predictors of sexual assault recidivism. Criminal Justice and Behavior , 27, 6-35.
8.
Hanson, R., & Harris, A. (2001). A structured approach to evaluating change among sexual offenders. Sexual Abuse: Journal of Research and Treatment , 13, 105-122.
Hilton, N.Z., & Harris, G.T. (2005). Predicting wife assault: A critical review and implications for policy and practice. Trauma, Violence, and Abuse, 6, 3-23.
Hilton, N.Z., Harris, G.T., Rice, M.E., Eke, A.W., & Lowe-Wetmore, T. (2007). Training front-line users in the Ontario Domestic Assault Risk Assessment (ODARA), a tool for police domestic investigations. Canadian Journal of Police and Security Services, 5, 92-96.
14.
Hilton, N.Z., Harris, G.T., Rice, M.E., Houghton, R.A., & Eke, A. (2008). An indepth actuarial risk assessment for wife assault recidivism: The Domestic Violence Risk Appraisal Guide (DVRAG). Law and Human Behavior, 32, 150-163.
15.
Hilton, N.Z., Harris, G.T., Rice, M.E., Lang, C., Cormier, C.A., & Lines, K.J. (2004). A brief actuarial assessment for the prediction of wife assault recidivism: The Ontario Domestic Assault Risk Assessment. Psychological Assessment, 16, 267-275.
16.
Johnson, R., Gilchrist, E., & Beech, A.R.A. (2006). Psychometric typology of U.K. domestic violence offenders. Journal of Interpersonal Violence, 21, 1270-1285.
17.
Kropp, P.R., & Hart, S.D. (2000). The Spousal Assault Risk Assessment (SARA) Guide: Reliability and validity in adult male offenders. Law and Human Behavior, 24, 101-118.
18.
Litwack, T.R., Kirschner, S.M., & Wack, R.C. (1993). The assessment of dangerousness and predictions of violence: Recent research and future prospects. Psychiatric Quarterly, 64, 245-273.
19.
Monahan, J. (1981). Predicting violent behavior: An assessment of clinical tenchniques. Beverly Hills, CA: Sage.
20.
Mossman, D. (2006). Another look at interpreting risk categories. Sexual Abuse: Journal of Research and Treatment, 18, 41-63.
21.
Ontario Ministry of the Solicitor General. ( 2000, April). A guide to the domestic violence supplementary report form. Toronto, Ontario, Canada.
Rice, M.E., & Harris, G.T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen's d, and r. Law and Human Behavior, 29, 615-620.
24.
Rice, M.E., Harris, G.T., Lang, C., & Cormier, C.A. (2006). Violent sex offenses: How are they best measured from official records? Law and Human Behavior, 30, 525-541.
