Abstract
The present meta-analysis explored the relationship between psychopathy and instrumental and reactive violence with a focus on factor and facet scores. A total of 53 studies (reporting on 55 unique samples, N = 8,753) from both published and unpublished sources were included. Results from random-effects analyses indicated moderate and significant relationships between psychopathy and both instrumental and reactive violence. There was some evidence that the Interpersonal facet was more important for instrumental violence, while Factor 2 (social deviance) was more important for reactive violence. The Lifestyle facet appeared important in explaining both violent outcomes. Effect sizes were significantly smaller for clinical rating scales compared with informant and self-report scales. Significant between-study variability was partly explained by mean age of the sample and type of outcome measure. The current findings do not support the conclusion that psychopathy is more related to instrumental violence as opposed to reactive violence.
Psychopathy is a personality disorder characterized by interpersonal, affective, behavioral, and antisocial features. It is estimated that 10% to 15% of the total offender population (Hare, 2003) and less than 1% of the general population (Coid, Yang, Ullrich, Roberts, & Hare, 2009) would meet the criteria for psychopathy. Although psychopaths represent a small subset of the overall offender population, their impact on the criminal justice system is exponential; it is estimated that a relatively small number of psychopathic offenders are responsible for a disproportionate amount of crime (Hare, 2003). Research has also demonstrated a relationship between psychopathy and violence in both offender (e.g., Asscher et al., 2011) and non-offender samples (e.g., Walters, 2003a, 2003b).
Violence can be further classified according to the instrumental versus reactive dimension. Reactive violence is thought to be marked by an impulsive emotional response to provocation, while instrumental violence is thought to be predominantly controlled, proactive, and goal oriented (Cornell et al., 1996). A great deal of research has demonstrated that psychopaths tend to engage in more instrumental violence as opposed to reactive violence (Cornell et al., 1996; Flight & Forth, 2007; Glenn & Raine, 2009; Vitacco, Neumann, & Caldwell, 2010; Vitacco, Neumann, Caldwell, Leistico, & Van Rybroek, 2006; Walsh, Swogger, & Kosson, 2009; Williamson, Hare, & Wong, 1987; Woodworth & Porter, 2002). Despite the prevalence of this finding, no study to date has systematically examined whether the relationship between psychopathy and instrumental violence is consistent across studies and across psychopathy facets or whether this relationship is dependent on sample characteristics such as age, ethnicity, or gender.
Measuring Psychopathy
The measurement scales created to assess psychopathy can be divided into three broad categories: clinical rating scales, self-report scales, and informant scales. The Psychopathy Checklist–Revised (PCL-R; Hare, 2003) and its derivations (i.e., PCL: Youth Version [YV]; Forth, Kosson, & Hare, 2003, and PCL: Screening Version [SV]; Hart, Cox, & Hare, 1995) are classified as clinical rating scales. These scales require raters to integrate information from interviews, collateral sources, and files to make inferences about traits (Hare, 2003). Using factor analysis, two factors have been identified within the PCL-R (Hare, 1991, 2003; Harpur, Hakstian, & Hare, 1988). Factor 1 represents the interpersonal (e.g., manipulative) and affective (e.g., callousness) components of psychopathy, while Factor 2 describes the antisocial lifestyle (e.g., early antisocial behavior) and behavioral (e.g., need for stimulation) components of psychopathy. More recently, these two factors have been further divided into four facets: Interpersonal, Affective, Lifestyle, and Antisocial (Hare, 2003). Subsequent research has found support for these four facets as a means of more thoroughly capturing the nature of psychopathy in a variety of forensic, clinical, and community populations (e.g., Babiak, Neumann, & Hare, 2010; Kosson et al., 2013; Neumann, Kosson, Forth, & Hare, 2006; Neumann, Kosson, & Salekin, 2007).
Additional research has been conducted in an attempt to identify possible alternate factor structures for psychopathy. Cooke and Michie (2001) have studied the validity of a three-factor model: arrogant and deceitful interpersonal style, deficient affective experience, and impulsive and irresponsible behavioral style. Weaver, Meyer, Van Nort, and Tristan (2006) conducted an examination of the original two-factor model (Harpur et al., 1988) as well as the three-factor model proposed by Cooke and Michie (2001), and the four-facet model proposed by Hare (2003). Confirmatory factor analysis revealed that the best fit to the data (sample of 1,566 male sex offenders) was represented by the three-factor model; the four-facet model was also found to be a better fit than the original two-factor model (Weaver et al., 2006).
Despite their frequent use, there are limitations associated with clinical rating scales. For example, scoring clinical rating scales is time-consuming given that interviews and reviews of file information are both necessary. Also, with community samples, access to any collateral or file information is often difficult to obtain. Alternatively, self-report scales represent a more cost-effective method of assessing psychopathy and can be administered to both criminal and non-criminal populations (Lilienfeld, 1994). In addition, self-report scales can be completed without fear of observer bias or subjectivity in scoring. The main limitation of self-report scales, especially when assessing psychopathy, is the possibility of dishonest responding (Lilienfeld & Fowler, 2006). Despite this limitation, a recent meta-analysis found that most self-report psychopathy scales are actually negatively correlated with social desirability responding (Ray et al., 2013). Although psychopaths may be willing to admit to negative traits in the context of a research study, they may be much more likely to engage in impression management when there are meaningful consequences such as during a forensic clinical assessment.
Various self-report scales have been developed to assess psychopathy. Importantly, these scales tend to correlate significantly with total scores derived from clinical rating scales and also represent similar underlying factor and facet structures. For example, the factor structure of the Self-Report Psychopathy Scale (SRP; Paulhus, Neumann, & Hare, in press) is best represented by the four facets of the PCL-R (Neal & Sellbom, 2012). In addition, a study by Brinkley, Schmitt, Smith, and Newman (2001) found that the primary and secondary factors of the Levenson Self-Report Psychopathy Scale (LSRP; Levenson, Kiehl, & Fitzpatrick, 1995) moderately correlate with Factors 1 and 2 of the PCL-R. Recent research has also suggested that a three-factor solution may be appropriate for the LSRP (Sellbom, 2011).
Another common self-report scale for youth, the Youth Psychopathic Traits Inventory (YPI; Andershed, Kerr, Stattin, & Levander, 2002), is also representative of the three-factor model of psychopathy. More specifically, the three factors of the YPI (Affective, Interpersonal, and Lifestyle) correlate with the Interpersonal, Affective, and Lifestyle factors of psychopathy (Cooke & Michie, 2001). Finally, the two underlying factors found within the Psychopathic Personality Inventory (PPI; Lilienfeld & Andrews, 1996) have been shown to significantly correlate with both factors of the PCL-R (Benning, Patrick, Hicks, Blonigen, & Krueger, 2003; Berardino, Meloy, Sherman, & Jacobs, 2005; Poythress, Edens, & Lilienfeld, 1998). Evidence suggests that although self-report scales differ in administrative procedure, they are able to capture the underlying characteristics of psychopathy.
Informant scales have been created to assess psychopathy among children and adolescents. They provide researchers with the ability to accurately assess a child through regular interaction and observation (Lynam, 1997). For example, the Antisocial Process Screening Device (APSD; Frick & Hare, 2001) and the Childhood Psychopathy Scale (CPS; Lynam, 1997) can be completed by a parent, guardian, or teacher. Like scores from self-report scales, scores from informant scales have shown acceptable convergent validity with other measures of psychopathy (Falkenbach, Poythress, & Heide, 2003; Frick & Hare, 2001). In addition, the factor structure of informant scales also relates to the factor structure of clinical rating scales. For example, confirmatory factor analysis has demonstrated that the APSD has three underlying factors (i.e., callous-unemotional, narcissism, and impulsivity), which are closely related to the three-factor model of psychopathy (Frick, Bodin, & Barry, 2000; Frick & Hare, 2001).
Psychopathy and Violence
Psychopathy is one of the most researched risk factors for violence (Guy, Douglas, & Hendry, 2010; Harris, Rice, & Cormier, 1991; Salekin, Rogers, & Sewell, 1996; Weiler & Widom, 1996). Several meta-analyses examining this relationship have been conducted using adult samples (Guy, Edens, Anthony, & Douglas, 2005; Kennealy, Skeem, Walters, & Camp, 2010; Salekin et al., 1996), youth samples (Asscher et al., 2011; Edens, Campbell, & Weir, 2006; Olver, Stockdale, & Wormith, 2009), or a combination of both (Walters, 2003a, 2003b, 2006). Although the majority of the samples represent forensic populations (offender or psychiatric), two of the meta-analyses also included high school students (Walters, 2003a, 2003b). The most common outcome measures included general and violent recidivism, delinquency, and institutional misconduct. Overall, previous meta-analyses have identified a moderate relationship between psychopathy and violence.
It is important to note that considerable variability between effect sizes is often cited and several significant moderators have been identified. For example, the relationship between psychopathy and violence is larger for youth compared with adult samples (Walters, 2006) and smaller for samples with higher ethnic heterogeneity (Edens et al., 2006). Gender has not consistently been found as a significant moderator, with Olver and colleagues (2009) reporting no significance and Edens and colleagues (2006) reporting smaller effect sizes for samples of female juvenile offenders. When examining sample origin, studies from the United States and Canada tend to have significantly larger effect sizes (Kennealy et al., 2010; Olver et al., 2009); however, this is not always consistent (Edens et al., 2006). Finally, several meta-analyses have reported that the relationship between psychopathy and risk of violence is significantly larger for Factor 2 compared with Factor 1 (e.g., Kennealy et al., 2010; Walters, 2003a, 2003b).
Reactive and Instrumental Violence
In psychological research, a distinction is often made between instrumental or predatory violence and reactive or hostile violence. Instrumental violence is defined by aggression that is controlled, proactive in nature, and is oriented by an external goal. Therefore, the consequence of violence is secondary to a goal such as monetary gain or elevated social status (Berkowitz, 1993). Emotions are thought to play a minimal role in instrumental violence (Glenn & Raine, 2009; Meloy, 2006). Conversely, reactive violence refers to aggression emanating from an extreme emotional response (usually fear or anger) to a real or perceived threat or provocation. In addition, this violence is committed without a foreseeable external goal by the offender (Berkowitz, 1993; Cornell et al., 1996). The operationalization of instrumental and reactive violence is not without controversy. Although the above definitions suggest that violent acts can be classified into one category, in reality, violence is more likely the result of a complex interaction of emotions and motives (Bushman & Anderson, 2001). Despite the simplicity of the dichotomous model, neurological and biological evidence for its validity is evident (see Meloy, 2006, for a review), and the distinction is still widely used in research settings.
Research has consistently found that although psychopathic offenders may commit both types of violence, psychopathy is more related to instrumental violence in both youth (Bezdjian, Tuvblad, Raine, & Baker, 2011; Fite, Raine, Stouthamer-Loeber, Loeber, & Pardini, 2010; Fite, Stoppelbein, & Greening, 2009; Flight & Forth, 2007; Murrie, Cornell, Kaplan, McConville, & Levy-Elkon, 2004) and adult offenders (Chase, O’Leary, & Heyman, 2001; Cima & Raine, 2009; Cornell et al., 1996; Porter & Woodworth, 2007). The relationship between psychopathy and instrumental violence has also been replicated in samples of female offenders (Lehmann & Ittel, 2012; Marsee & Frick, 2007). A narrative review of this literature has suggested that psychopathy may in fact serve as a potential protective factor against reactive violence (Reidy, Shelley-Tremblay, & Lilienfeld, 2011).
Although meta-analyses have reported Factor 2 to be more predictive of general violence than Factor 1, the opposite finding is reported when examining the type of violence; Factor 1 scores appear to be more predictive of instrumental violence compared with Factor 2 scores (Bezdjian et al., 2011; Cornell et al., 1996; Declercq, Willemsen, Audenaert, & Verhaeghe, 2012; Hodges & Heilbrun, 2009). For example, a study conducted by Flight and Forth (2007) with young offenders found that the potential for instrumental violence increased with higher scores on the interpersonal/affective (IA) factor as opposed to the social deviance (SD) factor. When examining facet scores, inconsistent results have been reported with some studies showing that the Interpersonal facet is more strongly related to instrumental violence (e.g., Declercq et al., 2012; Walsh et al., 2009), while others indicating that the Antisocial facet is more strongly related to instrumental violence (e.g., Hodges & Heilbrun, 2009).
The purpose of the present study was to systematically examine the relationship between psychopathy and instrumental and reactive violence using meta-analysis. To further understand these relationships, we calculated meta-analytic effects for total, factor, and facet psychopathy scores and for the three main types of measurement scales. In addition, moderator analyses were conducted to determine whether the association between psychopathy and instrumental and reactive violence was influenced by certain participant (e.g., age, gender, and ethnicity) and study characteristics (e.g., sample type and outcome measure).
Method
Study Selection
Both published and unpublished sources available before January 1, 2013, were included in the present meta-analysis. The following databases were searched: PsycINFO, National Criminal Justice Reference System, Web of Science, Criminal Justice Abstracts, Dissertations and Theses: Fulltext, and Dissertations and Theses: UK and Ireland. In addition, forensic journals not included in PsycINFO were searched individually, and the reference lists for accepted articles were also searched for any missing studies. The search procedure involved combining psychopathy-related terms (e.g., psychopath*, PCL*, and Psychopathy Checklist-Revised) with synonyms of violence with specific reference to instrumental or reactive violence (e.g., instrument*, predator*, proactive*, premeditate*, planned, impulsive*, reactive*, violen*, and aggress*).
To be included, every study must have adhered to both of the following inclusion criteria. First, the study must have explored the relationship between psychopathy (as measured by any valid and reliable scale) and a measure of either instrumental or reactive violence (studies reporting on criminal thoughts as opposed to action were excluded). Studies had to specifically state the type of violence (either instrumental or reactive) under study. Studies examining impulsivity and psychopathy without specifying impulsive violence were excluded. Studies did not have to examine both types of violence outcomes to be included, but if a study involved a comparison between instrumental and reactive violence, both effect sizes were coded.
Second, each study must have provided enough information for at least one correlation coefficient between the variables of interest to be extracted or converted from the existing information. Additional information was requested from the authors when needed. Information on all studies included in the present meta-analysis can be found in Table 1. 1 If multiple studies reported on the same sample (or a subsample of the total sample), the study with the largest sample size was chosen as the primary study. Only non-overlapping effect sizes were then coded from the other studies.
List of Studies Included in the Meta-Analysis
Note. Additional information was obtained from both S. Bezdjian and L. Bobadilla. Studies with two sample numbers represent independent samples within each study (i.e., males and females analyzed separately).
Same sample as previous. Only non-overlapping effect sizes were coded.
Measures of Psychopathy
Measures of psychopathy were divided into three broad categories: clinical rating scales, informant measures, and self-report scales. Clinical rating scales included the PCL-R and its derivative scales (PCL: YV and PCL: SV). Informant measures included the APSD (Frick & Hare, 2001) and CPS (Lynam, 1997). Several self-report scales were identified including the self-report scores from both the APSD and CPS. To ensure independence of effect sizes, only one effect size for each type of scale was coded for each study. If a study included multiple effect sizes for the same type of scale, the average of the two effect sizes was taken. For example, Study 17 included both the APSD self-report and the Millon Adolescent Clinical Inventory (MACI; Millon, 1993).
Although the overall relationship between psychopathy and instrumental or reactive violence was of interest, we also coded effect sizes for any study that included information on the relationship between psychopathy factor and facet scores and both types of violence (i.e., Factor 1, Factor 2, Interpersonal, Affective, Lifestyle, and Antisocial; a study did not need to include factor or facet scores to be included). For informant and self-report scales, factors and facets closely related to the original factors and facets derived from the PCL-R were coded. Table 2 provides information on all the scales included in the study as well as how each scale component was averaged to assess effect sizes for factor and facet scores.
Individual Scales Contributing to Psychopathy Total, Factor, and Facet Scores Divided by Type of Scale
Note. PCL-R = Psychopathy Checklist–Revised; PCL: SV = Psychopathy Checklist: Screening Version; PCL: YV = Psychopathy Checklist: Youth Version; APSD = Antisocial Process Screening Device; CPS = Childhood Psychopathy Scale; CPS-R = Chidhood Psychopathy Scale-Revised; LSRP = Levenson Self-Report Psychopathy Scale; MACI = Millon Adolescent Clinical Inventory; MCMI-II = Millon Clinical Multiaxial Inventory-II; mCPS = Modified Child Psychopathy Scale; PPI = Psychopathic Personality Inventory; SRP = Self-Report Psychopathy Scale; YPI = Youth Psychopathic Traits Inventory; ICU = Inventory of Callous and Unemotional Traits.
Coding Procedures
Each eligible study was coded for study demographics (e.g., country of origin, year of publication), sample statistics (e.g., sample type, mean age), and effect sizes for the variables of interest. The first and second authors coded all studies independently. Interrater statistics were calculated for 6 studies (11%). The kappa statistic was used when assessing the reliability of categorical variables, and a two-way random-effects model intraclass correlation coefficient (ICC; absolute agreement) was used when assessing the reliability of ordinal or continuous variables. When kappa could not be calculated, a percent agreement between raters was calculated. Acceptable values were found for study and sample variables and for effect size calculations. The kappa statistics ranged from .60 to 1.00 (80% of kappa values equaled 1.00; percent agreement ranged from 71.4 to 85.7) and ICC values ranged from .82 to 1.00. Given that both the first and second authors coded all studies, a consensus coding was obtained whenever a disagreement occurred.
Effect Size Calculation
Correlation coefficients (r) were used as effect size estimates for the relationship between psychopathy and instrumental or reactive violence. As described by Borenstein, Hedges, Higgins, and Rothstein (2009), the correlation coefficient for each effect was converted to the Fisher’s z scale (zr) and aggregated using the variance of Fisher’s z (all zr values weighted by the inverse of the variance). The aggregated effect sizes were then converted to the original correlation coefficient for ease of interpretation. In interpreting correlation coefficients, values below .30 can be considered “small,” values between .30 and .50 can be considered “moderate,” and any values above .50 can be considered “large” (Cohen, 1988). If the 95% confidence interval (CI) does not include 0, the effect size is significant at the .05 level.
Both fixed-effect and random-effects models were calculated. The fixed-effect model is based on the assumption that there is one true effect expressed by all of the studies used in the meta-analysis; any variance between samples is attributed to sampling error. Conclusions are therefore restricted to the particular sample of studies included in the meta-analysis (Borenstein et al., 2009). The random-effects model assumes that the observed effect sizes represent a random sample of all possible estimates of the true population effect. Under this model, observed effects vary as a function of study methodology (e.g., differences in samples), and this between-study variability is subsequently incorporated into the error term. Results of fixed-effect and random-effects analyses converge as between-study variability decreases (Borenstein et al., 2009). Although both fixed-effect and random-effects estimates are presented, only random-effects estimates will be discussed.
Between-study variability was assessed using both the Q and I2 statistics. While the Q statistic provides a measure of the significance of between-study variability, the I2 statistic provides an indication of the magnitude of this variability. The Q statistic is distributed as a chi-square with k − 1 degrees of freedom (k being the number of studies; Hedges & Olkin, 1985). I2 is presented as a percentage with 25, 50, and 75 indicating small, medium, and large proportions of variability, respectively (Huedo-Medina, Sánchez-Meca, Marín-Martínez, & Botella, 2006). When Q was significant, the presence of outliers was considered by examining both the size of the individual effect and the weight it contributed to the overall estimate. A study was considered an outlier if the effect was the largest or smallest of all the effects included in the aggregated estimate and if the effect contributed a large weight to the estimate. In addition, a study was only considered an outlier if, after removing the study, the overall Q value was reduced by half.
In the presence of significant between-study variability, one possible explanation is that other variables may moderate the relationship between the variables. Although significant moderators can be found in the absence of variability across studies (i.e., non-significant Q), these analyses have lower power. For this reason, moderators were only explored on effect sizes that demonstrated a significant Q value or if the magnitude of the variability (as measured by I2) exceeded .50. It should be noted that moderators are only one possible explanation for why effect sizes may vary significantly across the sample of studies. Moderators included study demographics (e.g., country of origin, outcome measure) and sample characteristics (e.g., age, sample type). For categorical moderators, between-level Q was calculated. This entails calculating the overall Q statistic and subtracting the Q value produced by each individual level of the moderator variable. If the between-level Q is significant, the moderator accounts for a significant portion of the overall variability. Each level of the moderator variable required at least three effect sizes to be analyzed. For continuous moderators (e.g., age, ethnicity), a random-effects meta-regression analysis (unrestricted maximum likelihood [ML] method) was conducted to assess the relationship between the effect size and the moderator.
We were also interested in comparing the effect sizes across factors, facets, and scale type (e.g., differences between facets for each type of scale); however, these variables violate the assumption of independence necessary to conduct proper moderator analyses. This means that the same individuals cannot be present in more than one category. For this reason, the 84% CIs were calculated based on the random-effects results to compare significance between effect sizes that violated the assumption of independence as suggested by Tryon (2001). When comparing across different effect sizes (e.g., Factor 1 vs. Factor 2), non-overlapping 84% CIs represent a significant difference at the .05 level, whereas non-overlapping 95% CIs represent a significant difference at the .01 level (Tryon, 2001). All analyses were conducted using comprehensive meta-analysis (CMA; Borenstein, Hedges, Higgins, & Rothstein, 2005).
Results
In total, 53 studies (86% peer reviewed) reporting on 55 unique samples were coded (N = 8,753). The median year of publication was 2009 (range = 1987-2012) and the majority of studies originated from the United States (71%). When examining the samples, the average sample size (using the largest sample associated with an effect size) was 159 (range = 33-679). The majority of the samples were adult only (56.4%; 38.2% juvenile only; 5.5% contained both). The mean age of the samples was 23.0 years (range = 9.3-46.6 years) and the majority were also male only (53.7%; 14.8% female only; 31.5% both; 1.8% not reported). Approximately 40% of the samples were from the general offender population and another 46.4% were from the general community population (the remaining samples were either psychiatric or a mixed sample). Finally, 39 of the 55 samples (71%) reported on ethnicity. On average, minorities made up 40.7% of the total ethnicity across the samples. When examining how the violent outcome was operationalized, 47% of samples used a self-report measure of instrumental or reactive violence, while the remaining 53% used a more objective method of measurement (e.g., independent raters, informant reports).
Psychopathy and Violence
Overall Psychopathy
The relationship between psychopathy overall and instrumental violence can be seen in Table 3. Psychopathy (across all scale types) showed a moderate, significant correlation with instrumental violence indicating that as psychopathy scores increased, ratings of instrumental violence increased (r = .36, 95% CI = [.30, .41]). This pattern of results was consistent for the total, factor, and facet scores. When examining the 84% CIs (necessary when comparing effect sizes that violate the assumption of independence), the relationship between psychopathy and instrumental violence was significantly larger for the Interpersonal facet (r = .42, 84% CI = [.39, .45]), followed by the Lifestyle facet (r = .38, 84% CI = [.35, .41]) and the Affective facet (r = .35, 84% CI = [.32, .38]). The Antisocial facet (r = .29, 84% CI = [.24, .34]) was the least related to instrumental violence. It is important to note that most of the effect sizes showed significant and considerable variability.
Relationship Between Psychopathy and Instrumental Violence
Note. CI = confidence interval.
p < .05. ***p < .001.
Table 4 presents the same findings for reactive violence. Similar to the findings for instrumental violence, the relationship between psychopathy and reactive violence was moderate and significant (r = .35, 95% CI = [.29, .41]). Unlike the results for instrumental violence, Factor 2 was more related to reactive violence (r = .38, 84% CI = [.35, .41]) compared with Factor 1 (r = .30, 84% CI = [.27, .33]). Also, the relationship between psychopathy and reactive violence was stronger for the Lifestyle facet (r = .44, 84% CI = [.41, .47]) compared with the other psychopathy facets. Considerable between-study variability was evident for all effect sizes with the exception of the Affective facet.
Relationship Between Psychopathy and Reactive Violence
Note. CI = confidence interval.
p < .01. ***p < .001.
Type of Scale
To reduce some of the between-study variability, analyses were divided by type of scale. Table 5 demonstrates these results for instrumental violence. All indices of psychopathy remained significantly related to instrumental violence; however, the relationship was significantly smaller for clinical rating scales (r = .29, 84% CI = [.26, .32]) compared with informant and self-report scales (r = .50, 84% CI = [.48, .52], and r = .37, 84% CI = [.35, .39], respectively). For clinical rating scales, the relationship between psychopathy and instrumental violence was consistently small across total, factor, and facet scores. When examining informant measures, Studies 31 and 36 were identified as outliers for certain variables and were subsequently removed (these studies were also removed from all moderator analyses). Unlike clinical rating scales, the Interpersonal (r = .62, 84% CI = [.57, .66]) and Lifestyle facets (r = .55, 84% CI = [.50, .60]) were significantly more related to instrumental violence compared with the Affective facet (r = .44, 84% CI = [.39, .49]) for informant scales.
Relationship Between Psychopathy and Instrumental Violence Divided by Type of Scale
Note. CI = confidence interval.
p < .05. **p < .01. ***p < .001.
Two studies were identified as outliers for self-report scales and were removed (i.e., Studies 33 and 43). Subsequently, there was no statistical difference between Factor 1 (r = .31, 84% CI = [.27, .35]) and Factor 2 (r = .33, 84% CI = [.30, 36]) for the relationship between self-reported psychopathy and instrumental violence. Only the Affective facet could be examined and showed a moderate relationship with instrumental violence (r = .42, 84% CI = [.36, .47]). Although between-study variability was reduced by examining the effect sizes by scale type and by removing outlying studies, significant variability was still evident overall for informant and self-report scales.
Table 6 presents the effect sizes for reactive violence divided by type of scale. Consistent with the results for instrumental violence, all effect sizes were significant; however, the relationship between psychopathy and reactive violence was smaller for clinical rating scales (r = .24, 84% CI = [.19, .29], after removing Study 41), followed by self-report scales (r = .34, 84% CI = [.32, .36]), and largest for informant scales (r = .43, 84% CI [.41, .45]). For clinical rating scales, the relationship between psychopathy and reactive violence was small and significant across total, factor, and facet scores, which was congruent with the results for instrumental violence. For informant scales, after removing outliers, the Interpersonal (r = .59, 84% CI [.54, .64]) and Lifestyle facets (r = .59, 84% CI = [.54, .64]) were significantly more related to reactive violence compared with the Affective facet (r = .30, 84% CI = [.23, .36]). Finally, for self-report scales, the relationship between psychopathy and reactive violence was significantly larger for Factor 2 (r = .42, 84% CI = [.39, .45]) compared with Factor 1 (r = .34, 84% CI = [.31, .37]). Significant between-study variability remained for informant and self-report scales.
Relationship Between Psychopathy and Reactive Violence Divided by Type of Scale
Note. CI = confidence interval.
p < .05. **p < .01. ***p < .001.
Moderators
The results have demonstrated that, overall, psychopathy is equally related to both instrumental and reactive violence. There is some evidence that Factor 2 may be more important in explaining reactive violence, while the Interpersonal facet may be more important in explaining instrumental violence; however, these results were not consistent across scale types. Although separating the analyses by scale type and removing outlying studies reduced the between-study variability (this was especially evident for clinical rating scales), considerable variability remained. To further explore this variability, several moderator analyses were conducted. It is important to note that at least three effect sizes for each level of categorical moderators were required for the moderator to be analyzed. Tables 7 and 8 present the results for instrumental and reactive violence, respectively.
Moderator Analyses by Type of Scale (Instrumental Violence)
Note. CI = confidence interval. Each level of the moderator required at least three effect sizes to be analyzed.
p < .05. **p < .01. ***p < .001.
Moderator Analyses by Type of Scale (Reactive Violence)
Note. CI = confidence interval. Given that clinical scales had non-significant between-study variability for overall psychopathy and total scores, it was not analyzed for moderators. Each level of the moderator required at least three effect sizes to be analyzed.
p < .05. **p < .01. ***p < .001.
Clinical Scales
To ensure adequate power for moderator analyses, only effect sizes with significant Q values or I2 values exceeding .50 were analyzed. For this reason, moderator analyses were conducted on the total scores for clinical scales. Between-study variability could not be explained by sample type or gender composition of the sample. Effect sizes were larger for studies conducted outside the United States. Clinical total scores were also moderated by outcome reporting with larger effect sizes in studies using an objective measure of type of violence as opposed to a self-reported measure. When the outcome was further examined, larger effect sizes were seen for studies utilizing a categorical definition of violence (based on the existing literature) compared with studies that utilized a validated, continuous scale or a simulation design.
When examining continuous moderators, clinical rating scores were moderated by ethnicity (k = 13), b = −.0061, SE = .0022, Z = −2.82, p = .005; effect sizes decreased as the percentage of ethnic minorities within the sample increased. In other words, effect sizes were smaller in samples with higher ethnic diversity. Age was not a significant moderator (k = 19), b = −.0011, SE = .0032, Z = −0.352, p = .725. Moderator analyses were not completed for reactive violence given that there was no significant between-study variability for psychopathy overall or for total scores and I2 values did not exceed .50.
Informant Scales
Considerable variability was evident for informant scales overall. Given the three effect size rule, the only categorical moderators that could be assessed were gender and outcome reporting. Overall, the relationship between informant psychopathy scores and instrumental violence was significantly larger in samples containing both males and females. Outcome reporting was not significant. Informant scale scores were also significantly moderated by the mean age of the sample (k = 7), b = −.0540, SE = .0090, Z = −6.01, p < .001; for every decrease of one point in mean age, the relationship between instrumental violence and psychopathy increased. In other words, effect sizes were larger in younger samples. The relationship between psychopathy and instrumental violence as measured by informant scales was also moderated by ethnicity (k = 7), b = −.0037, SE = .0018, Z = −2.00, p = .046; effect sizes decreased as the percentage of ethnic minorities within the sample increased.
When examining the relationship between informant measures and reactive violence, effect sizes were larger in mixed gender samples but also when the outcome was objective (in this case provided by an informant) rather than self-reported. The relationship between informant-rated psychopathy and instrumental violence was moderated by the mean age of the samples (k = 6), b = −.0694, SE = .0093, Z = −7.43, p < .001 (larger effect sizes as the mean age decreased), but not by ethnicity (k = 6), b = .0012, SE = .0018, Z = 0.64, p = .540.
Self-Report Scales
For self-report scales, the relationship between psychopathy and instrumental violence was moderated by country and sample type with larger effect sizes for studies originating outside the United States and for non-offender samples. The relationship was not moderated by peer review status or by gender. As opposed to informant measures, the relationship between self-reported psychopathy and instrumental violence was larger when the outcome was also self-reported and when a validated scale was used. Finally, effect sizes were significantly moderated by the mean age of the sample (k = 24), b = −.0155, SE = .0024, Z = −6.55, p < .001, indicating that for every decrease of one point in mean age, the relationship between instrumental violence and self-reported psychopathy increased. Self-reported psychopathy scores were not significantly moderated by ethnicity (k = 21), b = −.0017, SE = .0009, Z = −1.93, p = .053.
For reactive violence, the relationship between self-reported psychopathy and reactive violence was significantly moderated by peer review status, sample type, gender, and both outcome moderators. Effect sizes were larger for peer-reviewed studies, general or psychiatric samples, male samples, and when the outcome was self-reported and measured using a validated scale. Consistent with the instrumental findings, the relationship between self-reported psychopathy and reactive violence increased as the mean age decreased (k = 20), b = −.0100, SE = .0030, Z = −3.21, p = .001. Ethnicity was not a significant moderator (k = 16), b = .0000, SE = .0010, Z = 0.10, p = .992.
Publication Bias
Given the limited number of unpublished sources available for the present study (n = 8), analyses assessing for publication bias were conducted. Preliminary inspection of funnel plots conducted for each outcome provided no evidence of publication bias for the overall results. Orwin’s (1983) fail safe N was also calculated, which would indicate the number of studies with a clinically unimportant finding (set at r = .10, for the present study) necessary to negate the present findings. For instrumental violence, the fail safe Ns for total, factor, and facet scores ranged from 19 to 138 studies needed to negate the overall findings. For reactive violence, the Ns ranged from 15 to 100. When the analyses were broken down by type of scale, fail safe Ns decreased to a range of 13 to 70 for instrumental violence and 2 to 53 for reactive violence.
Discussion
Past meta-analyses have established that psychopathy is related to violence, and furthermore, that this relationship is more pronounced for the SD characteristics as opposed to the IA characteristics of psychopathy (Kennealy et al., 2010; Walters, 2003a, 2003b). In addition, Kennealy and colleagues (2010) reported no significant interaction between IA and SD factors, indicating that although IA features predict violence significantly, future violence would be best predicted by looking at impulsivity and past criminal behaviors. Despite the superiority of SD in predicting violence, the question remained as to whether IA features were more important in predicting violence that was premeditated and callous (i.e., instrumental). The results of the present study indicated a moderate and significant relationship between psychopathy and both types of violence; higher psychopathy scores were related to higher rates of instrumental and reactive violence across studies. There was no evidence that psychopathy, overall, was more related to one form of violence over the other.
When examining the differential associations of factor and facet scores, the relationship between psychopathy and instrumental violence was stronger for the Interpersonal facet, while the relationship between psychopathy and reactive violence was stronger for Factor 2. The Lifestyle facet appeared important in explaining both types of violent outcomes. These findings, however, were inconsistent across scale type. For clinical rating scales, all factor and facet scores were equally and consistently related to both outcomes, while for informant measures, both the Interpersonal and Lifestyle facets were more related to both violent outcomes compared with the Affective facet. When assessing psychopathy through self-report measures, both factors were equally related to instrumental violence, while Factor 2 was more related to reactive violence. It is interesting to note that the effect sizes for both outcome measures were consistently moderate, indicating that other variables, besides psychopathy, are likely important when examining violence.
For both types of outcomes, the relationship between psychopathy and violence was smaller for clinical rating scales compared with informant and self-report scales, which is somewhat contrary to other meta-analyses examining psychopathy and violence in general (e.g., Asscher et al., 2011). It is possible that the interaction of another variable, sample type, was partly responsible for this finding. For self-report scales, the effect sizes were larger for non-offender samples compared with offender samples. Considering that the majority of samples included in the analyses for clinical rating scales were offenders, it is not surprising that the effect sizes were smaller compared with self-report scales. In addition, age was also a significant moderator indicating larger effect sizes in younger samples. The smaller effect sizes for clinical rating scales compared with informant measures may be explained by the fact that the majority of samples using clinical rating scales were adult only and all of the samples using informant measures were juvenile samples. This is also supported by the exclusive use of youth samples in the Asscher et al.’s (2011) study, which may explain the differing results.
Moderators
The current meta-analysis consistently identified significant between-study variability indicating the possibility that other factors may be contributing to the overall relationship between psychopathy and instrumental and reactive violence. After dividing the analyses by scale type, the between-study variability for clinical rating scales was substantially reduced. Contrary to some other meta-analyses on psychopathy and violence (e.g., Guy et al., 2005; Kennealy et al., 2010), country of origin was not a consistent moderator, and furthermore, studies outside the United States tended to show larger effect sizes. The mean age of the sample was a consistent moderator with stronger relationships between psychopathy and both outcomes in younger samples. This finding is consistent with Walters (2006) who also examined age as a moderator.
In past meta-analyses, gender and ethnicity have not always been consistent moderators. In the present study, although there was some evidence that the relationship between psychopathy and instrumental and reactive violence was larger for samples with both female and male participants, this was only true for informant measures. In instances where purely male samples could be contrasted against purely female samples, no significant differences were found. Ethnicity was also not a consistent moderator; however, consistent with Edens et al. (2006), smaller effect sizes were sometimes found for samples with larger ethnic heterogeneity.
The moderator analyses concerning sample type were also dependent on scale type. For example, sample type only significantly moderated the relationship between self-reported psychopathy and instrumental violence (i.e., stronger relationship for non-offender samples). It is important to note that given the distribution of sample types across scales, this moderator could not always be analyzed. Regardless, this finding can be partly explained by consistency in test creation and administration; self-report scales were developed on non-offender samples and therefore show larger relationships with outcomes such as violence when utilized with this population.
Similarly, moderator analyses demonstrated greater relationships between psychopathy and both outcomes when there was consistency between who was reporting on the psychopathic traits and who was reporting on the outcome measure (as evidenced by both the reporting strategy and the operationalization of the outcome measure). Self-reported psychopathy scores were more highly related to self-reported outcomes. All self-reported outcomes were based on validated self-report scales (e.g., the Reactive and Proactive Aggression Questionnaire [RPQ]; Raine et al., 2006). Similarly, for clinical rating scales, effect sizes were larger in studies where the researchers determined the criteria for evaluating type of violence (i.e., categorical distinction based on the research literature) instead of utilizing a self-report scale. There was also some evidence that the relationship between informants’ ratings of psychopathy were more related to informant outcomes, at least for reactive violence. These results demonstrate that the way in which psychopathy and the criterion measure are assessed can potentially inflate results.
Practical Implications
Although there are inconsistencies in the results across scale type, the results do indicate that psychopathy overall is not more related to instrumental violence compared with reactive violence. This finding has clear implications for how psychopathy is currently used in the criminal justice system. For example, in preventive detention hearings, it is more likely that an expert present a total score as opposed to factor scores in drawing conclusions concerning risk for violence and recidivism (Blais & Forth, in press). The present findings suggest that it would be inappropriate to assume that an offender is more likely to engage in calculated and callous violence based solely on his or her psychopathy score. As Camp, Skeem, Barchard, Lilienfeld, and Poythress (2013) caution, clinicians working within real-world settings should not assume a causal mechanism underlying psychopathy and “predatory” violence, especially in light of the current findings.
Limitations
Although the study presents several interesting findings, limitations should also be noted. First, a common criticism of meta-analyses is the supposed “file drawer problem”, which describes the fact that articles with significant findings and large effect sizes are more likely to be published and therefore more likely to be included in meta-analyses resulting in a biased sample (Rosenthal, 1979). Although the present search included unpublished sources such as dissertations, the majority of the studies were published. Moderator analyses of publication status (i.e., peer reviewed) were therefore not always possible. Analyses of the impact of this potential publication bias (funnel plots; Orwin’s fail safe N) did not indicate that this would have severely affected the overall results of the present study.
There was concern, however, once the analyses were broken down by scale type. Not only was there a small number of studies available for the analyses of facet scores (several analyses included less than five studies), but the fail safe Ns indicated that very few studies would be necessary to negate some of the findings. This was especially true for the reactive violence outcome. More studies are needed before firm conclusions can be drawn regarding the relationship between psychopathy facets and instrumental and reactive violence. Future studies should therefore extend the search criteria in an effort to include more sources with a focus on unpublished material.
A second limitation of the present study was that the analyses were based on the zero-order correlations presented in the studies. Recent research has started to explore whether Factor 1 of psychopathy is able to add to the prediction of violent outcomes after controlling for the effect of Factor 2 (e.g., Kennealy et al., 2010). Such analyses could not be conducted in the present study and incremental analyses should be considered in future studies. In addition, future studies should restrict the analyses to studies with truly prospective designs to protect against criterion contamination. This refers to the fact that psychopathy assessments often contain items pertaining to instrumental and reactive violence and the same information may be used in scoring both the items and the violent outcome. Such contamination can inflate the relationship between psychopathy and outcome measures in retrospective designs (Patrick & Zempolich, 1998; Swogger & Kosson, 2007).
Conclusion
Despite the study limitations, the results of this study call into question the assumption that psychopathy is more related to instrumental violence as opposed to reactive violence; our results demonstrate equal relationships between psychopathy and instrumental and reactive violence across scale types. Although further research is required when examining facet scores, the present findings do confirm that the relationship between psychopathy and instrumental and reactive violence is complex and may depend on how psychopathy and violence are operationalized and measured.
Footnotes
Acknowledgements
We would like to thank Kelly M. Babchishin for providing guidance on the statistical software and analyses.
