Abstract
This study addresses two central research questions: (1) are children with incarcerated parents (CIP) more deviant than nonimpacted peers and (2) is a regional mentoring social intervention program effective for CIP? Two sources of data were used, longitudinal data gathered from 173 children involved with a regional branch of Big Brothers Big Sisters (BBBS) and a sample of children from the Fragile Families (FF) and Child Wellbeing Study. Based on the BBBS data, results find that CIP were more deviant than nonimpacted peers. Unexpectedly, children involved with BBBS reported more deviance after a year of social intervention, compared with children from FF.
In the face of a growing need for evidence that social intervention can be effective for children with incarcerated parents (CIP; Eddy and Poehlmann 2010; Nation et al. 2003; Parke and Clarke-Stewart 2003), the Big Brothers Big Sisters (BBBS) mentoring program has begun identifying the unique challenges faced by these children (cf. Big Brothers Big Sisters of America [BBBSA] 2011). The one-on-one social intervention model used by BBBS has an empirically demonstrated ability to reduce negative outcomes for other at-risk populations of children, with positive outcomes including reduced drug and alcohol use, improved school attendance and performance, and improvements in a child’s interpersonal relationships (Tolan et al. 2014). The BBBS program achieves these outcomes by pairing children with an active, close, consistent, and long- lasting relationship with a positive adult role model.
The rationale behind this model of social intervention is to give children access to a unique source of social capital. Coleman (1988) argued that human social capital is in part reflected in the differing access people have to one another and the resources made available through those people. Access to disparate groups of people varies. Mentoring programs carefully screen volunteers in hopes of providing at-risk children with a novel source of pro-social human capital, ostensibly steering children to opportunities and influences otherwise unavailable. The term “pro-social” is borrowed from developmental psychology (cf. Baumeister and Bushman 2014) to emphasize the point that sources of social capital differ; not all sources of social capital direct children toward socially accepted norms and expectations. For example, a drug dealer with limited social capital for other job opportunities might have an abundance of social capital making the drug market accessible (Fagan 1989).
Despite a strong foundation in social capital theory, it is uncertain if social intervention strategies such as those found in community-based mentoring programs can successfully mitigate the intergenerational effects of parental incarceration, a situation of risk that has been shown to increase a child’s self-reported levels of sadness (Poehlmann 2005), academic misconduct including cheating (Travis and Waul 2003), and increased likelihood for deviant behavior (Turanovic, Rodriguez, and Pratt 2012).
Furthermore, contemporary findings are in disagreement about the total effect parental incarceration has as a predictor of criminal behavior for CIP, with some studies reporting as much as “60-80% of the intergenerational crime relationship” being accounted for by intergenerational transmission of human capital and behavior from parent to child (Hjalmarsson and Lindquist 2012:553; see also Reed and Reed 2004 who find that CIP are approximately five times more likely to be incarcerated than similar peers). The National Institute of Corrections recently followed up on contemporary claims, adjusting the estimate and reporting that CIP are approximately three times more likely to be involved with the justice system at some point in their own lives, compared with their peers (Conway and Jones 2015).
Debates about total effect are likely to continue; regardless, CIP face unique risks and are in need of empirically grounded social intervention strategies. The present study focused on the efficacy of additional social support/capital in the form of an adult role model for CIP. In particular, analyses examined the ability of a regional mentoring social intervention program to mitigate the effects of parental incarceration on a child’s self-reported levels of sadness, cheating in school, and engagement in deviant behaviors. Two data sources were used, primary data gathered from 173 children involved with a regional branch of the BBBS mentoring program and a survey given to children in the Fragile Families (FF) and Child Wellbeing Study (Reichman et al. 2001). FF data are a nationally representative sample of approximately 5,000 children living in urban settings. The FF sample focuses on at-risk populations of children, including CIP (for more on FF, see Reichman et al. 2001).
The analysis centered on two central hypotheses; the first replicates studies working to examine the negative effects experienced by CIP (cf. Farrington, Coid, and Murray 2009; Haskins 2014; Murray, Farrington, and Sekol 2012):
The second hypothesis tests the efficacy of a regional social intervention program for CIP living in the area:
Literature Review
Broadly defined, mentoring occurs when three things are in place: (1) a protégé (in this case, a child) is involved with a role model who has greater experience or wisdom, (2) the mentor offers guidance to facilitate the development of the mentee, and (3) there is an emotional bond characterized by a sense of trust (Baber 2005).
Sipe (2002) noted three conditions that are critically important for developing successful social intervention through mentoring. She recommended that mentors go through a rigorous process of (1) screening, (2) orientation and training, and (3) ongoing supervision and support (see also Baber 2005). BBBS is the oldest social intervention program in the United States adopting this model of mentoring, providing mentors to children for more than 100 years. Across the United States, in 2014, BBBS served “more than 170,000 children . . . in need of a positive role model” (BBBSA 2014). BBBS matches one child (called a “Little”) with one screened, trained, and supervised adult mentor (called a “Big”). Volunteer mentors commit to spending at least four hours per month with their mentee, typically spread over two to four visits, engaging in social activities such as going to museums, playing video games, or just “hanging out” together.
To provide evidence that social intervention is working, a program must define what “working” means, essentially asking, “What are the intended outcomes of the social intervention and how can they be measured?” Growing scholarly work focused on the efficacy of social intervention programs has catalyzed a BBBS emphasis on providing empirically tested best practices (Grossman and Tierney 1998; Rhodes 2008). In recent years, BBBS has made efforts to clearly define what a mentoring relationship is and what it provides to children being served by the program. With specific reference to children at risk for deviance, BBBS (2011) has stated, JUVENILE JUSTICE—January of 2011, we launched a Juvenile Justice Initiative that focuses on . . . delinquency prevention through research and evaluation . . . We believe mentoring can prevent children who have come into contact with the juvenile justice system from having further involvement with the system [by matching] children with mentors that offer a positive influence and help children achieve their goals by instilling higher aspirations, greater confidence and modeling positive adult-child relationships. We hold ourselves accountable for positive measurable youth outcomes. (P. 8)
However, notwithstanding the good intentions, empirical work supporting positive outcomes for CIP is lacking (Nakkula and Harris 2005; Tolan et al. 2013); at present, reviews of the literature are full of statements that read, “little is known about the impact that [parental incarceration] may have on children, families, and society at large” (cf. Bongers et al. 2004; Loeber and Burke 2011; Naudeau 2010:47). More work is needed to determine if social intervention programs can mitigate the risk factors that children face in these homes, and in particular if social intervention can successfully mitigate the likelihood of deviance across the life-course (Thornberry 2009).
Despite a lack of empirical evidence for this subpopulation of at-risk children, the overall support for mentoring programs has grown steadily (Britner et al. 2006) with more than two million adults serving as a volunteer mentor to children in the United States, in BBBS and similar mentoring programs (DuBois et al. 2011). The popularity of these programs stems from increasing knowledge that a child’s relationships with nonparental adults plays a significant role in promoting overall positive adolescent development (Coakley, Shears, and Randolph 2014; DuBois and Karcher 2005). The literature on attachment, social learning, as well as self- and social control, all highlight the importance of connectedness to nonparental adults for the positive development and health of children (DuBois and Silverthorn 2005). Children who find adults other than their parents to act as a mentor and guide them through the adolescent years have better outcomes (Grossman and Bulle 2006).
Jekielek, Moore, and Hair (2002) as well as DuBois and colleagues (2011) conducted reviews of the literature on child mentoring. They found that children involved with mentoring experience many positive outcomes including a reduction in school absences, more positive school attitudes and behavior, higher college participation, less drug and alcohol use (especially among at-risk minority children), a decreased likelihood for violent behavior, and a decreased likelihood of criminal sentencing. What is not clear, across the literature (cf. Farruggia et al. 2011), is the strength of the effect mentoring has on the negative outcomes facing the children in these programs (see Tolan et al. 2013 for a comprehensive review of the empirical literature).
An additional challenge faced by social intervention is attrition. More than half of all BBBS mentoring relationships end in the first few months (Rhodes 2002; Serido, Borden, and Wiggs 2014; Spencer 2006). Research finds that, when mentoring falls short, social intervention can do more harm than good (Grossman et al. 2012). Evidence-based best practices suggest that children benefit most with at minimum six months of social intervention and, for greatest impact, at least a full year or more of the mentoring relationship (Grossman 2005). For social intervention through mentoring to have a lasting impact on the life of a child, programs need to support relationships of trust lasting at least six months and ideally one year or more (Miller et al. 2013; Roberts et al. 2004).
Mentoring Children at Risk for Intergenerational Crime
Establishing a trusting relationship with CIP is particularly challenging (Ellis et al. 2012). CIP live in a daily reality where trusting relationships are scarce, absentee parents are common, and crime and incarceration are often normative (Besemer and Farrington 2012; Blumstein and Cohen 1987; Campbell et al. 2006; Wakefield and Wildeman 2011). Even after a parent is released from jail or prison, a child continues to navigate the frequent presence of criminal justice personnel, electronic monitoring, and the stigma involved with criminal behavior (Braman 2004; Braman and Wood 2003; Turney, Schnittker, and Wildeman 2012).
In most cases, incarceration adds to the burden of struggling families (Hagan and Foster 2006; Jones, Cauffman, and Piquero 2007; Muller and Wildeman 2013). Wildeman and Western (2010) pointed out families that are impacted by incarceration often deal with difficult life circumstances beyond familial criminality, calling these families “fragile.” CIP often deal with issues of poverty (D. J. Smith 2005; Wacquant 2001), uncertain and irregular housing arrangements (Harper and McLanahan 2004; Johnston 2006), family histories of substance abuse (Hagan, McCarthy, and Foster 2002; Rivers and Anwyl 2000), single parented homes (Harper and McLanahan 2004; Martone 2005; McLanahan and Schwartz 2002), and family histories of mental, physical, and sexual abuse (Ammerman et al. 1999).
It is important to note, even in situations of extreme risk, the probability that parental incarceration will increase the likelihood of intergenerational crime and incarceration is not certain. Children can be surprisingly resilient and the removal of an abusive or negligent parent can be a net positive in a child’s life (Sampson 2011). The negative effects a child experiences as a result of incarceration are related to a number of complicating conditions such as the parent-child separation, the trauma of witnessing the crime and arrest, proceeding periods of incarceration/separation, general instability, poverty, and the adequacy of care in the home. Furthermore, the degree to which a child is affected by parental incarceration may be influenced by a number of variables, including the age of the child, level of maturity and understanding of the crime and incarceration, the length of separation, the level of disruption, the frequency of separation experiences, and the availability of family or community support. Taking all of the risk-inducing factors into consideration, the potential effects of parental incarceration are based on the following four factors: (1) the child’s developmental level (Moffitt 1993; Vazsonyi and Huang 2010), (2) the child’s awareness of the crime and incarceration (Skogan 1988), (3) the cognitive and emotional state of the child (de Haan and Loader 2002; Giordano, Schroeder, and Cernkovich 2007; Hipp et al. 2004), and (4) available social support (Travis and Waul 2003).
In a comprehensive meta-analysis focused only on this population of children, children with an increased risk for deviant behavior, Tolan and colleagues (2013) found only small amounts of empirical evidence supporting positive outcomes through social intervention. They argue that the current state of empirical work on mentoring provides “little understanding” of how social interventions produce positive results (Tolan et al. 2013:21). The point is, despite indications that mentoring can have a positive impact on other at-risk populations of children, when it comes to the population of CIP, little is known about how social intervention might mitigate a child’s likelihood for deviant behavior (for more on social intervention for juvenile deviance, see Jarjoura et al. 2013; E. I. Johnson and Easterling 2012; Kim, Merlo, and Benekos 2013).
In criminological terms, the positive outcomes anticipated from social intervention are rooted in sociogenic processes. Laub and Sampson’s (1993) theory of social control focused on the social conditions that mentoring programs hope to create. Laub and Sampson (2001) presented the concept of the “turning point” as the foundational expression of how social influence can either steer people away from or toward deviant behaviors (Laub and Sampson 2003). Life events transition people into distinct settings. For example, turning points transition people from family care into schooling, from changes in friend groups, to the role obligations of getting married. Events occur in the context of larger structural and cultural conditions that present new sets of norms and expectations to negotiate. As people learn to navigate and interact with new groups of people, opportunities for, and outcomes related to, behavior also change (Stryker and Craft 1982; Turner 1962). This is not a new idea. The notion of a turning point taps into the processes of socialization (Gottfredson and Hirschi 1990), social learning (Akers and Jensen 2006; Sutherland 1947), and role-based theories of criminal behavior (Matsueda and Heimer 1997).
A turning point at once recognizes the interactive nature of mentoring as well as the human agency involved in such a pairing. Placing a child in a deliberately constructed relationship with the “Little” role to occupy recognizes the power of socialization experiences to influence behavioral outcomes. Combining the individual-level interactions of socialization with the macro/cultural norms and expectations providing context for interaction, social-control theory and turning points argue that pro-social behavior is directly proportional to a person having access to a pro-social environment (Laub and Sampson 2002). A mentor provides a child with novel access to social roles and social capital that might otherwise be out of reach (Coleman 1988; Rose and Clear 1998).
Accordingly, current cross-cultural research on the effects of social capital finds that access to pro-social capital in the form of norms and interaction networks predicts not only perceptions of crime (Ferguson and Mindel 2007), but the commission of property (Paolo, Montolio, and Vanin 2009) as well as violent crimes (Kennedy et al. 1998). The hope is that, over time, as children in the BBBS mentoring program develop a sense of identity around the Little role, they will begin to internalize the pro-social capital they have access to through the relationship with their mentor (Mead 1934). Increased exposure to pro-social capital (i.e., norms, expectations, identities) increases pro-social attitudes, including self-control (Ray et al. 2013), thereby decreasing deviant behaviors. BBBS posits that the positive social influence of a mentor will provide children with a pro-social role to model, alternate expectations to consider, and will potentially represent a “turning point” to a life-course trajectory outside of the life conditions that might otherwise predict a life of crime and other antisocial outcomes (Fusco 2012).
Hypotheses
The present study focused explicitly on the efficacy of additional social support/capital in the form of an adult role model for children with an incarcerated parent. Another contribution of the current study is the source of data. Data in the current study were gathered directly from impacted children. Few studies examine intergenerational risk from the perspective of the affected children (T. Johnson 2012). Two hypotheses were tested:
Outcomes tested in this study were (1) deviance, (2) cheating in school, and (3) self-reported levels of sadness.
Analytic Strategy
Two data sources were used in this study to determine if the social support services provided through mentoring result in the anticipated turning point. The first data source came from primary data gathered from 173 children in the BBBS mentoring program in Central Indiana (BBBSCI). BBBSCI serves the Marion county region; a 99 percent urban environment of approximately one million people surrounding Indianapolis, Indiana. Panel data were collected in three waves (i.e., T1 = baseline collected prior to treatment, T2 = six months of social intervention, and T3 = one year of social intervention). The second data source came from the FF and Child Wellbeing Study. FF data are a nationally representative sample of at-risk children living in urban settings. FF data are ideal given the focus of the data collection on FF, including study measures relating to familial crime and incarceration (Wildeman and Western 2010:158). FF data include a cohort of approximately 5,000 children who were born between 1998 and 2000. It should be emphasized that FF data come from a nine-year follow-up survey given to children and are a cross-sectional assessment of children at this point in time. During analyses that did not use the probability matching found in propensity scores, FF data were treated as a representative national “average” of at-risk children in urban settings across the United States. This average applies to three FF dependent variables not modeled longitudinally.
Several limitations exist in the primary data. It should be noted that the results of this study are an analysis of a particular BBBS implementation with limited information about the programming beyond the assurance that all national BBBS standards were being met. Indeed, there may be unmeasured mentoring relationship factors that explain why this particular BBBS achieves the outcomes reported. For example, it is possible that hours spent or quality of pro-social capital of mentoring at BBBSCI vary from the BBBS national average. Too, based on limitations in the FF data, parental incarceration in this study collapses the mother and/or father into one category, with no distinction made. Studies have demonstrated differing effects of maternal versus paternal incarceration for CIP (Geller and Franklin 2014; Huebner and Gustafson 2007; Western and McLanahan 2000).
Furthermore, attrition in the primary data from baseline to the third wave of data resulted in about 50 percent of the original BBBSCI sample leaving the study. Attrition challenges most panel data analyses and, in particular, studies that examine at-risk children involved with mentoring (Bell and Bradley 2013; DuBois et al. 1992). Based on missingness, data were analyzed using regression models under maximum likelihood estimation in a mixed-model framework, rather than ordinary least squares; this approach has a demonstrated robustness to missingness when data are monotone, or missing at random (Rabe-Hesketh and Skrondal 2012:278–82). A missing data analysis was run finding that missingness was monotone; that is, children left the program and did not return to provide data at later waves. To further account for any bias that may have come from a misspecified model, the sandwich estimator for standard errors with the command vce(robust) was used in Stata (Rogers 1993).
Measures of Dependent and Independent Variables
Each dataset contains a scaled measure of deviant behavior, an identical measure of self-reported cheating in school recorded as Yes/No, and an identical measure of self-reported sadness recorded as a frequency. The deviance scales represent different underlying dimensions based on each survey (see tables below for more); for this reason, the scales were standardized using Bartlett Factor Scale Scores with a mean of 0 and a standard deviation of 1 (for more on factor scores, see DiStefano, Zhu, and Mîndrilă 2009; Reise, Waller, and Comrey 2000; Russell 2002). The deviant behavior items in the FF data were all coded Yes/No and required cleaning prior to component analysis. Responses coded “Not in wave,” “Missing,” “Don’t know,” and “Refuse” were all coded as missing. Restructuring of the FF data resulted in the principal components analysis (PCA) statistics displayed in Table 1 (using Promax rotation with a coefficient of alienation set to .25). 1 The Kaiser-Meyer-Olkin (KMO) & Bartlett test of sampling adequacy was .825 (p = .001) indicating adequate sampling after recoding.
Principal Components Analysis of Deviant Behavior Scale in FF Data.
Note. Rotation converged in 6 iterations. The highest correlation between components was 1 and 4 at .330. FF = Fragile Families.
Restructuring of data reduced component fit based on the premise that there was nothing meaningful to interpret in the missing values; and for the purposes of this study, missing data were not analyzed beyond their missingness (see Allison 2002; Schafer and Graham 2002 for more on the treatment of missing data values).
Four items from Table 1 dealing with property damage and stealing were used in a Confirmatory Factor Analysis (CFA) and create the deviant behavior scale in the FF data. CFA showed that these measures fit the data well (e.g., Root Mean Square Error of Approximation [RMSEA] = .035) despite moderate loadings (average CFA loading of .45) and Cronbach’s alpha (α = .547). These items were used during analysis for three reasons: (1) they loaded together during component analysis, (2) they partially overlapped with the BBBSCI items, and (3) they represent actions that are criminal, and because the likelihood of intergenerational crime is the focus of this research, they proved most sensible as a comparison of deviant behavior bent toward criminality (R. C. Johnson 2009).
The deviant behavior scale in the BBBSCI data came from four measures. The first item asked the frequency children had stolen things (loading .744), done things against the law (loading .796), been stopped and questioned by the police (loading .816), and been arrested (loading .909). All items were coded 1–8 with 1 = Never and 8 = Every Day. Component analysis of the deviant behavior items in the BBBSCI data returned a KMO-Bartlett statistic of .763 (p = .001) and a Cronbach’s alpha of .876. BBBSCI deviant behavior items hang together very well as a scaled measure of deviance. 2 Table 2 presents the mean and standard deviation for each of the outcome variables analyzed and also includes information organized by children who are impacted by parental incarceration. In both sample populations, CIP had higher negative outcomes, in some cases, double the standard deviation. The differences were smaller, or reversed, in the case of BBBSCI data for academic dishonesty (i.e., at BBBSCI baseline, children not impacted by parental incarceration self-reported more cheating).
Means and Standard Deviations of Dependent Variables by CIP and Treatment.
Note. BBBSCI = treatment; FF = control. CIP = children with incarcerated parent; BBBSCI = BBBS mentoring program in Central Indiana; BBBS = Big Brothers Big Sisters; FF = Fragile Families.
Descriptive statistics found in Table 2 suggest that CIP are more deviant and sad than a comparison group of peers, and that while negative outcomes decrease overall, the BBBSCI children consistently experience more negative outcomes than FF children. The causal nature of these relationships was explored in greater detail during subsequent analyses.
The measure for CIP was constructed as a binary variable 0 = No Impact and 1 = Yes Impact. In both samples, coding came from a combination of measures asking if either the child’s mother or father (or both) had ever been incarcerated during a child’s life. In the BBBSCI data, coding sources included agency data records, parent reports, mentor reports, or a child’s self-reported awareness of parental incarceration at each wave of data collection. Any response that confirmed parental incarceration was coded a 1 at that wave and later waves of data collection. In the FF data, both mother’s reports and father’s reports were used to construct the parental incarceration Impact variable as well as “constructed” variables created by the FF researchers regarding parental incarceration Impact. Any response that confirmed parental incarceration during a child’s life was coded 1.
The measure of parental incarceration in the FF data was drawn from multiple sources, none of which include a measure of child awareness related to the crime and incarceration of the parent, as was present in the BBBSCI data. As the FF data lack this level of sensitivity to the effect of parental incarceration, the analyses presented here likely missed some of the child awareness effects of parental incarceration in the FF data; and because it is impossible to know the level of awareness of the children in the FF data, it is uncertain if the bias was positive or negative. This is a known sensitivity, or measurement error, limitation of the FF data.
Controls, including controls for multivariate matching purposes, included age as a continuous variable of actual age; age has a strong positive relationship to deviance (Farrington 1986). Based on a demonstrated linkage between socioeconomic status and the likelihood for deviant behavior (see Giordano et al. 2011; Nagin and Tremblay 1999; 2001), a child receiving free school lunch (binary: yes/no), the primary caregiver’s employment status (categorical: employed, unemployed, and other), as well as household income (categorical: arranged in standard categories) were all controlled for. Finally, because both gender (see Lauritsen, Heimer, and Lynch 2009) and race (see Western 2006) are known to be related to deviant behavior, both of these controls were also included. Table 3 displays the controls used.
Means and Standard Deviations of Independent Variables by BBBSCI Baseline and CIP.
Note.
Method
Three methods were used to examine the relationship between parental incarceration and the effectiveness of social intervention for reducing negative outcomes. First, before determining if the BBBS social intervention reduced deviant behaviors, the a priori relationship that social intervention programs assume represented in H1 was modeled, that is, CIP are more likely to be deviant than nonimpacted peers. Using only the BBBSCI data—because it is longitudinal—two-level random intercept and random coefficient models for each outcome were estimated. This analysis provided regression estimates for the child as well as estimates for grouped cases by parental incarceration accounting for any variation occurring in the outcome level as a result of correlated error. Second, using both BBBSCI and FF data, I ran fixed-effects repeated measures analysis of variance (ANOVA) models treating FF as a national average comparison indicating how children in BBBSCI fare across a year of social intervention compared with the nationally representative “average” of FF children. Finally, to determine if social intervention is working, I compared the FF data to the BBBSCI data using propensity score matching (PSM; Rosenbaum and Rubin 1983, 1984). PSM was used for three reasons: (1) PSM has become a popular method for making quasi-experiential comparisons (Becker and Ichino 2002; Dehejia and Wahba 2002; Richey and Ikeda 2009), (2) PSM methods of balancing data are attractive especially to account for the age differences in these data, and (3) PSM was chosen because it replicates a recent report issued by BBBS finding positive outcomes of mentoring as a social intervention comparing children currently being mentored with children on a waiting list for a mentor (Valentino and Wheeler 2013): To draw conclusive evidence . . . we used a technique known as Propensity Score Matching to match each treatment youth with a youth from the comparison group who was similar on these potentially influential characteristics. (P. 20)
PSM analysis was run using a logit probability model. Scores were created using the controls mentioned above and were based on prior theoretical and empirical work dealing with at-risk children (Heckman, Ichimura, and Todd 1998; Latimer 2001; Rosenbaum and Rubin 1985). PSM was used to make the final comparison between the BBBSCI children and the FF children.
The limited data available on CIP and the difficulty of establishing a traditional experiment along with the ethical concerns of delaying children’s access to social services (for more on this point, see Blechman and Bopp 2005:461) make PSM an attractive substitute to randomization. Propensity scores were used to balance data so that the distribution of pretreatment covariates was similar but independent (unconfoundedness) of the treatment effect (Caliendo and Kopeinig 2008; Dehejia and Wahba 1999, 2002). In other words, a child’s place in the treatment group was determined by carefully selected observed variables, and based on these conditions, assignment to treatment was effectively randomized. Once balancing was satisfied, the propensity score had the same distribution properties independent of the treatment. During analysis, balancing was achieved for each of the PSM analyses run. The parameter estimate called the “average treatment effect on the treated” (ATT) was then used for comparison between cases.
All PSM estimates were obtained in Stata 13 using pscore (Becker and Ichino 2002). ATT was based on a range of propensity scores determined by common support. Counterpart observations are differentiated from controls using two matching methods. The first is nearest neighbor matching with replacement, comparing children from each sample who have the closest propensity score and allowing untreated FF children to be used more than once as a match. Running a PSM with common support and replacement adjusts for the difference in control conditions in each sample, for example, age. The second matching method, kernel matching, is a nonparametric matching based on a weighted average of all of the FF children (for more on matching methods, see J. A. Smith and Todd 2001).
Results
Results from the Random Intercept and Random Coefficient Models
Table 4 presents the results of multivariate examination using a random intercept model of deviant behavior, and Table 5 presents a similar analysis using a random coefficient model testing nesting of random effects.
Multilevel Regression of Deviant Behavior, Random Intercept Model Estimates.
p ≤ .10. *p ≤ .05. **p ≤ .01. ***p ≤ .001.
Multilevel Regression of Deviant Behavior, Random Coefficient Model Estimates.
p ≤ .10. *p ≤ .05. **p ≤ .01. ***p ≤ .001.
Model 1A included all of the controls. Model 1B dropped nonsignificant results after the first run. Model 1C included only the variables that were significant after the second run.
Results suggest that the best predictor variable, over the year of social intervention, for a child’s involvement in deviant behavior was whether or not they were impacted by an incarcerated parent. Across each model tested, CIP were .3 to .4 standard deviations higher on the deviance scale than children who are not impacted by parental incarceration.
Results of the random coefficient model support those found in the random intercept model. The likelihood-ratio test after estimation of the nested coefficient model within the random intercept model revealed that the mixed models were not nested, and because children’s rate of deviant behavior is essentially the same across mixed models, either model may be accepted.
Models of the outcome for cheating and sadness did not find significant effects for parental incarceration and are not reported here. There were, however, significant effects for controls finding that children from Black (β = 1.59, p = .01) and Other (β = 2.60, p = .001) racial categories were more likely to cheat. This finding is consistent with the literature on academic dishonesty (McCabe and Trevino 1997; Morris 2012).
Results of the mixed-effects regression models found that children who have an incarcerated parent are significantly more likely to commit deviant acts, supporting H1. The predictor for parental incarceration Impact was predictive across a year of social intervention even when controlling for variables such as age, gender, and race, variables that have been used successfully to predict criminal activity in numerous empirical settings.
Results from Fixed-effects ANOVA Models
Table 6 displays the results of the fixed-effects repeated measures ANOVA with BBBSCI children compared with the FF “average.” Following the results of the mixed models reported in Tables 4 and 5 above, I only report the results for children from both samples that were impacted by parental incarceration (modeled with controls). In each of the fixed-effects models, the assumption of sphericity was violated (the assumption that the variance between all predictors is equal, Mauchly’s Test = .406[2df], p = .001) and the test of within-subjects change over time was based on the Greenhouse-Geisser correction. The Greenhouse-Geisser correction of the mean scores for each outcome was statistically significantly different between time points by parental incarceration risk (see within-subjects statistics reported in Table 6). The BBBS program had a statistically significant effect on the children who were impacted by parental incarceration over time. However, how did this effect compare with the FF average?
Fixed-effects ANOVA of FF and BBBS Data across Three Waves of BBBS Data.
Note. ANOVA = analysis of variance; FF = Fragile Families; BBBS = Big Brothers Big Sisters; BBBSCI = BBBS mentoring program in Central Indiana.
Control = FF Children – Black Line/Constant, Treatment = BBBSCI Children – Red Line/Changing.
Looking at Figure 1 in Table 6, I found a bouncing trajectory for the BBBSCI children’s self-reported deviance over the year of social intervention. This resulted in a nonsignificant amount of change compared with the FF average. Over a year of social intervention, there was enough negative and then positive change to eliminate a significant effect between subject groups for self-reported deviance. The net amount of change equaled out over the year of social intervention, with the mean value for BBBSCI Deviance at baseline nearly identical to the FF national “average.” Children start the program with the same amount of self-reported deviant behavior (see Figure 1 in Table 6). After six months of social intervention, the likelihood for deviant behavior drops significantly, but at one year of social intervention, Deviance climbs above the FF data (time by treatment within-subjects effect F = 65.37, p = .001), and based on this, there was no statistically significant difference between groups (F = .19, p = .668). Further analysis of these differences at six months and one year were analyzed in PSM models.
Both Cheating and Sadness had statistically significant within- and between-subject effects. The self-reported instance of cheating went down at the six-month interviews, but at one year, rose slightly. Even after the increase at one year, the level of reported cheating stayed well below the amount reported at the baseline measurement. However, as Figure 2 in Table 6 indicates, at each time point, self-reported cheating among BBBSCI children was higher than the amount reported by FF children.
In terms of Sadness, BBBSCI children experience a consistent decline in the frequency of self-reported sadness over the year of social intervention. However, when treating the model as fixed, at each time point, the levels of sadness experienced by BBBSCI children were higher than those reported by FF children (see Figure 3 in Table 6). It appears that social intervention is working over the year of social intervention when it comes to cheating in school and the frequency of sadness these children experience. However, the Deviance outcome cautions against a singularly positive interpretation of the findings. For this reason, BBBSCI data were balanced against FF data and compared in a quasi-experimental PSM framework. The PSM allows for a more conclusive argument addressing H2. Did BBBSCI produce positive outcomes after a year of social intervention had taken place?
Results from Propensity Score Models
Table 7 displays the results of the first PSM analysis. After six months of social intervention, the ATT resulted in BBBSCI children reporting less deviant behavior compared with FF children. However, after a full year of social intervention, the ATT was positive and like the fixed-effects model was not significant.
Mentoring Effect on Deviance for Children Impacted by Incarceration.
Note. NT = sample size of treatment; NC = sample size of control; ATT = average treatment effect on the treated; ANOVA = analysis of variance.
Small t values for Deviance were consistent with the ANOVA results. Taken as a whole, both sets of analyses indicate that social intervention did not produce the expected positive outcomes, with the mentoring effect decreasing deviance at six months of social intervention, but after one year, rising to the point that there was no significant effect from mentoring.
Table 8 displays the results of the PSM analysis comparing BBBSCI children with FF children on Cheating. Nearest neighbor matching for the ATT supported the results already reported. Using a nonparametric comparison based on a weighted average through kernel matching also found an increased likelihood for self-reported cheating among BBBSCI children, finding that over the year of social intervention, the ATT increased. Taken with the fixed-effects results, these findings indicate that BBBSCI children were consistently more likely to report involvement in academic dishonesty compared with FF children.
Mentoring Effect on Cheating for Children Impacted by Incarceration.
Note. NT = sample size of treatment; NC = sample size of control; ATT = average treatment effect on the treated; ANOVA = analysis of variance.
Table 9 displays the results of the PSM analysis on Sadness that compared BBBSCI children with FF children. At six months and one year of social intervention, the ATT resulted in BBBSCI children reporting less sadness compared with FF children.
Mentoring Effect on Sadness for Children Impacted by Incarceration.
Note. NT = sample size of treatment; NC = sample size of control; ATT = average treatment effect on the treated; ANOVA = analysis of variance.
PSM results for Sadness find a positive outcome from the effect of mentoring on children. The fixed-effect model reported in Table 6 found consistently declining levels of sadness among mentored children. Using the quasi-experimental methods of PSM, results find that BBBSCI children report less sadness than FF children as a result of social intervention. Despite this positive outcome, results of the PSM analyses were mixed.
Discussion
The findings reported in this study support previous research and the hypothesis that CIP report more deviant behavior (Murray et al. 2014). However, the hypothesized relationship between mentoring and positive outcomes was not fully supported. I hypothesized that after one full year of mentoring, CIP in BBBS would report less deviance, cheating, and sadness compared with a nationally representative sample of similar children. When impacted children from FF were compared with impacted children from BBBS, I found that mentoring did not result in all of the expected positive outcomes, that is, results dipping below the “average” represented by the FF children. To the contrary, children in BBBS experienced increases in both Deviance and Cheating after a year of social intervention.
The mixed models suggested that a significant amount of deviant behavior comes from the effect of parental incarceration, but why a jump in cheating specifically? The increased likelihood for academic dishonesty may be explained by the fact that BBBS spends a lot of time focusing on a child’s performance in school (Rhodes, Grossman, and Resch 2000). BBBS children are oriented toward academic pursuits, spending mentoring time on homework and thinking about how schoolwork impacts their future opportunities. This focus on academics potentially has the unintended effect of leading children who are struggling to innovate an avenue to success (Merton 1938), believing cheating is one way to achieve good grades and increase their life opportunities (Bernardi et al. 2004; Davis et al. 1992; for more on this possibility, see McCabe and Katz 2009; T. R. Smith 2004). This antecedent “cause” for the increased likelihood of academic dishonesty among the BBBS children is beyond the scope of this study but provides an avenue for further research on the long-term effects of social intervention and academic integrity.
The bouncing trajectory may also be explained by a “shock effect” experienced as children join the mentoring program. This would explain the drop from baseline to six months of social intervention. With respect to Deviance and Cheating, as the social intervention relationship nears a close, the initial effect diminishes. Mentoring programs will need to find ways to continue the initial positive gains found in the first six months of mentoring. One suggestion might be to support continued contact between the Big and Little. With the increasing ease and proliferation of electronic communication, one possibility is a pen-pal program, requiring Bigs to commit to continued and consistent contact with their Little for two to five years beyond mentoring.
Looking at the results of mentoring on Deviance and Cheating, it appears that compared with the FF children, social intervention is making things worse for CIP (increasing the likelihood for these outcomes). However, this interpretation of the findings should be treated with caution. One possible explanation for the findings that falls outside of the scope of this study relates to the BBBS baseline numbers. Both Cheating and Sadness were higher at baseline for BBBS children, with Deviance essentially the same. This alone may account for the overall “lack of success” of BBBS when compared with the FF children. This could indicate that the urban setting and conditions of this study are particularly challenging for CIP. The city where this study took place has relatively high crime rates (the city crime index for 2013 was 647.8 while the national average for that same year was 297.1 3 ), which exposes more children to criminal environments and role models. In addition, children from the FF study are on average three years younger than children in the BBBS sample. This age difference likely affects the multilevel models, even when age is controlled for, as was done here.
Does social intervention act as a turning point for these children? Based on the final comparison using propensity matching with replacement (and the assumption of balancing satisfied) when CIP in the local BBBS program were compared with a nationally representative sample, on average, the BBBS children report more cheating and deviance, suggesting that social intervention is not working for this population of children. However, despite these negative outcomes, findings indicate that children receiving social intervention are happier than the comparison group of FF children. Is it working? In some ways, no; but, in others, there is evidence supporting social intervention as a turning point.
Limitations and Suggestions
The outcomes measured are not generalizable to the effect of mentoring across the BBBS social intervention network. These findings may reflect the efficacy of the program in the study setting. The effect of the BBBS program as a whole for CIP is largely unknown (Bruster and Foreman 2012; Jarjoura et al. 2013; Miller et al. 2013). Nonetheless, these findings are useful as an indicator of the efficacy of social intervention under the condition of the study setting. The expected positive outcomes of mentoring did not fully occur for CIP, indicating that programs serving this population of children may need to adjust how they meet their unique needs. If the BBBS social intervention is to provide a turning point for CIP, it may be necessary to restructure elements of the program. One change could be an increased length of mentoring commitment. More time in the program provides at-risk children with more opportunities to socialize with their mentor, thus, increasing the probability that this relationship will act as a turning point in the life of the child (Laub and Sampson 1993).
The most serious limitation is the lack of a generalizable mentoring effect. Research including a large representative sampling of BBBS would be able to make more precise claims. Future research would also benefit from mixed methods, augmenting the limitations of self-report measures relied upon in this study. Expanding the BBBS data is a worthy, but time-consuming and expensive undertaking, which made this level of generality impossible for the current project. Another limitation is the lack of longitudinal data from the FF study. Comparisons with a single cross-sectional wave of data, though nationally representative, should be interpreted with the knowledge that the BBBSCI data were being compared with a cross-section of FF data. The FF children provide a snapshot of children across the United States at a single point in time. A better measure of the changing likelihood for deviant behavior, cheating in school, and sadness would be to follow these children and survey them as they mature. As another researcher making use of these data notes, despite these limitations, the FF data are “the strongest data upon which to make causal claims about the relationship between [parental] incarceration and children’s” risk for intergenerational deviance (Wildeman 2010:308). The fixed-effect model provided a useful “average” comparison against my program data whereas the PSM models provided the quasi-experimental comparisons that determined social intervention at this site is not reducing deviance and cheating, but is increasing happiness for CIP.
In summary, the results of this study support the first hypothesis but do not fully support the second. In support of H1, results find that CIP report more involvement in deviant behavior compared with peers who are not impacted by parental incarceration. Mixed results related to H2 find that after a year of social intervention, mentoring does not reduce deviance and increases academic dishonesty. However, children involved with mentoring are happier than FF peers. Multiple modeling strategies and three different outcome variables were used demonstrating the robustness of these findings. Results suggest that the current implementation of BBBS social intervention is only partially successful at mitigating the negative effects of parental incarceration (see Phillips and O’Brien 2012 for more on the unique challenges and needs of children at risk for intergenerational criminal outcomes). It is recommended that the BBBS program evaluate its future plans for providing social intervention services addressing the unique needs of this population of at-risk children.
Additional Resources
For more information about Big Brothers Big Sisters visit the following Web site: http://www.bbbs.org/. For more information about the Fragile Families and Child Wellbeing study, visit the following Web site: http://www.fragilefamilies.princeton.edu/. Those interested in pursuing research investigating the collateral consequences of parental incarceration should visit the Web site of the Office of Juvenile Justice and Delinquency Prevention (OJJD): https://www.ojjdp.gov/funding/funding.html.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
