Abstract
Home visitation has the potential to improve parent, child, and maternal outcomes and has become a widely implemented prevention program across the United States. The purpose of this research was to use a randomized controlled trial to assess the short-term effectiveness of the Arizona Healthy Families program across a range of outcomes. Two hundred and forty-five families were randomly assigned to the experimental group (Healthy Families) or control group (Child Development assessment only). Results revealed significant findings across four domains including safety and resources, parenting attitudes and behaviors, health and maternal outcomes, and mental health and coping. These results were further corroborated with an analysis of qualitative findings that analyzed linguistic differences between how the treatment and control group described their parenting. These results add to the existing literature on the effectiveness of the Healthy Families model of home visitation.
Keywords
Home visitation research remains on the forefront, as policy makers look to evidence for programs they believe are worthy of investment. This interest is fueled by the potential wide ranging and significant outcomes associated with home visitation. Home visitation programs expect outcomes across many domains: child maltreatment rates, positive and nurturing parenting behaviors, prenatal and child health, child development and school readiness, and maternal educational and employment success. The infusion of significant dollars from the Maternal, Infant, and Early Childhood Home Visitation Program; the Children’s Bureau; and various state sources accentuates the need for new research and lessons learned that can influence future implementation and build more effective practice models for home visitation.
There are many home visitation programs being implemented across the country. Programs deemed evidence based (see Avellar, Paulsell, Sama-Miller, & Grosso, 2014) are being the most carefully reviewed for ongoing evidence. A total of 19 programs meet Department of Health and Human Services (DHHS) criteria for evidence including Child FIRST, Durham Connects/Family Connects, Early Head Start-Home Visiting, Early Intervention Program for Adolescent Mothers, Early Start (New Zealand), Family Check-Up, Family Spirit, Healthy Families America (HFA), Healthy Steps, Home Instruction for Parents of Preschool Youngsters, Maternal Early Childhood Sustained Home Visiting Program, Minding the Baby, Nurse Family Partnership, Oklahoma’s Community-Based Family Resource and Support Program, Parents as Teachers, Play and Learning Strategies, Infant, and SafeCare Augmented.
Within this group of evidence-based programs, one of the most widely adopted programs is HFA. This program, like the other home visitation programs, still has limited evidence of program effectiveness (Avellar et al., 2014).
Home visitation services include a broad set of goals for families. Most home visitation studies focus on four primary areas that include child safety and health, parenting practices, maternal health and self-sufficiency, and mental health and coping. There are five recent experimental studies that have examined the effectiveness of the Healthy Families program model using a variety of outcome measures. A series of studies in New York found positive results showing reductions in several types of abusive and neglectful parenting practices (DuMont et al., 2008) and positive results in reducing the risk of a low birth weight baby (Lee et al., 2009). A further analysis (DuMont et al., 2010) found more positive outcomes on measures of reduction of harsh discipline for first-time, prenatally enrolled mothers when compared with the control participants. One study (Barlow et al., 2006), less recent but often not cited, is of a Healthy Families program that examined program outcomes with an American Indian population. This is one of the few studies looking at program impacts within a minority population. This small randomized trial was conducted with one Apache and three Navajo communities where paraprofessionals delivered the program prenatally. Program participants showed positive impacts on measures of parent knowledge and maternal involvement when compared with a control group. A Massachusetts study (Easterbrooks et al., 2012) found mothers enrolled in the Healthy Families program reported less parenting stress than control mothers. There were no program differences between the two groups on measures of self-reported child maltreatment, and in one analysis, there was a significant difference from the control group of reported cases of child maltreatment in favor of the Healthy Families group.
Another recent study (LeCroy & Krysik, 2011) found positive results on reductions of harsh discipline similar to the New York study (DuMont et al., 2008). The Arizona study also found positive results in comparison to the control condition on use of safety practices, parenting attitudes (e.g., inappropriate expectations), reading to children, use of resources, reduced alcohol use, and greater maternal education and training. A recently published study (Green, Tarte, Harrison, Nygren, & Sanders, 2014) reported results from a randomized trial that found positive outcomes showing Healthy Families mothers read more frequently to their children, provided more developmentally supportive activities, and had less parenting stress than the control group.
The areas of focus that continue to direct research attention in home visitation include quality of service delivery and implementation (Azzi-Lessing, 2013); timing of service initiation (prenatal or postnatal enrollment) and limitation of services to first-time moms or multiparous mothers (Huntington & Galano, 2013); and families with high-risk factors such as depression, violence, and substance abuse (Ammerman, Putnam, Bosse, Teeters, & Van Ginkel, 2010).
Depression has been strongly linked to poor parenting and associated with child maltreatment (see, e.g., Ammerman et al., 2010; Conron, Beardslee, Koenen, Buka, & Gortmaker, 2009; Duggan, Caldera, Rodriguez, Burrell, & Crowne, 2007; Easterbrooks et al., 2013). The research question most often examined was, what impact does maternal depression have on program outcomes? Ammerman, Putnam, Bosse, Teeters, and Van Ginkel (2010) have focused research on depressed mothers, and in their initial study, they found that depressed mothers were less likely to benefit from home visitation services. Other researchers have also found nondepressed mothers obtained better outcomes (Easterbrooks et al., 2012; Green et al., 2014; Mitchell-Herzfeld, Izzo, Greene, Lee, & Lowenfels, 2005). Stevens, Ammerman, Putnam, and Van Ginkel (2002) report that maternal depression was present for 30% of the Healthy Families participants. Also, Duggan, Berlin, Cassidy, Burrell, and Tandon (2000) report that program outcomes for depressed mothers can be negatively impacted by attachment style.
Research continues to stress the importance of program implementation and fidelity. Research studies have found that families that receive more home visits (higher program dosage) are more effective (Howard & Brooks-Gunn, 2009). More recently studies (see Kahn & Moore, 2010) found that program intensity measured by the number of home visits within a set time period had the greatest impact. In particular, programs that achieved more than four home visits per month over a 1-year period had more positive outcomes than did programs with fewer visits (Kahn & Moore, 2010). Nievar, Van Egern, and Pollard (2010) found that two visits per month was a critical threshold for showing impact. Green, Tarte, Harrison, Nygren, and Sanders (2014, p. 6) summarize the issue: “the quality of program implementation, and in particular the dosage, frequency, and content of home visits is a near-universal challenge for home visiting programs and associated research.” The recent report by Boller et al. (2014), Making Replication Work, examined program implementation across the sites funded by the Evidence-Based Home Visiting initiative to prevent child maltreatment. The study found that all home visitation programs struggled to maintain caseloads and deliver service at the intended intensity. In addition, they found that fidelity of implementation was partly a function of “model factors” and that high-risk families were more likely to leave the program early. A study by Allen (2007) concluded that the relationship between the home visitor and the parent may impact the intensity of services that the parents receive.
In spite of new findings, reviewers continue to characterize home visitation programs as having uncertain impact, for example, “despite their growing popularity, there is considerable uncertainty regarding the efficacy of home visitation programs to produce meaningful and lasting outcomes for the children and families they serve” (Azzi-Lessing, 2013, p. 377). Furthermore, because home visitation is receiving significant fiscal support, ongoing evidence of program effectiveness is an important research priority. Therefore, it is critical that ongoing documentation of outcomes—beyond child maltreatment—be presented and published. The present study adds to this existing literature by conducting a randomized control trial of a well-established HFA program in a state that included an extensive quality assurance program, used a well-developed curriculum, and has obtained statewide accreditation. Furthermore, the present study is an important contribution because it extends the examination of potential outcomes by including several additional measures to test broader aspects of the program’s impact.
Although most of the literature on Healthy Families evaluations has been quantitative outcome studies, there has been an increasing interest in augmenting outcome studies with qualitative methods (McCall & Green, 2004). In a review of critical issues in home visitation, Azzi-Lessing (2011, p. 394) states, “qualitative evaluation methods should be employed to capture the experiences and responses of families served by home visitation programs.” Many studies have focused on either a quantitative approach or a qualitative approach. The current study includes a rigorous experimental study and adds an innovative qualitative method to the analysis.
Program Background and Design
Healthy Families Arizona is based on the national HFA (2016) program model. The overall goals of the program include the following: promote positive parenting, enhance child health and development, and prevent child abuse and neglect. The program adheres to a set of research-based critical elements that provide the benchmark to establish accreditation from the national office. The Healthy Families program in Arizona has been accredited and in operation for over 23 years.
Healthy Families Arizona works with prenatal and new parents to provide a range of services and supports. Families agree to participate and receive home visiting services after being screened in the hospital and meeting cutoff scores that identify families at risk who can benefit from services. After establishing a trusting relationship, the home visitor assists in helping parents with their life circumstances, personal issues, parenting needs, and successful adaptation to new infants. Home visitors are also available to help mobilize critical services to address substance abuse, domestic violence, and mental health issues. They attempt to model good parenting behavior, review the child’s developmental progress, ensure safety in the home, secure a “medical home” for the child, and provide emotional support to the parents, as they adapt to the changing circumstances of their home life. A critical part of the program is the parent education component based on the use of a specific curriculum, Growing Great Kids (Elliot & Flanagan, 2004). The program takes a multifaceted perspective in helping families by increasing knowledge of child development and teaching parenting skills, promoting infant–parent bonding, building important relationships with fathers, support figures, and other family members, and building responsive networks through linkage with additional community resources. Additional details regarding the program model can be found at the HFA website (http://www.healthyfamiliesamerica.org).
Method
Participants
Participant families were recruited from local hospitals. Prior to enrollment, participants were explained the nature of the research study and told that with their consent to participate, they would be randomly assigned to either an intervention group that included home visits or a child development group that included parent and child assessments. Participants were included in the study on the basis of risk assessment. A hospital screen involved identification of risk factors present including such factors as low income or being a single parent. Two or more risk factors indicate a positive screen. A second-tier risk screen was conducted using the Parent Survey based on the Kempe Family Stress Checklist (Prevent Child Abuse America, 2000), which is a semistructured interview that asks about stress, parents’ childhood history, potential for violence, stressors, parents’ expectations, and other areas. Participants who scored 25 or higher on this measure were eligible for the services. The interview is completed and scored, and a risk threshold must be met to continue to meet criteria for program inclusion. These are the same screening and assessment procedures that are used for eligibility into the Healthy Families program. The study took place in Arizona from 2010 to 2014 and covered mostly urban and some rural settings. The study was primarily located in Tucson, a medium size urban city, but also included services in smaller outlying towns and cities in southern Arizona.
Randomization
This study employed a randomized, intent-to-treat design that examines short-term outcomes from program participation. Families were randomized into the treatment or control group by research staff using random number procedures and group status was blind to data collection staff. By design, more families were assigned to the control group than the intervention group. This was done because enrollment into the treatment group depended on available slots from the program but enrollment in the control group did not, therefore randomization switched to a 2:1 randomization in order to increase the power of the experiment (Dumville, Hahn, Miles, & Torgerson, 2006). Those families assigned to the Healthy Families treatment group received the normal course of services available from the Healthy Families Arizona program and those assigned to the “Child Development Group” received assessment information about their child’s developmental progress and referrals as needed. The latter group constituted the control group. This design was deemed the minimal level of information that would still be valuable enough for participants to agree to participate in the study. To increase the likelihood of participation in the study and to reduce differential attrition from the control group, a minimal level of services were provided. Offering a minimal level of intervention was also important for the program staff who were uncomfortable with families receiving no services when they were at risk and in need of assistance. The study protocol obtained institutional review board approval before the commencement of the study. Multiple outcome measures were selected to assess the program’s impact across four theoretical domains of interest including safety and resources, parenting attitudes and practices, health and maternal outcomes, and mental health and coping. Some measures were administered at baseline and 6 months, parenting measures were administered only at the 6-month follow-up period.
Participant recruitment took place in several hospitals in the maternity ward. A total of 2,426 individuals constituted the recruitment population, of these 1,430 were not eligible (see consort diagram), 120 were eligible but not participating, and 631 were not available to randomize into the study.
A total of 245 participants were invited into the study and randomized. As noted in Figure 1, participants were not recruited if they were out of state, not present when recruitment staff visited, were discharged from the hospital, or expressed no interest in participating in the study. A total of 245 families met study criteria for inclusion and signed informed consent agreements. The total sample included in this study for analysis was 245 families randomized at baseline (147 control and 98 experimental); of this total, 100% completed baseline interviews. At the 6-month assessment; 79 (81%) were retained in the Healthy Families condition and 120 (82%) were retained in the control condition. Participants received US$20.00 incentives at baseline and at the 6-month follow-up assessment.

Consort diagram for participant flow.
Data Collection and Measurement
In order to examine a comprehensive set of outcomes for this study, four domains of interest were identified: safety and use of resources, parenting attitudes and practices, health and maternal outcomes, and mental health and coping. In each domain, primary outcomes were selected for the measurement model. Measurement burden was of particular concern in this study that included families with poor reading capacity and limited experience with research protocols. In order to maximize the data collection, some measures were collected at baseline and follow-up time points, and other measures were collected only at follow-up periods. The parenting outcomes were examined at the 6-month assessment after childbirth. This strategy allowed for a larger number of outcome variables with reduced burden to the families.
Safety and use of resources
A primary outcome measure is home safety. This measure is a compilation of safety practices in the home. Items include covering electrical outlets, locked poisons, use of car seats, and poison control. The safety scale had a low reliability α = .48 primarily because it is a composite index. Based on results from a previous study (LeCroy & Krysik, 2011), we determined that use of resources was an important outcome for a home visitation program. To investigate this, we examined the use of resources by determining what specific resources parents accessed (e.g., food stamps, mental health counseling, and general education development [GED] classes) and we included a separate scale that measured parents’ capacity to mobilize resources to meet their needs. A sample item from the mobilizing resources scale is “I know where to find important medical information” rated on a Likert-type scale.
Parenting attitudes and practices
Subscales from the Healthy Families Parenting Inventory (HFPI) were used to examine parenting attitudes and practices. The four HFPI parenting subscales which were found reliable were home environment (.85), role satisfaction (.85), parent/child behavior (.85), and parenting efficacy (.88). Examples of items from the HFPI include “I have a hard time managing my child” and “when my child is upset, I’m not sure what to do.” The HFPI uses Likert-type scaled items. Additional parenting measures included use of regular routines and reduced chaotic household. Because of the program’s emphasis on school readiness, we also examined the frequency that parents reported reading to the child.
Health and maternal outcomes
We investigated three primary health outcomes: initiated breast feeding, immunizations, and well-baby visits. Maternal outcomes included measures of use of contraception (to promote birth spacing), subsequent pregnancies, job training or employment, and substance abuse treatment. These outcomes were measured by single item dichotomous questions or a simple count of the frequency of the different behaviors.
Mental health and coping
The primary outcome for mental health was the Rand Mental Health Index (Ware & Sherbourne, 1992) which includes four subscales: General Positive Affect, Anxiety, Loss of Control, and Depression. The Mental Health Index was used as a single score based on all the items and designed as a summary index of the person’s mental health status. A sample item is “during the past month, how much of the time have you felt tense or “high-strung”?” scored from all of the time to none of the time on a 6-point scale. High scores on the Mental Health Index indicate greater psychological well-being and relatively less psychological distress. The reliability for this measure was α = .91.
Four subscales from the HFPI were used to assess different aspects of mental health: Depression, Social Support, Problem-Solving, and Personal Care. The reliabilities were α = .84, α = .87, α = .87, and α = .80, respectively. The HFPI subscales focus on mental health, as it relates to parenting. We included the HFPI depression measure, given the recent focus on depression and home visitation (Ammerman, et al., 2010, 2013; Golden, Hawkins, & Beardslee, 2011). Social support is often considered an important outcome with home visitation programs, problem-solving reflects parents’ capacity to respond to situational difficulties, and the personal care measures how much the respondent focuses on taking care of their own needs which might lead to better care for the child. Examples of items from these subscales include: “I feel supported by others” and “I feel unhappy about everything.”
Implementation
The Healthy Families model of home visitation includes a complex set of policies and procedures. Implementation and fidelity are primarily assessed through the ongoing process of training and accreditation that is conducted by HFA (2016). To evaluate consistent implementation, the program goes through a credentialing process where program material is reviewed, case files examined, and program staff interviewed. The program considers the credentialing review as a measure of program fidelity. Research staff also observed trainings, conducted staff surveys, reviewed policy, and procedure manuals to understand how implementation might impact quality of home visitor services.
Qualitative Data Collection
Research (see Pennebaker, 2011b) has found that the words people use reflect their feelings and that counting the words can provide information about their psychological processes. The basic idea is that by counting words one can gain insight into an individual’s emotional states and functioning (see Pennebaker, 2011b). Previous research has found that the more people used positive emotions, the more their mental health improved (Pennebaker, Mayne, & Francis, 1997). Studies (Rude, Gortner, & Pennebaker, 2004) also found that the linguistic software was able to differentiate between currently depressed, formerly depressed, and never depressed subjects by examining the words participants used suggesting the validity of using word analysis in assessing individuals functioning.
Using the linguistic inquiry and word count (LIWC) computer software
The qualitative analyses were conducted using LIWC2007, a linguistic text program, to study whether parents in the treatment group would use different words when describing their children (Pennebaker, Booth, & Francis, 2007; Pennebaker, Chung, Ireland, Gonzales, & Booth, 2007). We studied the words parents used in their descriptions. All statements were transcribed into text files and the linguistic program was used to provide frequencies of positive and negative emotion words as well as cognitive mechanism words. The software examines word use and contains positive and negative word dictionaries (see Pennebaker, 2011b, for details). Furthermore, there is a cognitive mechanism dictionary that was used to measure the use of words that designate insight and causation. This complex software is based on extensive word dictionaries specifically designed to capture psychological processes.
We examined the linguistic patterns of parents in the treatment and control groups. The Healthy Families program focuses on helping parents learn how to interact differently with their children, how to become more attached, and how they perceive their role as parents. Participants in the study were asked to describe their child and to talk about what they have discovered about their child. Responses made by the parents were recorded and entered into the LIWC program. By examining data at this level, we hoped to understand how parents perceived their children and reveal more about their parenting experiences. Based on previous research (Pennebaker, 2011b), we hypothesized that parents in the treatment group, when talking about their children, would talk more about the present and future, less about the past, use first person pronouns, talk in more positive emotional terms, talk in less negative emotional terms, show less anxiety, anger and sadness and demonstrate greater cognitive mechanisms including the use of insight, understanding cause, and expressing certainty and confidence. These were a priori categories selected by the researchers as the most likely factors to provide meaningful differentiation between the two groups.
Data Analysis Plan
The results of this study are based on an intent-to-treat analysis of the data. Intent-to-treat analysis includes all subjects who are randomized in the experiment. Even families who decide not to continue after a first home visit are included in the treatment group for analysis. It eliminates overoptimistic estimates of the efficacy of the treatment which can result from removal of participants who do not engage in the treatment. The two groups (Healthy Families treatment group and Child Development control group) were tested for baseline comparability using t-tests and χ2 statistics. Data analysis was conducted using SAS 9.4 software to generate descriptive statistics, and χ2 tests of independence. Statistical analysis was assessed using analysis of variance and regression models to assess impact on outcomes. Program attrition remains an important consideration in home visitation, and we examined whether program dosage was related to program outcomes.
Evaluations of home visitation programs have used a multitude of outcomes, with results that may vary based on the outcome measures chosen by the study investigators. We intentionally collected a broad array of outcomes, with the intention of identifying the boundaries of potential program effects. The dependent measures were treated as independent measures and considered conceptually independent (Huberty & Morris, 1989); however, measures that were highly correlated with other measures were not included. Since the total N for this study is no larger than 245, it is an underpowered experiment. A recent review of home visitation (Filene, 2012) estimated the average effect size to be .15 which would require 400 subjects in each group to detect an effect this small. In light of these considerations, we report statistical significance or meaningful outcomes as either a p < .10 or an effect size of .20, recognizing that effect sizes are less sensitive to small N problems (Rosenthal, Rosnow, & Rubin, 2000). Further, reporting nonsignificant p values with small effect sizes, for example, d = .20 allows interpretation of the p value with its associated effect size as recommended by Rosenthal, Rosnow, and Rubin, (2000). It is recognized that this study includes a large number of outcome indicators. We have examined correlations, established primary measures, and in some instances combined measures to reduce the overall number of tests being performed on the data.
Results
Table 1 presents information on the background characteristics of the participants in the experimental and control groups. As the table shows the groups had similar baseline equivalence and there were no significant differences between the groups. Both groups reported a high school graduation or a GED (58% both groups), emotional abuse was reported by 22.7% of the treatment group and 25.7% of the control group, and past involvement with child protective services (CPS) included 12.3% (treatment group) and 14.1% (control). These indicators suggest baseline equivalence and show that the program was targeting a group of families that could be considered at risk for child abuse and neglect.
Baseline Comparisons of the Healthy Families and Control Groups.
Note. CPS = child protective services; NS = not significant; AHCCCS is the state of Arizona Medicaid program.
Table 2 presents key outcome measures across four different domains including safety and resources, parenting attitudes and practices, mental health and coping, and maternal outcomes. In each of the major domains, there was a significant outcome for the Healthy Families Arizona experimental group in contrast to the control group. In the safety and resources domain, outcomes at 6 months showed the Healthy Families experimental group had implemented more safety practices in the home (p = .05, d = .24), used more resources to meet family needs (p = .10, d = .24), and scored higher on mobilizing resources (p = .007, d = .43).
Comparison of Outcome Measures by Group.
aDifference favored the control group.
*p < .10. **Meaningful effect size of d ≥ .20.
With regard to parenting attitudes and practices, four outcomes favored the Healthy Families condition including quality of the home environment (p = .003, d = .47), regular routines (p = .02, d = 36), reduced chaotic household (p = .04, d = .29), and reading to the child (p = .03; d = .31). Positive parent/child behavior was not significant but obtained a meaningful effect size (p = .13, d = .24). Two measures showed no difference between the two groups (role satisfaction and parent efficacy). Role satisfaction favored the control group over the Healthy Families experimental condition (p = .06, d = .32).
Results for the health and maternal outcomes domain found Healthy Families participants had higher rates of breast feeding (p = .04, d = .29) and greater contraception use (p = .14, d = .21). There were no differences between the two groups on immunizations, well-baby checks, subsequent pregnancy, job training, or employment, and substance abuse treatment.
Mental health and coping measures found two positive outcomes for the Healthy Families participants in comparison to the control condition, the Mental Health Index (p = .02, d = .35) was higher in the Healthy Families group. Problem-solving did not show a significant difference but obtained an effect size that favored the Healthy Families group (p = .20, d = .20). There were no significant between-group differences on depression, social support, or personal care.
An examination of program dosage revealed several significant findings. Dosage was measured as the total number of home visits received. Families who received more home visits showed significantly better improvement on the following outcomes: social support (t = 2.27, p = .03), depression (t = 2.29, p = .03), role satisfaction (t = 2.07, p = .04), problem-solving (t = 1.79, p = .08), breast-feeding (t = 1.71, p = .09), and Mental Health Index (t = 2.72, p = .01). Trends showing a relationship between program dosage and outcomes were evident for parental efficacy (t = 1.49, p = .14).
Qualitative Results
Results revealed many significant differences in linguistic categories between the treatment and control group (see Table 3). In particular, at the 6-month comparisons, 11 comparisons showed significance, all of which favored the Healthy Families treatment group. The Healthy Families group expressed more positive emotions (p = .02, d = .37), less negative emotions (p = .08, d = .29), less sadness (p = .01, d = .42), showed more feeling expressions (p = .002, d = .50), had enhanced cognitive mechanisms (p = .007, d = .44), and greater insight (p = .05, d = .33).
Means, Standard Deviations, Significance, and Effect sizes for Linguistic Dimensions for the Treatment and Control Groups: Linguistic Analysis of Treatment and Control Group at 6 months.
*significant α, p < .10. **meaningful effect size of d > .20.
Discussion
This study found positive short-term effects for the Healthy Families group across a variety of domains. The program evaluated is accredited and has been in operation for over 23 years; therefore, implementation of the program is likely to be more consistent and effective than in the past or compared to other programs. The broader range of outcome indicators and the qualitative assessment have also contributed to the findings, as past studies have been limited to a more narrow range of measures.
The strongest program effects were in the areas of safety, parenting practices, the home environment, and mobilization of resources. The safety practices are an important outcome indicator, because unintentional injuries are a leading cause of child death (Deal, Gomby, Zippiroli, & Behrman, 2000). The safety scale had low reliability but when we examined individual items we also found significant differences between the Healthy Families and control group.
Knowing how to use resources may be an important skill for families that face multiple difficulties, as Krysik, LeCroy, and Ashford (2008) note, participation in home visitation may, “provide a positive experience for families that will promote future involvement with other social service programs when families need help in the future” (p. 59).
Outcomes were also observed in the parenting attitudes and behavior domain. The scales of parenting competence, parent/child behavior, and overall home environment all showed positive program effects. The home environment had the largest effect size and is considered a good indicator of the program’s effort to increase the quality of the environment is a manner that promotes positive child development.
There were important findings in the health domain. Particularly important was the finding that Healthy Families mothers reported greater breast feeding than control mothers. This could add significantly to the long-term health impact for the infants. Studies have consistently found that breast milk can improve a baby’s health, lower childhood obesity, decrease asthma, and promote better brain development (Horta & Victora, 2013). Furthermore, no breastfeeding may put women at higher risk for breast and ovarian cancer, diabetes, cardiovascular disease, and other health conditions (Harmon, 2010). Although the results were positive, they were quite modest and programs should target breast-feeding, given the significant benefits. There was a modest impact on use of contraception. This outcome can reap important health benefits, as birth spacing is strongly related to positive health status and child abuse and neglect (Conde-Agudelo, Rosas-Bermudez, Castano, & Norton, 2012; Zuravin, 1988).
The two measures of more routine health status—immunizations, and well-baby visits did not show any program effects. The outcomes for immunizations may be different at the 12-month period than at 6 months when the families are still more strongly connected with health care. The well-baby visits show that both the Healthy Families and the control group are seeking similar health care for their children.
With regard to mental health, the study found a strong effect on the Mental Health Index which measures both psychological distress and psychological well-being. This was the most comprehensive measure of mental health used in the study. Three additional measures in the mental health domain did not show a difference between the Healthy Families and control group: depression, social support, and personal care. However, when we examined the relationship between dosage and outcomes, both the depression scale and the social support scale showed an effect for the Healthy Families group. Personal care and social support are similar concepts, and although home visitation programs provide additional support from the home visitor, the parent may continue to feel a sense of loneliness and have less focus on personal care as a result of her new role as a mother.
McCall and Green (2004) noted the need to augment experimental evaluations with other qualitative methods in the evaluation of home visiting programs. Azzi-Lessing (2011) reviewed home visiting programs and recommended that “qualitative evaluation methods should be employed to capture the experiences and responses of families” (p. 394). The present study adds a new qualitative element to the experimental design that provided robust differences between the intervention and control groups. Furthermore, the results suggest that the program may work in ways not previously expected since intervention families developed a different language or narrative in describing their approach to parenting.
The Growing Great Kids curriculum, used with the majority of the parents in the program, focuses on “cues and communication” teaching parents to accentuate the positive, calls attention to positive process in the relationship, and teaches the steps of building a more positive family environment suggesting words and strategies to accomplish this. As parents construct a different story of who they are as parents, it is likely that their language and corresponding psychological processes change. The research on linguistic analysis has found when people change their perspective in how they talk they tend to function in a more healthy way. For example, the more people use first person pronouns compared to other pronouns, the better their health was (Moore & Brody, 2009; Pennebaker, 2011a; Pennebaker et al., 1997). Rude, Gortner, and Pennebaker (2004) found linguistic differences between depressed and nondepressed individuals, whereby depressed individuals used more negative emotion words and fewer positive emotion words. The qualitative linguistic analysis from this study adds a new dimension in understanding the impact of home visitation services and coupled with the impacts found on the self-report measures adds additional evidence that the program is having an impact on parents.
This study is limited due to the small number of participants. Another consideration in the interpretation of the results is that the control group did not receive services, but they did get ongoing child development assessments, referral information as needed, and had a consistent, caring research assistant who asked them about their child and family life—all actions which diminished the difference between the active treatment and the control condition. The results presented in this study are limited to short-term follow-up period and we do not know if these results will persist at longer follow-up time points. The linguistic analysis is a new qualitative method and it will be important to determine whether other researchers can replicate our findings in this regard.
Research on home visitation continues to evolve. Prevention research of this nature is complex due to measurement difficulties, control group limitations, engagement and retention issues, and the diverse recipients of the services. Continued research must grapple with how to best design studies and measure outcomes on widely diverse programs that service a diverse group of participants. Examining a broader range of potential outcomes may add new understandings to the potential program impact of home visitation programs.
Footnotes
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was funded by Rigorous Evaluation of Existing Child Abuse Prevention Programs, Children’s Bureau. Award: 90CA178.
