Abstract
This study examined the longitudinal stability and dynamics of group membership within the Greenspoon and Sakflofske’s dual-factor model of mental health. This expanded model incorporates information about subjective well-being (SWB), in addition to psychopathological symptoms, to better identify the mental health status and current functioning of youths. Participants included 730 seventh- and eighth-grade U.S. middle school students. Four groups of students were identified: flourishing (i.e., high SWB and low psychopathology), vulnerable (i.e., low SWB and low psychopathology), symptomatic but content (i.e., high SWB and high psychopathology), and troubled (i.e., low SWB and high psychopathology). Analyses of stability of group membership revealed varying levels of stability, with flourishing students demonstrating the highest stability. Analyses also revealed that social support variables yielded meaningful predictions of changes in group membership. Implications for professional practice are discussed.
Psychologists and educators have traditionally relied on a unidimensional, deficit-focused approach to practice, in which mental health is conceptualized as the absence of psychopathological symptoms (Keyes, 2005). As a result, professional practices are organized around identification and amelioration of psychological symptoms with little regard for positive psychological factors (e.g., character strengths, subjective well-being) that may constitute or promote optimal levels of mental health. Positive psychologists have argued that the absence of symptoms is not an adequate definition of mental health; rather, it must include the presence of positive psychological characteristics (Seligman & Csikszentmihalyi, 2000).
Subjective well-being (SWB) is a key construct in positive psychology comprised of three major components: life satisfaction, positive affect, and negative affect (Diener, 1984). Life satisfaction is defined as a person’s cognitive appraisal of the positivity of her or his life overall based on her or his unique standards. Positive affect refers to the frequency of positive emotions (e.g., joy, excitement, affection) experienced by an individual. Conversely, negative affect represents how often an individual experiences negative emotions (e.g., anxiety, sadness). Research has demonstrated the utility of SWB assessment as an indicator and determinant of positive aspects of mental health (Proctor, Linley, & Maltby, 2009)
Research has supported positive and negative well-being as distinct constructs (Huppert, 2009). Based on such distinctions, a multidimensional, dual-factor model (DFM) of mental health was proposed by Greenspoon and Saklofske (2001) to integrate assessments of SWB and psychopathology. From a sample of 407 Canadian elementary students, Greenspoon and Saklofske (2001) identified four distinct groups varying in mental health. Using the nomenclature of Antaramian, Huebner, Hills, and Valois (2010), the first group was identified as having positive mental health, with high SWB scores and low psychopathology scores. A second group was characterized as troubled children, with low SWB and high psychopathology. The third group, labelled as vulnerable, demonstrated low levels of psychopathology with low SWB. The fourth group, labelled symptomatic but content, reported high SWB, despite high psychopathology. The latter two groups do not neatly fit into the traditional, unidimensional model of mental health; in fact, Groups 3 and 4 would not have been identified via traditional assessments. Greenspoon and Saklofske (2001) further identified a variety of psychosocial variables that differentiated the groups. Additionally, Lyons, Huebner, Hills, and Shinkareva (2012) also found that parent social support was a significant determinant of group membership in a sample of U.S. secondary students.
Suldo and Shaffer (2008) subsequently evaluated the DFM by classifying U.S. middle school students into the four groups and investigating differences in educational, social, and health-related presumed “outcomes.” Most notably, students with the highest mental health had higher reading achievement, academic self-perceptions, greater motivation and valuing of school, fewer social problems and school absences, and better parent and peer relationships than vulnerable students (i.e., low SWB, low psychopathology).
Antaramian and colleagues (2010) further investigated the DFM. As expected, middle school (U.S.) students with positive mental health consistently demonstrated higher school grades and higher levels of behavioural, cognitive, and emotional engagement, when compared to vulnerable students. Also, the two groups with high SWB had significantly more social support (i.e., parent, teacher, and peer) for learning compared to the groups with low SWB, despite comparable levels of psychopathology.
The aforementioned research suggests that the DFM provides a more comprehensive understanding of students’ well-being relative to traditional unidimensional models. To date, research has been limited to cross-sectional designs. Although useful in early research, cross-sectional approaches do not account for temporal processes or causal mechanisms. Thus this study used a short-term longitudinal design to assess the stability and predictors of DFM group membership. Students were categorized into one of four DFM groups across two different time periods, 5 months apart. Drawn from Lent’s (2004) integrative model of SWB, four social support variables (i.e., teacher–student relationships, family support for learning, and peer support for learning, seeking social support) were evaluated as predictors of group membership. Hence, this study further investigated the utility of the DFM in youth by determining (a) the longitudinal stability of group membership and (b) whether social support variables predicted changes in group membership.
Method
Participants
A total of 730 seventh and eighth graders (ages 11 to 15, 51% female) participated in a two-wave assessment of school climate and student well-being (T1, fall 2008; T2, spring 2009). These data have been used in prior research (e.g., Antaramian et al., 2010); however, these analyses are new. The students were from one middle school in the Southeastern United States. Of the participants, 27% were African American, 4% were Asian, 60% were White, 2% were Hispanic and 7% reported themselves as “other.” Additionally, 21% received free or reduced-cost lunch at school, suggesting lower socioeconomic status (SES).
Measures
Subjective well-being—life satisfaction
Life satisfaction was assessed using the Students’ Life Satisfaction Scale (SLSS; Huebner, 1991), a self-report scale composed of seven items that reflect general statements about one’s life (e.g., “My life is going well”). Students rated their agreement with each item on a 6-point scale, ranging from strongly disagree to strongly agree. The SLSS has been used in numerous studies, and research has provided evidence of its reliability and validity (Huebner & Hills, in press).
Subjective well-being—positive and negative affect
Positive and negative affect were assessed using the Positive Affect and Negative Affect Scale for Children (PANAS-C; Laurent et al., 1999). It is a 27-item scale comprised of two subscales: Positive Affect and Negative Affect. The Positive Affect subscale consists of 12 descriptors, such as happy, lively, and proud. The Negative Affect subscale includes 15 descriptor items, such as gloomy, mad, and afraid. Children respond to items using a 5-point scale from very little or not at all to extremely or all the time during the past few weeks. For the purposes of the larger survey from which these data were drawn, the instructions of the PANAS-C were modified to request students to report on their positive and negative affect in the school setting. The PANAS-C has been widely used in research, and there is evidence supporting its reliability and validity (Huebner & Hills, in press).
Psychopathology
Psychopathology was assessed using the Self-Report Coping Scale (SRCS; Causey & Dubow, 1992), a 34-item measure that assesses the use of five different coping strategies in a socially stressful situation. The Internalizing and Externalizing subscales were used in this study to measure psychopathological symptoms. The Internalizing subscale includes seven items, such as “Worry that others will think badly of me” and “Become so upset that I can’t talk to anyone.” The Externalizing subscale is composed of four items, such as “Curse out loud” and “Take it out on others because I feel sad or angry.” Students reported how often they engaged in each behaviour on a 5-point scale ranging from never to always. Studies indicate sound psychometric properties of the SRCS (Causey & Dubow, 1992; Roecker-Phelps, 2001).
Social support—seeking social support
An additional subscale of the SRCS was used to assess how often students’ rely on social support from teachers, family, and friends as a coping strategy. The Seeking Social Support subscale is composed of 8 items, such as “Tell a friend or family member what happened” and “Talk to somebody about how it made me feel.” Students reported how often they sought out social support in response to a stressful event by rating the items on a 5-point scale ranging from never to always.
Social support—environmental context
Students’ environmental context was measured using three subscales from the Student Engagement Instrument (SEI; Appleton, Christenson, Kim, & Reschly, 2006), a 35-item self-report scale. The Family Support for Learning subscale includes four items that assess family involvement in school (e.g., “When I have problems at school, my family/guardians are willing to help me”). The Teacher–Student Relationships subscale is composed of nine items that describe positive relationships with adults at school (e.g., “My teachers are there for me when I need them”). The Peer Support for Learning subscale includes six items reflecting good peer relations at school (e.g., “Other students at school care about me”). Responses to all three scales are indicated on a 4-point scale ranging from strongly agree to strongly disagree. Evidence of reliability and validity has been provided in several sources (e.g., Appleton et al., 2006; Reschly, Huebner, Appleton, & Antaramian, 2008).
Procedure
The study involved analyses of archival data collected in an in-house survey of school climate and students’ well-being. A total of 11 (1%) declined participation. Surveys were administered by teachers during homeroom in October 2008 and March 2009. Eighty-four participants were removed because of excessive missing data (> 25% of items per scale), yielding a final total sample of 730. Analyses of the relevant study variables revealed no statistically significant differences between the students removed from the database and the remaining sample.
Data Analysis
DFM classification
Consistent with past research, levels of SWB using Diener’s tripartite model (1984) were identified, including the three constructs of positive affect, negative affect, and life satisfaction. A SWB score was calculated based on the same formula used in previous research; that is, composite scores were calculated based on life satisfaction and positive and negative affect standardized scores (Antaramian et al., 2010; Suldo & Shaffer, 2008). Specifically, we standardized the SLSS and PANAS-C scores, summed the life satisfaction and positive affect scores, and subtracted negative affect scores.
Participants were classified as having either moderate-to-high SWB or low SWB based on widely used interpretation guidelines (Reynolds & Kamphaus, 2004). Students with a T score of 40 or lower were considered to have low SWB, whereas those with a T score higher than 40 were classified as having moderate-to-high SWB.
To determine DFM status, participants were first classified according to their level of psychopathology, measured by SCRS scores. Again, based on commonly used guidelines (Reynolds & Kamphaus, 2004), participants were classified as having high psychopathology if they had a T score of 60 or higher on Internalizing, Externalizing, or both scales. Students DFM’ group affiliation was then determined by pairing dichotomized levels of SWB and psychopathology using these decision points.
Results
Descriptive Analysis and Intercorrelations
Descriptive statistics are reported in Table 1. Mean scores on the SWB variables were comparable to those found in prior studies (Haranin, Huebner, & Suldo, 2007; Reschly et al., 2008). Means on the internalizing and externalizing variables were also consistent with those from prior research (Causey & Dubow, 1992).
Descriptive Statistics, Intercorrelations, and Coefficient Alphas at Time 1 and Time 2
Note: N = 730. Bold = coefficient alpha.
p < .05. ***p < .005.
Descriptive statistics were used to examine distributional properties. Skew and kurtosis were evaluated using rules of thumb provided by Tabachnick and Fidell (2007). Specifically, absolute values of skew below 2 and kurtosis below 3 were not regarded as severe deviations. Based on these criteria, one outcome variable (i.e., family support for learning) was leptokurtic (K = 3.4). Because this variable was only slightly leptokurtic, and because the statistical models used to analyze the data are generally robust to distributional violations, the variables were not transformed to preserve integrity of interpretation.
Coefficient alphas were subsequently calculated; all exceeded .70 (Table 1). Test-retest coefficients were also calculated and were as follows: global life satisfaction (.64), positive affect (.57), negative affect (.49), externalizing behaviour (.59), internalizing behaviour (.49), family support for learning (.60), teacher–student relationships (.62), peer support for learning (.59), and seeking social support (.59).
DFM Classification
Participants were classified into DFM groups based on levels of SWB and psychopathology. These groups will be referred to using Suldo and Shaffer’s (2008) nomenclature with the exception of the “complete mental health” group, which will be referred to as “flourishing.” Tables 2 and 3 show the distributions of participants. The flourishing group had average to high levels of SWB and low levels of psychopathological symptoms. With 466 participants, the flourishing group was the largest of the groups, comprising 64% of the sample. The vulnerable group included 59 adolescents who not only had low levels of psychopathology but also had low SWB; they comprised 8% of the sample. Approximately 20% of the participants were classified into the third group, labelled as symptomatic but content. These adolescents had average-to-high SWB; in spite of also having high psychopathology. Finally, 57 adolescents were in the troubled group, comprising 8% of the sample.
Mental Health Status Groups Yielded From a Dual-Factor Model With Predictor Descriptive Statistics at Time 1
Mental Health Status Groups Yielded From a Dual-Factor Model With Predictor Descriptive Statistics at Time 2
Demographic characteristics of the groups and total sample were analyzed. Chi-square tests were conducted to determine if demographic variables were differentially represented in the four groups. Results indicated nonsignificant differences for gender, ethnicity, SES, grade, and age.
Stability and Dynamics of DFM Groups
To assess the stability of group membership, participants were reclassified according to DFM status 5 months later. To assess the dynamics of group membership, participants were further categorized into 12 additional subgroups of group change (Table 4). A total of 85% of the flourishing group continued their membership at Time 2, demonstrating the highest stability of the DFM groups. The vulnerable group demonstrated the lowest stability, with 29% remaining at Time 2. Most of these students moved to the flourishing group (46%). The symptomatic but content and troubled students demonstrated intermediate levels of stability, 42% and 47%, respectively.
Stability and Dynamics of DFM Group Affiliation
Note: Bold = group stability across Time 1 and Time 2.
Influence of Support Variables on Group Change
To assess the predictive qualities of support variables on group change, multiple logistic regression models were used for each DFM group in which dichotomous outcome variables (i.e., no change; change from one category to another category/categories) were predicted by four continuous support variables (i.e., family support for learning; teacher–student relationships; peer support for learning; seeking social support). In addition to these models, multiple logistic bivariate models were used to accommodate for any loss of power due to moderate multicollinearity and limited sample sizes; a remedial approach suggested by Cohen, Cohen, West, and Aiken (2003).
The first multiple logistic regression analysis determined which support variables predicted change in membership from flourishing at Time 1 to any of the other three groups at Time 2 (Table 5). One predictor (i.e., family support for learning) was significant (β = –.68, p < .05), and suggested that for every unit increase in family support for learning, the log odds of moving from the flourishing group decreased by .68. When bivariate regression models were used for individual predictors, teacher–student relationships, as well as family support for learning, were significant predictors of negative group change from the flourishing group (β = –.47, p < .05). The estimates can be converted to odds ratios by taking the natural log of the estimate. The odds ratios are interpreted as the corresponding odds of moving from the flourishing group to another group associated with a unit increase in the continuous predictor variable.
Predictors of Negative Change From the Flourishing Group to the Vulnerable, Symptomatic but Content or Troubled Group
Note: N = 70.
p < .05. ***p < .005.
The second multiple logistic regression analysis determined which support variables predicted change in membership from vulnerable at Time 1 to flourishing at Time 2 (Table 6). In this model, none of the values was significant. When bivariate regression models were used for individual predictors, the variables of teacher–student relationships (β = −1.53, p < .05), peer support for learning (β = 1.07, p < .05), family support for learning (β = 1.31, p < .05), and seeking social support (β = 1.18, p < .05) were all significant predictors of group change.
Predictors of Positive Change From the Vulnerable Group to the Flourishing Group
Note: N = 27.
p < .05. ***p < .005.
The third multiple logistic regression determined which support variables predicted a change in membership from vulnerable at Time 1 to symptomatic but content or troubled at Time 2 (Table 7). One predictor (i.e., teacher–student relationships) was significant (β = 2.34, p < .05), and suggested that for every unit increase in the teacher–student relationship variable at Time 1, the log odds of moving from the vulnerable group to the symptomatic but content group or the troubled group at Time 2 increased by 2.34. When bivariate regression models were used for individual predictors, teacher–student relationships (β = 2.08, p < .05) again was the only significant predictor.
Predictors of Negative Change From the Vulnerable Group to the Symptomatic but Content or Troubled Groups
Note: N = 15.
p < .05. ***p < .005.
The fourth multiple logistic regression determined which support variables predicted a change in membership from symptomatic but content at Time 1 to vulnerable or flourishing at Time 2 (Table 8). In this model, teacher–student relationships (β = .82, p < .05) and seeking social support (β = –.61, p < .05) were significant predictors, suggesting that (a) for every unit increase in the teacher–student relationships variable assessed at Time 1, the log odds of moving from the symptomatic but content group to one of the two higher functioning groups at Time 2 increased by 0.82, and (b) for every unit increase in the seeking social support variable at Time 1, the log odds of moving from the symptomatic but content group to one of the two higher functioning groups at Time 2 decreased by .61. When bivariate regression models were used, only the variable of teacher–student relationships (β = .53, p < .05) was significant.
Predictors of Positive Change From the Symptomatic but Content Group to the Vulnerable or Flourishing Groups
Note: N = 75.
p < .05. ***p < .005.
The fifth multiple logistic regression determined which support variables predicted a change in membership from symptomatic but content at Time 1 to troubled at Time 2 (Table 9). None of the values was significant.
Predictors of Negative Change From the Symptomatic but Content Group to the Troubled Group
Note: N = 10.
p < .05. ***p < .005.
The sixth multiple logistic regression determined which support variables predicted a change in membership from troubled at Time 1 to any of the other three groups at Time 2 (Table 10). One predictor (i.e., family support for learning) was significant (β = −1.10, p < .05), and suggested that for every unit increase in the family support for learning variable at Time 1, the log odds of moving from the troubled group to another group at Time 2 decreased by −1.10. When bivariate regression models were used, none of the predictors was significant.
Predictors of Positive Changes From Troubled Group to Flourishing, Symptomatic but Content or Vulnerable Groups
Note: N = 30.
p < .05. ***p < .005.
Discussion
The first aim of this study was to analyze the longitudinal stability of middle school students’ mental health status using Greenspoon and Saklofske’s (2001) DFM. Students were categorized into four mental health groups based on levels of SWB and psychopathology on two occasions, 5 months apart. The distribution across the four groups in this study was similar to previous research (Suldo & Shaffer, 2008). Findings also revealed that 85% of the students in the flourishing group remained in the flourishing group, 29% of the students in the vulnerable group remained in the vulnerable group, 42% of the students in symptomatic but content group remained in the symptomatic but content group, and 47% of the students in the troubled group remained in the troubled group. The vulnerable group demonstrated the lowest stability (29% remained at Time 2). Among the students with high psychopathology (troubled and symptomatic but content), those with high SWB were more likely to improve compared to those with low SWB, which provides support for SWB as a resiliency factor. This finding is consistent with that of a previous study, which found that SWB in the form of life satisfaction acted as a buffer against psychopathological behaviour (Suldo & Huebner, 2004). These results reveal further distinctions among the mental health groups and suggest that measures of SWB and psychopathology together better differentiate mental health than measures of psychopathology alone.
The second aim was to investigate whether social support variables predicted group changes. Among flourishing students, those students who had good relationships with teachers or received family support for learning were more likely to remain in the flourishing group. This finding is consistent with resiliency literature, which shows that mental health is nurtured by caring relationships with teachers and parents (Benard, 2006).
Among vulnerable students, those receiving greater social support for learning from family or peers and/or better teacher–student relationships at Time 1 were also more likely to move to the flourishing group. This suggests that positive social supports are especially beneficial for improving vulnerable students’ mental health. However, findings also showed that vulnerable students who had good teacher–student relationships were more likely to change to a group of lesser mental health at the 5-month follow up. This may be a spurious finding, or it may be an extraneous variable effect. For instance, past research has found that children who engage in informal help-seeking behaviour and have school-related problems are more likely to recognize a psychological problem and seek and receive professional help (John, Offord, Boyle, & Racine, 1995). Similarly, those vulnerable students who have good relationships with teachers may be more likely to seek help from their teachers when they recognize a problem; however, this is speculative at best. Follow-up assessments would be helpful to clarify the longer term outcomes for these students.
Among symptomatic but content students, those who had more positive relationships with their teachers were more likely to move to a higher functioning group. This finding is consistent with a prior variable-centered longitudinal study, which found that increasing teacher support for middle school students showed corresponding decreases in depressive symptoms and increases in self-esteem (Reddy, Rhodes, & Mulhall, 2003). Contrary to what might be expected, those who tended to seek out social support were less likely to make a positive change. This may be because students identified with a psychological disorder who engage in help-seeking behaviour are more likely to recognize their problems (Zwaanswijk, Verhaak, Bensing, Van der Ende, & Verhulst, 2003).
Among troubled students, those who received higher family support for learning were less likely to improve in mental health. This finding could suggest that these students do not benefit from family social support for learning, that family support for learning is insufficient as a protective factor in isolation, or that a statistical anomaly (e.g., suppression effect) has occurred. Again, future research is needed to clarify this finding.
Research Limitations and Future Directions
This study had several major limitations. First, all data were obtained from students from a single school, limiting generalizability. Second, all data were self-report, increasing method variance. Third, multiple logistic bivariate models were used to accommodate for small sample sizes in some groups. This analysis not only increases the likelihood of Type I error but also helps discern weaker signals for areas of future interest. Because this was an exploratory study, incurring a Type I error was preferred to a Type II error (Cohen et al., 2003). Still, results of the multiple logistic bivariate models should be interpreted cautiously.
This study also reflected strengths. First, this study used a two-wave longitudinal design to better identify predictors of mental health and to provide a novel understanding of the stability and dynamics of group membership. Second, this study identified four social support variables that were predictive of group change, illuminating areas of possible future research and practice applications.
However, future directions for research should be considered. One major recommendation is for longitudinal studies using larger samples across more frequent occasions. Such studies are needed to untangle the shorter term and longer term antecedents and consequences of group membership. A second major recommendation is that future researchers would likely benefit from including a broader array of individual difference and environmental variables to capture more fully the dynamics of changes in group membership for children of varying ages, gender, and backgrounds.
The findings from this study along with previous studies support the usefulness of more comprehensive psychological assessments, which incorporate positive psychology data, such as SWB. Mental health models (e.g., DFM), which conceptualize mental health as more than the absence of psychopathology, provide more nuanced information, leading to a more complete understanding of students’ functioning (e.g., identification of vulnerable vs. flourishing students) and ultimately should lead to more sophisticated efforts to prevent problems and promote optimal mental health.
Footnotes
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The research was supported in part by a grant from the South Carolina Association of School Psychologists.
