Abstract
As the first in their families to attend college, first-generation students plausibly experience family achievement guilt—socioemotional distress related to “leaving family members” to attend college. Family achievement guilt is little studied but a promising indicator of student outcomes. The present work used psychometric methods to develop the family achievement guilt scale. First-generation (46.6%) and continuing-generation (i.e., at least one parent has a 4-year degree, 53.4%) students completed a 41-item guilt measure online. Exploratory factor analysis revealed four factors, including guilt related to Leaving Family Behind, Having More Privileges, Becoming Different, and Experiencing Pressures about not being successful. The scale yielded good internal and test–retest reliability. Moreover, guilt predicted greater engagement in family roles and interdependent motives for college, even after controlling for general negative affect. In measuring guilt in psychometrically sound ways, we validate the voices of first-generation college students and alert institutions to adjust how they serve students.
As the first in their families to attend college, first-generation college (FGC) students confront cultural discrepancies between life in their working-class homes and middle-to-upper class college campuses (Lubrano, 2003; Stephens et al., 2012; Vasquez-Salgado et al., 2015). When FGC students transition to college, they may experience family achievement guilt—a socioemotional experience students might have due to “leaving family members behind” to study in a cultural setting that has historically reflected norms of middle-to-upper class, White families (Covarrubias & Fryberg, 2015; Davidson, 2017). FGC students may feel the lifestyle afforded to them by college grants privileges that are denied to equally deserving family members who have not graduated from a 4-year institution and compromises their ability to continue to contribute to their family (Covarrubias et al., 2019; Vasquez-Salgado et al., 2015). In this sense, leaving family behind is the feeling of starting on a path of upward social and economic mobility not readily available to family members.
There is some promising but limited evidence that FGC students experience family achievement guilt more than continuing-generation college (CGC) students (i.e., at least one parent with a 4-year degree; Covarrubias & Fryberg, 2015). Family achievement guilt among FGC populations negatively relates to students’ mental well-being (Covarrubias et al., 2015) and is theorized to relate negatively with academic performance (Piorkowski, 1983). This is of particular importance given rising concern about the mental health challenges of college students nationwide (Mistler et al., 2012), especially given that FGC students are a fast-growing demographic group in higher education (Redford & Hoyer, 2017). Given the strong link between mental health and student outcomes (e.g., belonging, grades; Pittman & Richmond, 2008), knowing more about family achievement guilt might help programs charged with increasing FGC retention and graduation rates. Although prior work in measuring family achievement guilt has produced some promising findings, these remain limited and tentative in the absence of a more psychometrically robust measure. The present work used psychometric methods to develop a reliable and valid measure of the family achievement guilt construct.
Guilt Research and Measurement Challenges
The concept of family achievement guilt (Covarrubias & Fryberg, 2015) builds on a brief theoretical review of a particular form of guilt experienced by low-income, Black FGC students (Piorkowski, 1983). Drawing from a small sample of counseling sessions, Piorkowski theorized that these students experience survivor guilt when they witness close others in their lives endure trauma (death, abuse) and stress (unemployment) which they themselves have escaped by attending college. She reported one Black adult male describing guilt because he had been working on a college degree when he lost his brother in a drug-related crime. As a result of this guilt, students reported experiencing depressive symptoms, a link that has been reported in other studies (see Austin et al., 2009; Covarrubias et al., 2015).
Piorkowski’s work in 1983 prompted subsequent investigations of survivor guilt among college students, with important variations in its conceptualization. Subsequent conceptualizations included more subtle forms that did not include actual death of family members; specifically, survivor guilt included fear about hurting others (Weiss, 1986). Guilt might arise from engaging in one’s own pursuits and, subsequently, reaping benefits or good experiences from those pursuits while close others are not (e.g., London, 1986; Spurlock, 1985; Whitten, 1992). Through interviews, London (1986) found that FGC students experienced survivor guilt when leaving family to attend the university. Similarly, both Spurlock (1985) and Whitten (1992) reported that Black students who surpassed the academic achievement of family members experienced survivor guilt as well as other mental health consequences (e.g., depression, ambivalence).
While these scholars conceptualized guilt as related to a fear of surpassing the achievements of family members and leaving them behind, measures to assess these experiences are limited. Studies have relied on the survivor guilt subscale of the Interpersonal Guilt Questionnaire (IGQ; O’Connor et al., 1997), which includes both a 45-item and 67-item version with four subscales—Survivor Guilt, Separation Guilt, Omnipotent Guilt, and Self-Hate Guilt—that have been validated with clinical and nonclinical samples. Austin et al. (2009) used the 22-item Survivor Guilt subscale and found guilt was significantly associated with depressive symptoms for Black college students. In their work, the Survivor Guilt measure had marginally acceptable internal consistency (.68). Using the same scale, Hooper (2014) found that Latinx FGC students reported higher survivor guilt than Latinx CGC students and that guilt was significantly correlated with depressive symptoms.
Although these findings shed light on the guilt experiences of marginalized students in university contexts, they do not address family achievement guilt. The IGQ survivor guilt items focus on guilt related to strangers who are struggling (e.g., I am able to retain my good humor even after seeing beggars or homeless people) rather than family members. Focusing on guilt related to family is more theoretically relevant given that FGC students cite their family as a top motive for attending college (Jackson et al., 2016) and report attending college closer to home to be near family (Allen et al., 2015).
To more closely reflect relationships with family in the experience of guilt, Covarrubias and Fryberg (2015) developed a three-item scale adapted from the Survivor Guilt subscale (e.g., I feel uncomfortable because I have more academic opportunities than my siblings or parents). Similar to Piorkowski (1983), Covarrubias and Fryberg argued that engagement in two cultural contexts—social class and race/ethnicity—that both value family connectedness may exacerbate guilt, especially among FGC (Lareau, 2003; Stephens et al., 2012) and Latinx (Rogoff, 2014; Valdés, 1996) populations. The authors found, as predicted, that Latinx FGC students reported higher instances of guilt relative to White FGC, Latinx CGC, and White CGC students (Covarrubias & Fryberg, 2015). These results suggested Latinx FGC students were experiencing high levels of family achievement guilt because of their families’ economic struggles. Indeed, in a follow-up study of FGC and CGC White and ethnic minority students (e.g., Latinx, Black, Native), Covarrubias and Fryberg found that perceiving greater family struggle was related to higher guilt. In the same study, Covarrubias and Fryberg also administered the IGQ Survivor Guilt subscale and found no differences in this measure among student groups, further providing support that family achievement guilt is a more relevant conceptualization of guilt experienced by FGC students in the university context.
These findings, however, remain tentative because of measurement limitations. The measure used by Covarrubias and Fryberg had only three items that yielded marginally satisfactory internal consistency values of .61 and .65 across both studies. Although internal reliability values slightly below .70 are a reasonable enough criterion in exploratory studies of family achievement guilt, a major challenge to future investigations of this construct is measurement development.
Guilt as a Prosocial Emotion
An important consideration in measurement development for family achievement guilt is understanding the unique experience of guilt as different from negative affect and understanding its convergence with related phenomena. Negative affect broadly reflects distress or unpleasant feelings (e.g., Watson et al., 1988). There is no consensus on how to best conceptualize or measure negative affect. Nonetheless, when it is assessed via self-report, researchers commonly prompt participants to rate negatively valenced terms (e.g., anger, fear, sadness) on a Likert-type scale. Some self-report measures of negative affect include guilt (e.g., Russell, 1980; Watson et al., 1988) and others do not (e.g., Gross & Levenson, 1995). Moreover, while guilt is sometimes subsumed, conceptually and methodologically, within negative affect, its phenomenology includes distinct features associated with self-reflection and social ties that set it apart from other affective experiences.
In the current study, we examine the link between guilt and negative affect further by testing two hypotheses. First, we test whether guilt and negative affect are positively associated given that some work subsumes the basic emotion of guilt within negative affect, including items to assess guilt when measuring negative affect (e.g., Russell, 1980; Watson et al., 1988). Given that guilt is distinguishable from negative affect as a self-conscious emotion (Tangney et al., 2007), we expect for guilt to be positively correlated, but conceptually distinct from negative affect. Second, we test whether guilt, beyond negative affect, predicts theoretically relevant outcomes that capture the prosocial nature of guilt, including empathic concerns, family roles, and interdependent motives for going to college. Testing both hypotheses gives a deeper understanding of both the degree of overlap between family achievement guilt and how guilt might also predict relevant outcomes, above and beyond negative affect.
Research has shown that, different than negative affect, guilt is an adaptive emotion as it can help maintain important interpersonal connections (O’Connor et al., 1997). Specifically, guilt includes self-awareness and facilitation of social goals (Tangney et al., 2007). People need to be able to self-reflect on their actions and assess them against internal norms, past experiences, and social norms. Part of these social norms for FGC students include the motivation to maintain ties to close others (e.g., Allen et al., 2015; Jackson et al., 2016). Thus, when leaving family members for college and a life different from home, students might experience cultural incongruence or dissonance linked to feelings of guilt. Such feelings London (1986) described as “breakaway guilt” to define guilt related to leaving home and entering a new cultural context in college. Drawing from interviews with FGC students, London (1986) argued that FGC students felt guilty for becoming different in college in ways that disrupted familial relationships. As a prosocial emotion, guilt might prompt students to correct this disruption. The need for corrective action might arise given the link between guilt and empathy that is focused on alleviating the suffering or hurt of close others (O’Connor et al., 1997). Indeed, research has demonstrated an empirical link between guilt and empathic concern (Tangney et al., 1992). The current work tests these positive links using established scales of cultural incongruence and empathetic concern for others.
As part of the empathic concern, guilt might motivate particular prosocial behaviors that help maintain a connection to family. For example, to reduce the adverse feelings associated with leaving family behind, FGC students might engage more in their home roles and responsibilities to help support parents and siblings. FGC students’ increased familial engagement might include offering instrumental, financial, or emotional support to parents or engaging heavily in sibling caretaking (see Covarrubias et al., 2019; Vasquez-Salgado et al., 2015). Students who experience more guilt might also endorse stronger family-based motivations for attending college, including helping family after graduating (Jackson et al., 2016; Stephens et al., 2012). Past work has not directly examined the links among guilt, family roles, and interdependent motives; the current work addresses this gap. Given the prosocial nature of guilt, we predict a strong positive link between guilt and both family roles and interdependent motives for going to college.
To further test whether family achievement guilt is prosocial and adaptive, we also included a measure of depression. Past theoretical and qualitative work has demonstrated a positive link between guilt and depression for low-income, FGC students of color (Piorkowski, 1983). Follow-up research using measures of guilt validated with clinical samples has found similar links (see Austin et al., 2009; Covarrubias et al., 2015). This link might make sense when guilt is maladaptive (see Tangney et al., 1992). For example, in Piorkowski’s (1983) work with low-income, FGC students of color, she conceptualized guilt as related to surviving trauma and described the experiences of depression felt from dealing with trauma-related guilt. Yet, if family achievement guilt taps into a more prosocial, adaptive experience, one would expect a weak or zero correlation with depression. We test these competing hypotheses in the current study to further examine the concept of family achievement guilt.
The Present Study
The current study developed and began the validation of a measure of the family achievement guilt construct. Because the original three-item family achievement guilt scale used by Covarrubias and Fryberg (2015) likely under-represented the relevant experiences of guilt for students, we conducted background research to generate a more nuanced account of what guilt entails phenomenologically. First, we briefly review focus group data with FGC students designed to capture the ways in which they experience guilt and designed to help generate items for a new, more reliable measure of family achievement guilt. We then briefly describe our process of collecting survey data to identify a preliminary structure for family achievement guilt. These studies provided the basis for the guilt scale tested in the main study.
We have three goals for the main study. First, through an exploratory factor analysis, we identify the structure of the guilt scale. Second, we examine the reliability of the measure by testing both internal consistency and test–retest reliability. Third, we test the predictive validity of the scale. We test the link between guilt and constructs for which we expected positive associations based on past work or theory, including cultural incongruence (London, 1986), family roles and interdependent motives (Covarrubias et al., 2019; Covarrubias & Fryberg, 2015; Vasquez-Salgado et al., 2015), and empathic concern for others (Tangney et al., 1992). We also test the link between guilt and a construct for which we expected a weak or nonsignificant association (i.e., self-efficacy). We reasoned that guilt should be unrelated or weakly related to general beliefs about one’s ability to carry out difficult or new tasks (i.e., general self-efficacy). Yet, because general self-efficacy is considered a positive self-belief (see Schwarzer, 1992), it should be negatively related to general negative affect.
We also include two constructs (i.e., negative affect, depression) that help us better understand the nature of family achievement guilt as either an adaptive or maladaptive emotion. To do this, first, we test the correlation between guilt and negative affect and test the predictive validity of guilt and the other constructs while controlling for negative affect. Given that guilt is often considered a part of negative affect but is also considered to have distinct self-conscious qualities, we anticipate that guilt will (a) be positively related to negative affect and separately (b) predict theoretically relevant constructs (e.g., cultural incongruence, family roles, interdependent motives, empathic concern), even after controlling for negative affect. Second, we test the correlation between guilt and depressive symptoms. If family achievement guilt is adaptive, we predict a weak or zero correlation with depression.
Testing the predictive validity of guilt enables us to understand how guilt is related to important outcomes for student success and sheds light on one component of how students are experiencing the university context. We build on current literature that examines how FGC students struggle to find a place of fit within the university environment (e.g., Engle & Tinto, 2008; Pascarella et al., 2004; Stephens et al., 2015). Extending this work, the current study focuses on what happens to familial relationship at home as FGC students transition to college. Few studies focus on how leaving for college impacts family dynamics and how students experience this shift (e.g., Azmitia et al., 2018; Covarrubias et al., 2019; Destin et al., 2017; Jehangir, 2010; Vasquez-Salgado et al., 2015). We examine the socioemotional consequences of that shift.
Description of Background Studies
The research team conducted two background studies to build the family achievement guilt scale. All members of the research team, which included two faculty members (one Latina, one White male) and one graduate student (Latino), identified as FGC and as experiencing some aspects of family achievement guilt during their academic careers. We drew from these experiences to inform the work. We provide a brief summary of these studies to describe how we arrived at the current measure in the main study.
Step 1: Semi-Structured Interviews
To begin scale development, the research team conducted 60- to 90-minute, semi-structured focus group or individual interviews with 34 FGC students. Students were recruited from a 4-year, large public university on the West Coast of the United States. Using a convenience sampling method, participants were recruited via the psychology department subject pool (n = 25) or via word of mouth from classroom announcements or previous participants (n = 9). The majority of the participants were female (74%) and identified as Latino/a 1 (62%) and Asian/Asian American/Pacific Islander (35%).
Because an in-depth analysis of the semi-structured interviews is not the goal of this article, we provide a brief summary of the coding procedure and results. The full details of the study can be read at Covarrubias et al. (revision). We utilized conventional/inductive and directed/deductive methods to develop codes or categories (Hsieh & Shannon, 2005). Inductive methods were used to understand the underlying meaning of guilt experiences. Using a deductive approach, the search for codes was guided by theory around guilt in college settings (Covarrubias & Fryberg, 2015; London, 1986; Piorkowski, 1983). Guilt themes were categorized based on codes thought to be significant in explaining events or processes related to guilt (Charmaz, 2004).
Four main themes were constructed by the research team. The most frequent theme mentioned was Leaving Family Obligations Behind. This theme indicated the important roles that students could not fully continue while in college, ranging from lending financial support to parents, being present for family gatherings, or supporting siblings emotionally or academically. The second most prevalent theme was Having More Privileges, which was described as freedoms, luxuries, and opportunities not available to family back home. A third prominent theme was that of Becoming Different or changing because of the college experience. Although a few students mentioned teasing comments from family members, most reported feeling guilty and frustrated due to feeling distant because of changing interests and practices, or to not feeling understood when trying to communicate their college experiences. The final theme included Experiencing Financial Distress or distress related to other pressures to succeed. Students often remarked on the sacrifices, including financial sacrifices, that families have made and continue to make to support their education, and the associated pressure to succeed.
The first two authors drew from interview findings to generate 54 initial items. The items were refined and discussed with the third author. Given that achieving a simple factor structure was a priority, no reverse-worded items were included in the final instrument since reverse items may produce a method factor and may reduce reliability over time and internal consistency (Hazlett-Stevens et al., 2004). See Table 1 for examples of how interview findings were translated into scale items. This scale was tested with a separate, diverse sample.
Construction of Family Achievement Guilt Scale Items from Interview Findings.
Step 2: Survey Data Collection
In the second step, we had both FGC and CGC students complete the family achievement guilt scale online, via an online survey tool Qualtrics, at their convenience and on their own devices. Items were administered in random order. Participants answered 54 items. After conducting exploratory factor analyses, the research team created a revised version of the survey with 27 items. All participants were compensated with course credit. See supplemental materials (Appendix A) for a full description of the survey, including details about participants, procedure, and results.
The survey findings informed the current family achievement guilt measure used in the main study. First, we were able to improve the response scale to clarify the meaning. In the original survey, we utilized a Likert-type scale from 0 to 4, with 0 being not true/doesn’t apply. This potentially conflated two responses with different meanings. Thus, we refined this to a 1 to 6 Likert-type scale, with 1 being strongly disagree and 6 being strongly agree, to help clarify the response meanings. Second, because we used a new response scale, we also reverted back to the original 54 items (with refined language) used in the original survey. However, instead of using all 54 items, we removed items that seemed like a poor conceptual fit with family achievement guilt. For example, we removed I feel embarrassed about my level of preparation compared with my college peers and other items that included a comparison between peers rather than between home and college experiences. These changes yielded 41 items to test in the main study.
Main Study
Method
Participants
One hundred eighty-eight participants were recruited from the psychology subject pool at the same institution as the background studies. Six participants were dropped from the survey because they did not complete the demographic questionnaire and eight participants were dropped because they did not pass the attention check question embedded in the survey. This resulted in a final sample of 174 participants (Mage = 20.08, SD = 1.87).
To assess first-generation status, we asked students to report the “highest level of education attained by your parent(s)/guardian(s).” Students selected one option for each parent/guardian from the following: 1 = less than high school; 2 = high school diploma; 3 = some college or 2-year college degree (AA or AS); 4 = 4-year college degree (BA or BS); 5 = graduate or professional degree (MA, PhD, JD, MD); or 6 = I don’t know. Students were considered FGC if they reported that both parents had not earned a 4-year college degree and CGC if at least one parent earned a 4-year college degree. The sample included 53.4% CGC students and 46.6% FGC students. Of all FGC students, the majority (70.4%) reported being the very first person in their families to attend college (i.e., pioneers).
Participants identified as majority female (74.7%), followed by male (18.4%) and nonbinary or other (6.9%). The sample included 26.4% first years, 27.6% second years, 29.3% third years, 11.5% fourth years, 2.9% fifth years, and 2.3% who reported other. Most participants identified as Caucasian/European American 2 (28.2%), Asian/Asian American/Pacific Islander (25.9%), and Latino/a (24.1%), followed by non-White Multiracial (8.0%), White Biracial (8.0%), African American/Black (4.0%), and Middle Eastern (1.7%).
Student income was determined based on family income using an 8-point scale in U.S. dollars (1 = less than US$10,000; 2 = US$10,000–US$29,999; 3 = US$30,000–US$49,999; 4 = US$50,000–US$69,999; 5 = US$70,000–US$100,000; 6 = US$100,000–US$150,000; 7 = US$150,000–US$200,000; 8 = more than US$200,000). The average income of the sample was 4.42 (SD= 1.81), which ranged from approximately US$50,000 to US$69,999. An independent sample t test revealed that FGC students reported lower levels of family income (M = 3.49, SD = 1.30) relative to CGC students (M = 5.48, SD = 1.74), t(128) = 7.29, p < .001. For proceeding analyses, we created a mean split where students coming from family incomes of US$10,000 to US$69,999 were considered working class (n = 72) and those coming from family incomes of US$70,000 to more than 200,000 were considered middle-to-upper-class (n = 58). There were several students (n = 44) who did not report income information. The vast majority also reported that their families lived in California (93.1%), spanning the entire state. Only a small percentage (9.8%) of students’ parents lived in surrounding cities within 35 miles of the campus.
Procedure
Participants were invited to complete the study online, via the online survey tool Qualtrics, at their convenience and on their own devices. There were two data collection time points. The purpose was to examine test–retest reliability for the guilt measure and to assess whether guilt at Time 1 predicted outcomes at Time 2. The first survey was distributed during the beginning of the spring 2019 term and included 41 items and several demographic questions. It took less than 5 min to complete. The second survey was distributed 4 weeks later and included the guilt measure along with other psychological and behavioral measures. This second part took less than 25 min to complete. After participants complete both surveys, they received course credit for their participation.
Time 1 and Time 2 measures
Family achievement guilt was measured using 41 items. Participants read the following prompt: College is a time when students experience a lot of ups and downs. The following statements highlight some challenging emotions students might feel as they compare their experiences in college with their experiences back home. Students might feel these emotions despite the support they receive from close others back home (e.g., parents, legal guardians, siblings).
They then rated the extent to which they agreed or disagreed with each item on a scale from 1 (strongly disagree) to 6 (strongly agree). Responses were coded such that higher scores indicated higher levels of guilt. See Table 2 for a list of items and Table 3 for scale reliabilities, means, and standard deviations of each subfactor. The subfactors yielded good reliability (all αs are above .86).
Factor Loadings and Communalities from the Exploratory Factor Analysis (N = 174).
Note. Factor loadings >.4 are in bold. h2 = extracted communalities. Factor interpretations: 1 = Leaving Family Behind, 2 = Having More Privileges, 3 = Becoming Different, 4 = Experiencing Pressures.
Family Achievement Guilt Factor Reliability, Bivariate Correlations, and Descriptives.
Note. Correlations (all significant at p < .001) below the diagonal reflect scores at Time 1, whereas correlations above the diagonal reflect Time 2. α = Cronbach’s alpha reliability estimate. Test–retest (r) was conducted a month apart. α, M, SD, Skew, and Kurtosis values reflect scores at Time 1. Range for each factor = 1–6.
Time 2 measures
Cultural incongruence was measured with 13 items from the Cultural Congruity Scale (Gloria & Kurpius, 1996). Participants rated the extent to which they agreed or disagreed with each item on a scale from 1 (not at all) to 7 (a great deal). Example items included, I feel that I have to change myself to fit in at school and my cultural values are in conflict with what is expected at school. Responses were coded such that higher scores indicated higher levels of incongruity (M = 2.91, SD = 1.10) and reliability was good (α = .87).
Family roles were measured with 19 items from the Parentification Inventory (Hooper, 2009). Participants rated the extent to which each statement was true on a scale from 1 (never true) to 5 (always true). The scale consisted of two subscales. The Parent-focused subscale consisted of 12 items. Example items included, most children living in my community contributed to their family’s finances and I was the person with whom family members shared their secrets. The reliability was good (α = .87). The sibling-focused subscale consisted of seven items. Example items included, I was responsible for helping my siblings (brother/sister) complete their homework and I was the primary person who disciplined my siblings. The reliability was acceptable (α = .77). Responses were coded such that higher scores indicated higher levels of parent-focused (M = 2.48, SD = 0.78) and sibling-focused (M = 1.87, SD = 0.66) family roles.
Empathic concern was measured with seven items using the Interpersonal Reactivity Index (Davis, 1983). Specifically, we used the Empathic Concern subscale which “assesses ‘other-oriented’ feelings of sympathy and concern for unfortunate others.” Participants rated the extent to which each item described them on a scale from 1 (does not describe me well) to 5 (describes me very well). Example items included, I am often quite touched by things that I see happen and I would describe myself as a pretty soft-hearted person. Responses were coded such that higher scores indicated higher levels of empathic concern (M = 4.00, SD = 0.69) and reliability was good (α = .82).
Interdependent and independent motives were measured with 12 items from Stephens et al. (2012). Participants reported yes or no to whether each statement was a top reason for wanting to attend college. The scale consisted of two subscales. The Interdependent Motives subscale consisted of six items. Example items included, help my family out after I’m done with college and be a role model for people in my community. The Independent Motives subscale also consisted of six items. Example items included, become an independent thinker and expand my understanding of the world. For each subscale, we created a sum composite score. Responses were coded such that higher scores indicated higher levels of Interdependent (M = 3.74, SD = 1.86) and Independent (M = 5.30, SD = 1.34) motives. Reliabilities were acceptable for both Interdependent motives (α = .73) and Independent motives (α = .79).
General self-efficacy was measured with 10 items from the General Self-Efficacy Scale (Schwarzer & Jerusalem, 1995). Participants rated the extent to which they agreed with each item on a scale from 1 (not at all true) to 5 (exactly true). Example scale items included, I can usually handle whatever comes my way and I can solve most problems if I invest the necessary effort. Responses were coded such that higher scores indicated higher levels of self-efficacy (M = 3.03, SD = 0.40) and reliability was good (α = .83).
Negative affect was measured with eight items spanning the dimensions of valence and arousal according to the circumplex model (Russell, 1980). Participants rated the extent to which they experienced each item on a scale from 1 (not at all) to 7 (extremely). Specifically, the following items were averaged: upset, tense, fearful, frustrated, unhappy, ashamed, sad, and exhausted. Responses were coded such that higher scores indicated higher levels of negative affect (M = 3.12, SD = 1.27) and reliability was excellent (α = .90).
Depressive symptoms were measured with seven items from the Center for Epidemiologic Studies Depression Scale–Short Form (CES-D-S; Levine, 2013). Participants rated how frequently they experienced each item on a 1 (rarely or none of the time [less than 1 day]) to 4 (all of the time [5–7 days]) scale. Example scale items included, I did not feel like eating and I felt that everything I did was an effort. Responses were coded such that higher scores indicated higher levels of depressive symptoms (M = 2.47, SD = 0.74) and reliability was good (α = .84).
Results
Exploratory factor analysis
An exploratory factor analysis was conducted on Time 1 guilt items to determine whether the generated items clustered into meaningful, underlying factors and to identify the number of factors present. Our goal was to achieve a simple factor structure that captured related but distinguishable dimensions of family achievement guilt suggested in the focus group interviews. Factorability of the guilt items was demonstrated by the significant correlation of each item with at least one other item. In addition, a Kaiser–Meyer–Olkin test of sample adequacy yielded a value of .928, above the recommended value of .6 (Beavers et al., 2013). Moreover, the corrected interitem correlations were all above .48, greater than the recommended .30 (M = .62, SD = .09; Nunnally & Bernstein, 1994).
Given the low reliability in interpretation associated with scree plots (Crawford & Koopman, 1979; Streiner, 1998), we utilized a parallel analysis simulation to determine the number of factors to extract (B. P. O’Connor, 2000). A parallel analysis simulation generates random correlation matrices with the same number of variables and participants in a given data set for comparison to determine how many derived eigenvalues are solely due to chance. Using SPSS syntax developed by B. P. O’Connor (2000), we calculated 1,000 randomly generated data sets with 174 cases and 41 variables. The first four mean eigenvalues were 13.73, 3.02, 2.57, and 1.94, and the parallel analysis indicated they were too rare in a sampling distribution of eigenvalues to be due to chance, suggesting an optimal four-factor solution. Principal axis factoring was used to extract the four factors. Oblique rotation (promax) was used to help interpret them because the factors were expected to be correlated with each other. After a second iteration, seven items were omitted due to cross-loading of at least .32 (Tabachnick & Fidell, 2001; g6, g30, g33, g34), due to low factor loading (g15, g38), or due to low factor loading and cross-loading (g9), resulting in a final 34 items. All except one (g40) of the extracted communalities were above .30 (M = .578, SD = .116; Velicer & Fava, 1998). The four factors explained 63% of the variance in the items.
The first factor explained the most variance and was interpreted as Leaving Family Behind (40.37%, 13 items), followed by Having More Privileges (8.87%, eight items), Becoming Different (7.57%, eight items), and Experiencing Pressures (5.70%, five items). See Table 2 for factor structure details. Computed averages demonstrated good internal reliability for each subscale (αs = .94, .93, .88, and .86, respectively). There were significant inter-subscale associations with correlations ranging between .39 to .71, with Leaving Family Behind and Having More Privileges correlating the highest at .71. See Table 3 for subscale internal reliability values and inter-subscale associations.
College generation status and income differences on guilt subscales at Time 1
We tested for college generation status and income differences separately on all guilt subscales measured at Time 1. In addition, see supplemental materials (Appendix B) for racial/ethnic differences on guilt subscales and for analysis of the interaction between college generation status, income, and race/ethnicity on guilt subscales.
College generation status
A series of independent sample t tests yielded significant college generation (FGC, CGC) differences on each guilt subscale. FGC students reported higher levels of guilt related to Leaving Family Behind (M = 4.19, SD = 1.04) relative to CGC students (M = 3.63, SD = 1.10), t(171) = 3.43, p = .001. FGC students reported higher levels of guilt related to Having More Privileges (M = 3.91, SD = 1.17) relative to CGC students (M = 2.75, SD = 1.11), t(169) = 6.65, p = .000. FGC students reported higher levels of guilt related to Becoming Different (M = 3.01, SD = 1.05) relative to CGC students (M = 2.65, SD = 1.10), t(171) = 2.17, p = .031. Finally, FGC students reported higher levels of guilt related to Experiencing Pressures (M = 4.72, SD = 1.10) relative to CGC students (M = 4.11, SD = 1.25), t(171) = 3.37, p = .001. These findings held when controlling for income, all ps ranged from .001 to .021.
Income
We then conducted a series of independent sample t tests to examine the link between income (working-class, middle-to-upper-class) and each guilt subscale. There were no significant income differences on guilt related to Leaving Family Behind (p = .18), Becoming Different (p = .18), and Experiencing Pressures (p = .99). There were significant income differences on guilt related to Having More Privileges, t(125) = 2.83, p = .005. Working-class students reported higher levels of guilt related to Having More Privileges (M = 3.70, SD = 1.13) relative to middle-to-upper-class students (M = 3.09, SD = 1.31).
College generation status differences on outcome variables at Time 2
For all Time 2 analyses, 17 participants were dropped from the Time 1 sample because they did not complete Time 2 measures and 24 were dropped because they did not pass the attention check question embedded within the Time 2 survey. This left a final sample of 133 participants (Mage = 20.15, SD = 1.96), including 53.4% CGC and 46.6% FGC students. We conducted a series of independent sample t tests to examine college generation status (FGC, CGC) differences on each outcome variable. See Table 4 for means, standard deviations, and test statistics. There were no college generation status differences on cultural incongruence, empathic concern, independent motives, depression, and self-efficacy. However, there were differences on parent- and sibling-focused family roles, interdependent motives, and negative affect. Relative to their CGC counterparts, FGC students reported engaging in heavier parent- and sibling-based family roles, endorsing higher levels of interdependent motives for going to college, and experiencing higher levels of general negative affect.
College Generation Status Differences on Time 2 Outcome Variables.
Note. FGC = first-generation college; CGC = continuing-generation college.
Test–retest reliability
To examine the consistency of the family achievement guilt measure across time, we tested for test–retest reliability. We conducted a Pearson correlation of Time 1 and Time 2 guilt, which were measured 4 weeks apart. See Table 3 for correlations. The r values ranged from .78 to .85, indicating good test–retest reliability.
Convergent and discriminant validity
We then explored the predictive value of the measure. We focused on testing convergent (i.e., a correlation with other similar or theoretically informed measures) and discriminant (i.e., a lack of or weak correlation with measures that are different or not expected to be related) validity. Measurement of negative affect sometimes includes guilt and sometimes does not. Moreover, the association between guilt and depression might differ depending on whether guilt is maladaptive or adaptive. Therefore, we did not make a case for convergent or discriminant validity of negative affect and depression. Instead, we tested competing hypotheses for each of these constructs to learn more about the nature of the family achievement guilt construct. See Table 5 for standardized coefficients from regression analyses with the guilt subscales as simultaneous predictors for each outcome.
Family Achievement Guilt Subscales at Time 1 Predicting Dependent Variables at Time 2.
Note. Nonparenthetical values are standardized coefficients. Parenthetical values are standard error estimates. Values of .00 reflect estimates <.01. Dependent variables were measured at Time 2 whereas guilt subscale scores were collected at Time 1.
p < .05. **p < .01. ***p < .001.
Convergent validity
We selected constructs that we reasoned would correlate with guilt based on theory or past literature, these included cultural incongruence, family roles parent- and sibling-focused, empathic concern, and interdependent and independent motives for college. For all constructs, there was some correlation between one of the guilt subscales and the construct. Higher levels of guilt related to Leaving Family Behind predicted higher engagement in parent-focused family roles, higher levels of empathic concern, and lower levels of independent motives for going to college. Higher levels of guilt related to Having More Privileges predicted higher engagement in parent- and sibling-focused family roles and higher levels of interdependent motives for going to college. Higher levels of guilt related to Becoming Different predicted higher levels of cultural incongruence between home and school. Finally, higher levels of guilt related to Experiencing Pressures predicted higher interdependent motives for going to college.
Discriminant validity
We also tested a construct (e.g., self-efficacy) that we thought would not correlate or would correlate weakly with guilt. As expected, no subscales of guilt predicted self-efficacy (βs = .03 to .17, ps > .24).
Negative affect and depression
We tested whether different subscales of guilt predicted negative affect and whether they predicted depression (see Table 5). We found that higher levels of guilt related to Becoming Different and to Experiencing Pressures were associated with higher levels of negative affect. Yet, guilt related to Leaving Family Behind and to Having More Privileges was unrelated to negative affect. Moreover, we found no links between any of the guilt subscales and depression.
Family achievement guilt as a predictor controlling for negative affect
We then examined the unique role of guilt in predicting the same outcome variables, controlling for negative affect (see Table 6). After controlling for negative affect, the guilt subscales continued to predict the same constructs as described above. 3
Family Achievement Guilt Subscales at Time 1 Predicting Dependent Variables at Time 2, Controlling for Negative Affect at Time 2.
Note. A separate model for each dependent variable with the guilt subscales as simultaneous predictors and negative affect as a covariate. Nonparenthetical values are standardized coefficients. Parenthetical values are standard error estimates. Values of .00 reflect estimates <.01. The guilt subscales scores were all measured at Time 1. Dependent variables and negative affect measured at Time 2.
p < .05. **p < .01. ***p < .001.
Negative affect also significantly predicted several outcome variables (see Table 6). Higher levels of negative affect were associated with higher levels of cultural incongruence between home and school, higher engagement in parent-focused family roles, and higher depression. As expected, negative affect, but not any of the guilt subscales, predicted lower levels of self-efficacy.
General Discussion
Family achievement guilt was first conceptualized as a socioemotional experience related to “leaving family members behind” to pursue individual goals in college (Covarrubias & Fryberg, 2015). Because of limited measurement development, students’ guilt experiences may not have been fully captured. The current work makes some progress toward a more robust and reliable instrument with predictive value. Our findings resulted in four subscales that captured different aspects of family achievement guilt, produced good internal and test–retest reliability, and presented initial evidence for convergent and discriminant validity.
The first factor (13 items), the most representative of family achievement guilt, was interpreted as guilt related to leaving family behind and not being able to fulfill important roles that are central to the functioning of the family (Covarrubias et al., 2019; Vasquez-Salgado et al., 2015). The second factor (eight items) included guilt related to having more privileges. Closely related to the original concept proposed by Covarrubias and Fryberg (2015), this factor includes recognizing the discrepancy between privileges and opportunities available in the university and those less readily available to members in working-class homes (Covarrubias & Fryberg, 2015; Piorkowski, 1983). The third factor (eight items) included guilt related to becoming different from family. This guilt closely resembles London’s (1986) notion of “breaking away” and the fear of growing distant from family by becoming educationally mobile. The final factor (five items) was guilt related to experiencing pressures concerned with not being able to be successful for their families or pay back their family’s investment.
Across all subscales, we found that FGC students reported higher levels of guilt relative to their CGC counterparts, even when controlling for income. This is consistent with our predictions and prior work (Covarrubias & Fryberg, 2015; Piorkowski, 1983; Vasquez-Salgado et al., 2015). Moreover, we found no income differences on three of four guilt subscales (Leaving Family Behind, Becoming Different, Experiencing Pressures). This suggests that family achievement guilt might tap into a cultural experience related to being the first person to go to college rather than an experience solely informed by financial resources. For example, as FGC students leave family to go to college, they might experience guilt for becoming different than them culturally. In this way, guilt is about the cultural differences experienced in both the home and university contexts. Interestingly, working-class students did report higher levels of guilt related to having more privileges than their middle-to-upper class counterparts. Although this form of guilt can also be cultural (e.g., experiencing a privileged cultural experience at the university), it also taps into financial resources in that working-class students are experiencing more wealth at the university than what might be available at home. Future work should study the nuances and intersections of these differences.
Another main goal and contribution of the current work was to explore the predictive value of the guilt subscales. Although guilt was positively associated with negative affect, guilt was also found to predict theoretically relevant constructs when controlling for negative affect. For example, we found that higher levels of guilt related to becoming different were linked to higher levels of incongruity between home and school. That is, when students experience greater wedges between their home and school lives, this might elicit feelings of guilt. Different from negative affect, guilt is a prosocial emotion that facilitates the maintenance of interpersonal connections (L. O’Connor et al., 1997). In this way, guilt might facilitate family-engagement behaviors, including helping at home and going to college to help family. Indeed, we found that higher levels of guilt related to leaving family behind and having more privileges was related to higher engagement in family roles and higher interdependent motives for college (and fewer independent reasons for going to college). This adaptive responding might be one way to confront what might be left behind as students transition to college.
This adaptive responding also sheds light on the link to depression. Inconsistent with past work linking guilt with depression (Austin et al., 2009; Covarrubias et al., 2015; Piorkowski, 1983), the family achievement guilt subscales were not associated with depression, yet negative affect was. One reason for this difference is that past work has utilized the IGQ Survivor Guilt subscale and has discussed that guilt can be maladaptive when it is inhibiting (Tangney et al., 1992). Under these circumstances, guilt is likely to be related to depression, capturing more general distress (which explains the link to negative affect). Our findings suggest a more adaptive feature of family achievement guilt as an emotion that provokes engagement with close others. This might explain the lack of correlation between family achievement guilt and depression. Future work is needed to directly test this idea.
Finally, we present initial evidence for discriminant validity. Consistent with our predictions, the guilt subscales were not associated with self-efficacy, yet negative affect predicted lower self-efficacy. This provides support for the distinctive nature guilt apart from negative affect.
Future Directions and Implications
One possible limitation of the new measure is its generalizability. All items were drawn from interviews with FGC students at a midsize public R1 university in California. Although the subscales are experiences that are supported by prior work with FGC students, it would be important for future research to validate and test the reliability of these measures with FGC students in other university contexts (e.g., community colleges, highly selective universities, and in other geographical regions with a range of ethnic and racial diversity). For example, our samples were predominantly Latinx, White, and Asian, pioneers, and from across the state of California. Would similar themes emerge for Black FGC students at historically black college and universities or for White FGC students in rural areas of the country? Future work should strive to recruit larger, more diverse samples to conduct further validation of the family achievement guilt scale, including employing confirmatory factor analysis techniques. This would not only help understand the generalizability of the phenomenon but also would allow the opportunity to better understand the interactions between college generation status, income, and racial/ethnic identity.
In better understanding what is left behind when marginalized students leave for college, educational settings can respond effectively and sensitively to the needs of FGC students. Although we find that family achievement guilt might lead to prosocial outcomes, the experience of guilt might create a stressful tension for FGC students. There is a sense of dissonance and distress that occurs when students witness themselves simultaneously becoming more upwardly mobile by going to college and becoming different and distant from their family’s lifestyles and responsibilities. The freedom and privileges afforded by university life might feel like a wedge between the student’s life at home and on campus (Stephens et al., 2012; Vasquez-Salgado et al., 2015). This wedge can be especially acute in families where no one has gone to college.
This distancing is created by institutional structures that can do more to consider the dissonance; that is, even though the result of guilt might be prosocial, students are left to cope with this stressful tension on their own and may not always cope adaptively. Institutions cannot rely on students’ resilience to ensure their graduation from college. Indeed, Piorkowski (1983) commented that although the concept of guilt may alleviate some of the distress, as it helps students draw closer connections to families, this isolation or distancing is particularly important to address by creating norms and placing structures that help FGC students develop better interpersonal support networks in the new college environment. Without an interpersonal support network, students may continue to view their college transition as a selfish endeavor.
What policies on campus might help alleviate this dilemma? Few scholars have begun to write about strategies for alleviating guilt, in particular, for FGC students. Tate et al. (2013) outlined a specific form of therapy that they reason will help FGC students deal with guilt by finding meaning in their place at the university. Although this work brings awareness to the socioemotional experiences of FGC students, there is a serious risk of treating guilt experiences as mental disorders that should be addressed by psychotherapy. This approach places the focus of the response on students to cope. Instead, responses should consider how systemic mismatches between university and home settings, and the subtle cues elicited by each of these contexts, can have an effect on this nuanced socioemotional experience.
By privileging FGC voices in creating the family achievement guilt scale, we hoped to alert faculty, staff, and administrators to tensions created by a cultural wedge. For example, in learning that FGC students might feel guilt related to experiencing pressures or of leaving family behind and not being able to fulfill similar opportunities campuses might seek ways to alleviate this tension. Often FGC students have to choose between part-time work to cover living, school, and family expenses, and unsupported professional development activities designed to build critical career skills (Carnevale & Smith, 2018). If universities provide more paid internships, students would not have to choose between gaining experience and supporting themselves and their families. Universities could also integrate family-based programming that reflects the cultural understandings of FGC students and their families and affirms the role of families in the college journey (see Covarrubias et al., 2020).
In being able to measure guilt in psychometrically sound ways and to test preliminary links with important outcomes, we move closer to understanding and validating the voices of students who experience dissonance between their homes and a university setting not designed for them and their families. This dissonance is a site and opportunity for institutions to grow in the ways they serve and support students.
Supplemental Material
Covarrubias_Online_Appendix – Supplemental material for Developing a Family Achievement Guilt Scale Grounded in First-Generation College Student Voices
Supplemental material, Covarrubias_Online_Appendix for Developing a Family Achievement Guilt Scale Grounded in First-Generation College Student Voices by Rebecca Covarrubias, Isidro Landa and Ronald Gallimore in Personality and Social Psychology Bulletin
Supplemental Material
Guilt_Scale_Appendices_Jan_7 – Supplemental material for Developing a Family Achievement Guilt Scale Grounded in First-Generation College Student Voices
Supplemental material, Guilt_Scale_Appendices_Jan_7 for Developing a Family Achievement Guilt Scale Grounded in First-Generation College Student Voices by Rebecca Covarrubias, Isidro Landa and Ronald Gallimore in Personality and Social Psychology Bulletin
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Notes
Supplemental Material
Supplemental material is available online with this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
