Abstract
The Protean and Boundaryless Career Attitudes scales developed by Briscoe and colleagues have facilitated research on career attitudes and mindsets, but they are unnecessarily lengthy and somewhat redundant in their content. To address these concerns, this article presents three studies that develop and validate short forms of the Protean and Boundaryless Career Attitudes scales (i.e., PCA-SF and BCA-SF). Study findings suggest that the PCA-SF and BCA-SF provide a more efficient assessment of the protean and boundaryless career attitudes constructs than the full-length measures and exhibit partial measurement equivalence across U.S. and Korean populations.
Keywords
The traditional organizational career, where an individual proceeds linearly up the hierarchy of one or two organizations in order to achieve extrinsic rewards, is often contrasted with alternative career arrangements such as protean and/or boundaryless career approaches (Arthur & Rousseau, 1996; Hall, 2002; Sullivan & Baruch, 2009). Both protean and boundaryless career approaches are characterized by self-reliance in the pursuit of career development and employability. More specifically, protean careers are characterized by “self-direction in the pursuit of psychological success in one’s work” (Hall, 2002, p. 23) and the adherence to personal standards or values when making career choices rather than to the expectations of others (e.g., an employing organization). Boundaryless careers are characterized by psychologically or physically crossing organizational boundaries for work (Sullivan & Arthur, 2006). Although these “non-traditional” career approaches have been discussed in the careers literature for decades, empirical research is just beginning to illuminate their psychological origins and practical implications for individuals and organizations.
To facilitate the rigorous and systematic study of protean and boundaryless careers, Briscoe, Hall, and DeMuth (2006) developed and validated the Protean and Boundaryless Career Attitudes scales (items are listed in the Appendix). The Protean Career Attitudes (PCA) scale is composed of two subscales, that is, Self-Directed and Values-Driven. The Self-Directed (PCSD) subscale assesses the belief that one is “in charge” of his or her own career. The Values-Driven (PDVD) subscale measures whether one tends to follow his or her own values when making career decisions as opposed to organizationally or socially sanctioned values. The Boundaryless Career Attitudes (BCA) scale is also composed of two subscales, that is, Boundaryless Mindset and Organizational Mobility Preference. The Boundaryless Mindset (BCBM) subscale captures one’s desires and inclinations to cross organizational boundaries (e.g., functional units and organizations) to accomplish work, and the Organizational Mobility Preference (BCOMP) subscale assesses whether one favors changing employers over staying with one employer for a longer time.
Briscoe et al.’s (2006) scale development work signifies a crucial step in establishing the consistent measurement of protean and boundaryless career attitudes. Moving forward, we see two reasons why further refinement (or reduction) of these scales may be beneficial. First, the content match between the original scales and the corresponding theoretical constructs is somewhat questionable: Some items included in the measures are fairly repetitive or overly broad in their content coverage. Second, the scales are fairly long (13–14 items in each scale), which may discourage researchers with limited time and resources from using the scales and/or result in respondent fatigue.
To remedy issues of scale validity and length, we conducted three studies to develop the PCA and BCA short forms (PCA-SF and BCA-SF). In the first study, we reduce the number of items in the original PCA and BCA scales to remove redundant or irrelevant content. In the second study, we present two types of validity evidence for the PCA-SF and BCA-SF as assessments of protean and boundaryless career attitudes: the internal factor structures of each shortened scale and the empirical relationships of the short forms with a set of theoretically relevant personality antecedents and work and career outcomes. Moreover, we evaluate the construct validity of the PCA-SF and BCA-SF by comparing these findings with the findings of previous research that used the original PCA and BCA scales. In the third study, we evaluate the measurement equivalence of the PCA-SF and the BCA-SF across U.S. and South Korean working adults, thereby extending the potential use of the short forms to a different language/cultural population. Taken together, these studies aim to facilitate future protean and boundaryless careers research by addressing the psychometric and practical issues associated with the use of the original PCA and BCA scales as well as providing an initial foundation for broadening the scope of protean and boundaryless careers research across national boundaries.
Study 1: Developing PCA-SF and BCA-SF
As a first step in refining Briscoe and colleagues’ PCA and BCA scales, this study shortens the original PCA and BCA by removing irrelevant and/or redundant items, yielding the PCA-SF and BCA-SF. We drew from protean and boundaryless careers research to determine which items were theoretically relevant to the protean and boundaryless career attitudes constructs and therefore, which items should be retained in the PCA-SF and BCA-SF (e.g., Arthur & Rousseau, 1996; Briscoe, Hall, & DeMuth, 2006; Defillippi & Arthur, 1994; Hall, 2002; Hall & Moss, 1998; Inkson, 2006; Mirvis & Hall, 1994; Sullivan & Arthur, 2006).
Method
Procedure and Participants
Using Amazon Mechanical Turk (MTurk), 1 we administered Briscoe et al.’s (2006) measures of PCA and BCA via an anonymous online survey to 370 working adults residing in the United States. On average, participants were 36 years old (SD = 12.5) and had an organizational tenure of 5 years (SD = 6). Sixty-five percent of respondents were female; 77% were White, 8% were Black, 8% were Asian, and 4% were Hispanic. About 34% of participants had a bachelor’s degree, 30% had some college or an associate’s degree, 24% had graduate or professional training, and 10% had a high school diploma. Participants were from a variety of industries including information technology (14%), health care (13%), retail (11%), and financial services (7%).
Results and Discussion
To identify items that were candidates for removal, we conducted two separate sets of exploratory factor analyses (with maximum likelihood estimation and a promax rotation), one for the PCA and one for the BCA. The number of factors for each scale was determined by the number of eigenvalues greater than 1.0 and the number of factors present before the final steep decline of the scree plot; these criteria were consistent with one another. In addition, we evaluated the theoretical interpretability of each solution. For the PCA scale items, a three-factor solution initially emerged (as opposed to the expected two factor solution) that explained 58% of the variance in the PCA items. Upon investigating the factor pattern matrix, we found that Items 2 and 3 of the PCVD subscale split from the other PCVD items, creating two factors that were conceptually indistinguishable from one another. Given that the three-factor structure did not provide new insights into the protean career attitudes construct, we decided to refine the scales to obtain a two-factor solution, as originally theorized by Briscoe et al. (2006). For the BCA items, a two-factor solution initially emerged that explained 65% of the variance in the BCA items; all items loaded on their theoretically expected factors.
We continued conducting two separate factor analyses for the PCA and BCA scales in which we removed items from each scale one at a time based upon a combination of four criteria (Hinkin, 1998; Stanton, Sinar, Balzer, & Smith, 2002): (1) whether items exhibited loadings on more than one factor; (2) whether items demonstrated unacceptably low intercorrelations with items of the same scale (.40 or lower); (3) whether items exhibited unacceptably low communality levels (.40 or lower); and (4) whether item content was overlapping with other items or inconsistent with the construct. We explain our rationale for the removal of each item in the Appendix. Throughout this scale refinement process, we sought to keep the item content consistent with theoretical conceptualizations of protean and boundaryless career attitudes.
For the PCA-SF, 7 items were retained, 4 items representing the PCSD subscale and 3 items representing the PCVD subscale. About 68% of the variance in the items was explained by these two factors. For the BCA-SF, 6 items were retained, 3 representing the BCBM subscale and 3 representing the BCOMP subscale. About 79% of the variance in these items was accounted for by these two factors. Table 1 reports the retained items with factor loadings and the Cronbach’s α reliability coefficients of the shortened scales.
Short-Form Protean and Boundaryless Career Attitudes Scales With Standardized Factor Loadings and Reliability Coefficients.
aA reverse scored item.
Further, to evaluate whether the PCA-SF and BCA-SF assess similar constructs as the original measures, we examined the statistical relationships between the short and long form subscales. We found that the short forms and the long forms of the PCA and BCA subscales were very highly correlated, PCSD r(370) = .93, p < .01; PCVD r(370) = .86, p < .01; BCBM r(370) = .95, p < .01; BCOMP r(370) = .96, p < .01, which suggests that the short and long forms are comparable measures of protean and boundaryless career attitudes.
In summary, this study shortened Briscoe et al.’s (2006) original PCA and BCA scales and, in so doing, addressed concerns associated with the validity and length of the scales. Specifically, redundant and tangentially relevant items were removed from the scales, resulting in more efficient assessments of protean and boundaryless career attitudes that can more easily be incorporated into subsequent research.
Study 2: Scale Validation
Study 2 builds upon Study 1 by presenting two types of evidence for the validity of the PCA-SF and BCA-SF as measures of protean and boundaryless career attitudes. First, we evaluate whether the observed internal factor structures of PCA-SF and BCA-SF align with the original theories underlying the protean and boundaryless career attitudes constructs and their corresponding indicators (as opposed to other alternative measurement models) using confirmatory factor analysis. Second, we investigate the empirical relationships of the shortened measures with other variables (i.e., personality antecedents and work and career outcomes), and we evaluate whether PCA-SF and BCA-SF show similar patterns of relationships with these variables as previous research using the full-length scales. To provide a theoretical background for these relationships, we briefly review the literature on protean and boundaryless careers in relation to the variables included in our study: personality antecedents (Big Five personality factors and proactive personality) and work and career outcomes (job satisfaction, organizational commitment, job market cognitions, job search, and career satisfaction).
Personality Antecedents
Previous research has investigated factors that might contribute to nontraditional career mindsets (e.g., Sargent & Domberger, 2007; Segers, Inceoglu, Vloeberghs, Bartram, & Henderickx, 2008), but these studies have overlooked the potential role of personality in facilitating these attitudes. One notable exception is Briscoe et al.’s (2006) work, which found that all four subscales of PCA and BCA (PCSD, PCVD, BCBM, and BCOMP) were positively associated with measures of proactive personality (Bateman & Crant, 1993) and openness to experience (one of the Big Five personality factors; John & Srivastava, 1999; McCrae & Costa, 1987). This study contributes to this literature by linking protean and boundaryless career attitudes with all Big Five personality factors and proactive personality, which may provide insights into the dispositional roots of these attitudes (i.e., who is likely to hold nontraditional career attitudes).
Work and Career Outcomes
Research suggests that workers who hold self-directed (protean) career attitudes often express feelings of attachment to their organizations (i.e., organizational commitment), perceive themselves to be capable of maintaining or acquiring new employment, and may engage in more job search activities (Çakmak-Otluoğlu, 2012; De Vos & Soens, 2008; Waters, Briscoe, Hall, & Wang, 2014). Moreover, self-directed workers are more likely to be satisfied with both their jobs and their careers (Briscoe, Henagan, Burton, & Murphy, 2012; O’Shea, Monaghan, & Ritchie, 2014). In contrast, those who follow their own values when making career choices (i.e., values-driven) are less likely to exhibit these outcomes (Briscoe & Finkelstein, 2009; Çakmak-Otluoğlu, 2012).
Workers with a boundaryless mindset, who prefer psychological mobility, are neither particularly attached to nor detached from their organizations (Çakmak-Otluoğlu, 2012); however, they tend to view themselves as valuable to the external labor market, are more likely to engage in job search, and are more likely to be satisfied with their jobs and careers (Briscoe et al., 2012; McArdle, Waters, Briscoe, & Hall, 2007; Vansteenkiste, Verbruggen, & Sels, 2013; Verbruggen, 2012). Those with a preference for organizational mobility (i.e., physical boundarylessness), on the other hand, are expected to feel less attached to their organizations (i.e., organizational commitment) and are more likely to be dissatisfied with their jobs and careers (Briscoe & Finkelstein, 2009; Çakmak-Otluoğlu, 2012; O’Shea et al., 2014; Verbruggen, 2012).
Method
Procedure and Participants
Similar to Study 1, we collected 311 responses from working U.S. residents to a second anonymous online survey via MTurk; participants were rewarded with a nominal fee (U.S. $3.00). On average, participants were 33 years old (SD = 12) and had an organizational tenure of 4 years (SD = 4.5). Fifty-four percent of respondents were male; 74% were White, 10% were Asian, 7% were Black, and 5% were Hispanic. About 40% of respondents had some college or an associate’s degree, 31% had a bachelor’s degree, 16% had graduate or professional training, and 13% had a high school diploma.
Measures
Unless otherwise noted, participants were asked to rate the extent to which they agreed with statements based upon a 5-point scale (1 = strongly disagree; 5 = strongly agree). To assess protean and boundaryless career attitudes, we used the PCA-SF and BCA-SF developed in Study 1 (see Table 1 for items). We assessed the Big Five personality factors (extraversion, neuroticism, conscientious, agreeableness, and openness to experience) using the 44-item Big Five Inventory (John & Srivastava, 1999). Proactive personality was measured using the 17-item proactive personality scale (Bateman & Crant, 1993), which assesses the propensity to show initiative, take action, and persevere to bring about change. Job satisfaction was assessed using the 8-item Abridged Job-in-General Scale (Russell et al., 2004), which asks participants to rate the extent to which adjectives (e.g., “Good” and “Undesirable”) describe their job. Organizational commitment was assessed using Meyer, Allen, and Smith’s (1993) 6-item measure of affective commitment in which participants rated their emotional attachment to their organizations. Job market cognitions were assessed using the Employment Opportunity Index (Griffeth, Steel, Allen, & Bryan, 2005), a multidimensional measure of one’s perceived ability to acquire an alternative job based upon job market conditions and personal attributes. This 17-item measure has five components: ease of movement, desirability of movement, networking, crystallization of alternatives, and mobility. Job search was assessed using Blau’s (1993) job search behavior measure. Respondents were asked to rate the frequency with which they engaged in job search behaviors (e.g., “Filled out a job application”) over the previous 6-month period on the following scale: 1 = never (0 times), 2 = rarely (1 or 2 times), 3 = occasionally (3–5 times), 4 = frequently (6–9 times), and 5 = very frequently (at least 10 times). Finally, career satisfaction was assessed using Greenhaus, Parasuraman, and Wormley’s (1990) Career Satisfaction Scale, which is composed of 5 items that assess satisfaction with one’s career in general (e.g., I am satisfied with what I have achieved in my career). The Cronbach’s α reliability estimates for these scales are reported in Table 2.
Means, Standard Deviations, Reliability Coefficients, and Intercorrelations of Study 2 Variables.
*p < .05. **p < .01.
Results
Evaluating Internal Factor Structures
Using Mplus version 5.1, we conducted two sets of confirmatory factor analyses on the PCA-SF and BCA-SF separately. We evaluated model fit using four indices: the chi-square statistic, comparative fit index (CFI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). CFI values of .90 or above indicate acceptable fit and values of .95 or greater indicate good fit; RMSEA and SRMR values of .08 or lower indicate acceptable fit and values of .05 or less indicate good fit (Hu & Bentler, 1999; McDonald & Ho, 2002). Further, we compared the fit of each model using the chi-square difference test.
For both the PCA-SF and the BCA-SF, we compared theoretically expected two-factor models (in which subscales were represented as separate factors) to one-factor models. Compared to the one-factor PCA model (χ 2 = 194.89, df = 14; CFI = .76; RMSEA = .20; SRMR = .10), the two-factor model provided a better fit to the data (χ 2 = 25.47, df = 13; CFI = .98; RMSEA = .05; SRMR = .04) as evidenced by the chi-square difference test (Δχ 2 = 169.42, Δdf = 1, p < .001). Likewise, the two-factor BCA model (χ 2 = 7.75, df = 8; CFI = 1.00; RMSEA = .00; SRMR = .02) provided a superior fit to the data compared to the one-factor model (χ 2 = 423.54, df = 9; CFI = .75; RMSEA = .28; SRMR = .17), which was also supported by the chi-square difference test (Δχ 2 = 415.79, Δdf = 1, p < .001). 2
Evaluating Relationships with Other Constructs
To further evaluate the validity of the PCA-SF and BCA-SF in assessing protean and boundaryless career attitudes, we examined their bivariate relationships with personality antecedents (i.e., Big Five and proactive personality) and work and career outcomes (i.e., job satisfaction, organizational commitment, job cognitions, job search, and career satisfaction). Table 2 presents the zero-order (bivariate) correlations of study variables, along with their means, standard deviations, and Cronbach’s α reliability estimates. Moreover, to examine whether the PCA-SF and BCA-SF assess protean and boundaryless career attitudes in a similar manner as the original (long) scales, we used the Fisher’s z test to evaluate whether the relationships between the short forms and the aforementioned study variables were comparable to findings reported in previous research using the original PCA and BCA scales (see Table 3).
Comparisons of Study 2 Findings With Previous Research Results Using Fisher’s z Test.
Note. PCSD = Protean Career Self-Directed; PCVD = Protean Career Values-Driven; BCBM = Boundaryless Career Boundaryless Mindset; BCOMP = Boundaryless Career Organizational Mobility Preference.
*p < .05. **p < .01.
Personality
The short forms of the PCSD, PCVD, and BCBM subscales (PCSD-SF, PCVD-SF, and BCBM-SF, respectively) were positively associated with openness to experience and proactive personality. The short form of the BCOMP subscale (i.e., BCOMP-SF), on the other hand, was only associated with openness. While the magnitude of these findings was largely consistent with previous research (see Table 3), we note that the PCVD-SF exhibited a stronger relationship with the theoretically relevant variable of openness to experience than has been reported in previous research using the original PCVD subscale (Briscoe et al., 2006).
Regarding the relationships between the short forms and the remaining Big Five personality factors, the PCSD-SF was positively related to extraversion, agreeableness, and conscientiousness, and negatively related to neuroticism, whereas the PCVD-SF was positively related to agreeableness and conscientiousness. The BCBM-SF was positively associated with extraversion and agreeableness, and negatively associated with neuroticism; the BCOMP-SF was unrelated to the remaining Big Five personality factors.
Work and Career Outcomes
The PCSD-SF was associated with greater job satisfaction and organizational commitment, whereas the PCVD-SF was unrelated to these work attitudes. The PCSD-SF was also positively related to perceptions of alternative employment opportunities (i.e., ease of movement) and maintaining a network of contacts with access to alternative job information (i.e., networking); the PCVD-SF was unrelated to job market cognitions. Finally, both the PCSD-SF and PCVD-SF were positively related to career satisfaction. In general, these findings were consistent with previous research with two exceptions; the Fisher’s z test revealed that the PCSD-SF showed stronger relationships with theoretically relevant variables of job satisfaction and organizational commitment than the original subscale.
The BCBM-SF was positively related to job satisfaction and unrelated to organizational commitment, whereas the BCOMP-SF was negatively associated with these outcomes. The BCBM-SF was positively related to job market cognitions: those with a boundaryless mindset thought that they could find an alternative job if they were looking (i.e., ease of movement), had a network of contacts to whom they could turn for job leads (i.e., networking), believed that better jobs were available to them (i.e., desirability of movement), and were more likely to have an alternative job offer in hand (i.e., crystallization of alternatives). On the other hand, the BCOMP-SF was only related to mobility, the perception that one could easily leave his or her current organization. Finally, the BCBM-SF was positively associated with career satisfaction, whereas the BCOMP-SF was negatively related to this outcome.
While relationships between the BCA-SF subscales and openness, proactive personality, and organizational commitment were of consistent magnitudes as prior research, relationships between the BCA-SF subscales and job satisfaction, job search, and career satisfaction were only partially consistent with previous research using the original BCA subscales. In one study comparison, the BCBM-SF predicted job search equally as well as the original scale; in two other study comparisons, the short form had a weaker relationship with job search than the long form. In addition, the relationship between the BCBM-SF and career satisfaction was equivalent to the relationship reported in prior research in one study comparison, but weaker in a second study comparison. Finally, in one study comparison, the BCOMP-SF had similar relationships with job satisfaction and career satisfaction as research using the long form, but in another study comparison, the short form exhibited stronger relationships with these variables.
Discussion
These results provide evidence for the validity of the PCA-SF and BCA-SF as assessments of protean and boundaryless career attitudes in two ways. First, the short form items adhere to the PCA and BCA dimensions proposed in previous research (Briscoe et al., 2006). More specifically, compared to a one-factor model, we found that a two-factor model provided superior fit to both the PCA-SF and BCA-SF data, which suggests that the scale items are assessing their respective constructs as theoretically expected. Second, this study also provided evidence that the PCA-SF and BCA-SF relate to personality and work and career constructs as theoretically expected. Further, we found that the magnitudes of the relationships between the shortened PCA and BCA scales and the examined antecedents and outcomes were often similar to the relationships of the original PCA and BCA scales and study variables. However, we note that in some cases, the short forms were more strongly related to theoretically relevant variables than the long forms (e.g., PCSD-SF with job satisfaction and organizational commitment), whereas in other cases, they were more weakly related (e.g., BCBM-SF with job search). It is possible that these somewhat mixed findings are a function of the equivocal results presented in prior research: While some studies report moderate relationships between theoretically relevant constructs, other studies report weak relationships between the same constructs. These differences may also be a consequence of different sampling strategies or operationalizations of study variables employed across studies. Given these possibilities, future research may evaluate relationships of the PCA-SF and BCA-SF scales with theoretically related variables in different samples or with different operationalizations of those constructs and compare these findings with previous research to strengthen inferences that they adequately assess protean and boundaryless career attitudes.
We also note that this study extends prior research by linking protean and boundaryless career attitudes with previously uninvestigated antecedents (i.e., Big Five personality factors) and outcomes (i.e., job market cognitions). By doing so, this study presents initial insights into the tendencies and mindsets of those who hold protean and boundaryless career attitudes. For instance, we found that tendencies to be extraverted, agreeable, and emotionally stable (i.e., not neurotic) were associated with workers who are self-directed and hold boundaryless mindsets; and these same workers are also likely to have positive evaluations of their abilities to acquire alternative employment.
Study 3: Measurement Invariance Between U.S. and Korean Samples
Building upon the prior studies that developed and provided initial validity evidence for the PCA-SF and BCA-SF, the goal of Study 3 is to investigate whether it is appropriate to use the PCA-SF and BCA-SF in a different cultural population, that is, Korean. Before the PCA-SF and BCA-SF are used to assess protean and boundaryless career attitudes in Korean samples, researchers should have evidence that the translated scales assess the same construct as the English scales or evidence of measurement equivalence (or invariance) across groups. Without measurement equivalence evidence, researchers are at risk of drawing erroneous conclusions about the constructs assessed in each group, such as invalid group differences in the mean-levels of a construct or inflated relationships among constructs in one group or another (see Chen, 2008). With this in mind, Study 3 evaluates the measurement equivalence of the PCA-SF and BCA-SF across U.S. and Korean samples to evaluate whether these scales adequately assess protean and boundaryless career attitudes in another cultural context.
Method
Participants and Procedure
Data from 295 U.S. adult workers were collected via MTurk; participants completed the survey for a nominal reward (U.S. $3.00). On average, participants were 33 years old (SD = 11.8) and had an organizational tenure of 4.5 years (SD = 5.5). Fifty-eight percent of respondents were male; 76% were White, 9% were Asian, 8% were Black, and 5% were Hispanic. About 38% of respondents had some college or an associate’s degree, 31% had a bachelor’s degree, 13% had graduate or professional training, and 10% had a high school diploma.
Data from 419 Korean adult workers were collected using an online panel survey firm; participants earned cash points for completing the survey. On average, participants were 37 years old (SD = 10.4) and had an organizational tenure of 9.7 years (SD = 8.0). Sixty-four percent of respondents were female. About 8% had a master degree, 68% had a bachelor’s degree, and about 24% had a high school diploma.
Measures
To assess protean and boundaryless career attitudes in English, we used the PCA-SF and BCA-SF developed in Studies 1 and 2. For the Korean sample, the items were first translated from English to Korean by the third author, who is proficient in both languages; the second author, who is bilingual, compared and examined the two versions. The two authors discussed any discrepancies between the two versions and revised the items until no more modifications were necessary. Throughout the translation process, the authors took into account (subtle, yet important) linguistic and sociocultural differences between the two populations, following the International Test Commission’s Test Adaptation Guidelines (Coyne, 2000).
Analysis and Results
To assess the measurement equivalence of the PCA-SF and BCA-SF across U.S. and Korean groups, we used multigroup confirmatory factor analysis with maximum likelihood estimation in MPlus version 5.1 (French & Finch, 2006; Raju, Laffitte, & Byrne, 2002; Reise, Widaman, & Pugh, 1993; Vandenberg & Lance, 2000). We assessed the fit of each measurement model using the chi-square statistic, the comparative fit index (CFI), the root mean square error of approximation (RMSEA), and the standardized root mean square residual (SRMR). In line with recommended practices (Cheung & Rensvold, 2002), we also compared “nested” models by evaluating the change in the chi-square statistic and CFI values; a change in a CFI value of .01 signifies a substantial difference in fit. Table 4 reports the results of these analyses.
Evaluation of the Measurement Equivalence of the PCA-SF and BCA-SF Across U.S. and Korean Samples.
Note. CFI = comparative fit index; RMSEA = root mean square error of approximation; SRMR = standardized root mean square residual; PCA-SF = Protean Career Attitudes Short Form; BCA-SF = Boundaryless Career Attitudes Short Form; OMP-SF = Organizational Mobility Preference Short Form.
**p < .01.
Single-Group CFA
Before testing for measurement equivalence, we first investigated whether a two-factor model adequately modeled the protean career and the boundaryless career data in each sample (U.S. and Korean) separately using single-group CFA (Byrne, Shavelson, & Muthen, 1989). First, we evaluated the PCA-SF in the U.S. sample and the Korean sample, separately. The two-factor model fit the U.S. PCA-SF data well (χ 2 = 50.04, df = 13; CFI = .95; RMSEA = .10; SRMR = .04). In the Korean sample, the two-factor model fit the PCA-SF data very well (χ 2 = 27.00, df = 13; CFI = .98; RMSEA = .05; SRMR = .03). Second, we evaluated the BCA-SF in the U.S. sample and the Korean samples. The two-factor model fit the BCA-SF data very well in the U.S. sample (χ 2 = 15.72, df = 8; CFI = .99; RMSEA = .06; SRMR = .04) and in the Korean sample (χ 2 = 27.11, df = 8; CFI = .98; RMSEA = .08; SRMR = .04). As the PCA-SF and BCA-SF adhered to the theoretically expected factor structure in both U.S. and Korean samples, we continued testing for measurement equivalence between the English and Korean versions of both scales.
Invariance of Covariance Matrices
We conducted two omnibus tests of the invariance of the covariance matrices for the PCA-SF and the BCA-SF (separately) across U.S. and Korean samples simultaneously. When covariance matrices are equivalent, groups are considered equivalent on a measure and no further tests of invariance are necessary (Vandenberg & Lance, 2000). However, the test of equivalence of covariance matrices is very strict and often untenable (Byrne et al., 1989). Not surprisingly, we failed to find invariance across matrices for the PCA-SF and the BCA-SF. Therefore, it was necessary to continue subsequent tests of measurement equivalence to identify the source of variance.
Configural Invariance
Next, we tested for configural invariance: an evaluation of whether items load on the same factor across samples or whether the pattern of factor loadings is similar across samples. Conceptually, evidence of configural invariance is support for the assumption that the same construct was assessed in both groups. To conduct this test, we fit the two-factor measurement model for both samples simultaneously (rather than sequentially as in the single group CFA). The configural invariance measurement model serves as the baseline model to which subsequent (more restrictive) tests of measurement equivalence are compared (Vandenberg & Lance, 2000). Thus, configural invariance must be established before conducting further tests of measurement invariance.
For both the PCA-SF and the BCA-SF data, configural invariance between U.S. and Korean groups was established: RMSEA values indicated acceptable fit and the CFI and SRMR values indicated that the models fit the data well (see Table 4). Thus, further tests of measurement equivalence were necessary to identify the source of variance between the two groups. The factor loadings of the PCA-SF and BCA-SF scale items for the U.S. and Korean samples are reported in Tables 5 and 6.
Standardized Factor Loadings, Item and Scale Means, and Reliability Coefficients for the Two-Factor Model of PCA-SF Across U.S. and Korean Samples.
Note. FL = factor loadings; α = internal consistency (Cronbach’s α reliability) estimate; m = scale mean; PCA-SF = Protean Career Attitudes Short Form.
Standardized Factor Loadings, Item and Scale Means, and Reliability Coefficients for the Two-Factor Model of BCA-SF Across U.S. and Korean Samples.
Note. FL = factor loadings; α = internal consistency (Cronbach’s α reliability) estimate; m = scale mean; BCA-SF = Boundaryless Career Attitudes Short Form.
aA reverse scored item.
Metric Invariance
Next, we tested for metric invariance—whether item factor loadings are invariant (equal) across groups—by constraining factor loadings to be equal across groups. Conceptually, evidence of metric invariance supports the assumption that the items are interpreted in a similar manner across groups. As suggested by Vandenberg (2002), we used exploratory factor analytic techniques (maximum likelihood estimation and a promax rotation) to identify referent indicators for each factor that were invariant across the U.S. and Korean samples (Schmitt & Kuljanin, 2008); the choice of referent indicator was important because referent indicators that vary across groups can bias results when identifying items that function differently across groups (Johnson, Meade, & DuVernet, 2009).
For the PCA-SF data, we found evidence of full metric invariance. The chi-square difference test revealed that there was no significant difference in fit between Model 1PC and the baseline (configural invariance) model (Δχ 2 = 4.65, p > .10), and the change in CFI was negligible (ΔCFI = .000). For the BCA-SF data, full metric invariance was not supported. Compared to the baseline model, Model 1BC showed a decrement in fit as evidenced by a significant increase in the chi-square value (Δχ 2 = 16.86, df = 4, p < .01) and a decrease in the CFI value (−.007), indicating that the factor loadings of one or more items differ between U.S. and Korean samples.
To identify the variant factor loading and establish partial metric invariance (where some but not all factor loadings are invariant across groups), we conducted a series of measurement invariance tests in which each item was constrained across samples (Cheung & Rensvold, 1999); if constraining an item resulted in a decrement in fit compared to the baseline model, then we concluded that the item with the constrained factor loading was the source of the variance. When Item 1 of the BCOMP-SF was held invariant across groups, there was a significant decrement in fit (Δχ 2 = 11.96, df = 1, p < .01), suggesting that this item varied across groups. Upon examining the factor loadings, we found that this item had a stronger factor loading in the U.S. sample (.70) than in the Korean sample (.56). Therefore, we retained a model (Model 2BC) where this parameter was allowed to vary across groups for subsequent tests of measurement invariance.
In sum, across U.S. and Korean samples, we found support for metric invariance for the PCA-SF and partial metric invariance for the BCA-SF. Evidence of full or partial metric invariance is sufficient to proceed to further tests measurement invariance (Vandenberg & Lance, 2000); therefore, we continued to test for scalar invariance.
Scalar Invariance
Scalar invariance is a test of whether item intercepts (i.e., item means) are equal across groups when the mean of the latent factor is zero. Conceptually, support for scalar invariance indicates that respondents from each group answer items similarly. Differences in item intercepts across groups may indicate either bias in how groups respond to items (i.e., measurement variance) or true differences in the mean level of the construct between groups (Vandenberg & Lance, 2000). As a theoretical reason for true group differences in protean or boundaryless career attitudes across U.S. and Korean samples has yet to be proposed, we considered it appropriate to proceed with tests of scalar invariance. Neither the PCA-SF (Model 2PC) nor the BCA-SF (Model 3BC) showed evidence for scalar invariance: when item intercepts were held constant across groups, both models showed a significant decrement in fit compared to the baseline model according to change in the chi-square and CFI values.
To further investigate why scalar invariance was not supported, we compared the item means for the U.S. and Korean groups using a series of t-tests (see Tables 5 and 6 for item means). We found that the Korean sample was less likely than the U.S. sample to agree with PCVD items (t-values ranging from 3.11 for PCVD Item 2 to 6.17 for PCVD Item 1), whereas there was no significant difference between the U.S. and Korean samples’ likelihood of agreeing with the PCSD items (t-values ranging from .26 for PCSD Item 2 to −1.80 for PCSD Item 4). In addition, we found that the Korean sample was less likely to agree with the BCBM items (t-values ranging from 3.51 for BCBM Item 3 to 9.49 for BCBM Item 2) and more likely to disagree with BCOMP Item 1, t(733) = −9.44, p < .01 (when not reverse coded).
Discussion
This study provides evidence of the measurement invariance of the PCA-SF and BCA-SF across U.S. and Korean samples, suggesting that it is appropriate to use these scales to assess protean and boundaryless career attitudes in Korean samples. Specifically, full metric invariance was established for the PCA-SF, while partial metric invariance was established for the BCA-SF. Subsequently, we discuss these findings and their practical implications.
Evidence for metric invariance has two implications for the use of the PCA-SF and BCA-SF. First, based upon this evidence, one can infer that respondents from the U.S. and Korea perceive a similar psychological construct or hold a similar frame of reference when interpreting items (i.e., configural invariance). Second, it suggests that each item is being interpreted similarly across the U.S. and Korean samples (i.e., metric invariance). Based upon this study, the PCA-SF has both of these attributes. The BCA-SF, on the other hand, falls just short; U.S. and Korean respondents interpret items similarly with the exception of Item 1 of the BCOMP-SF subscale: “I would feel very lost if I couldn’t work for my current organization” [reverse coded]. This item was more strongly related to the latent BCOMP factor for U.S. respondents than Korean respondents, and Korean respondents were more likely to disagree with the item (when it was not reverse coded). It may be the case that, compared to U.S. respondents, Korean respondents may construe themselves as belonging to multiple social groups such that the loss of membership in one social group (e.g., organizational member) is compensated for by membership in other groups (e.g., family, church, and community). Although differences between samples exist, evidence of partial metric invariance is sufficient for using the BCA-SF in Korean samples (Byrne et al., 1989; Reise et al., 1993).
Additionally, we note that neither the PCA-SF nor the BCA-SF showed evidence of scalar invariance. As mentioned earlier, we tested for scalar invariance because researchers have yet to propose a theoretical rationale for why U.S. and Korean workers may approach their careers differently. However, the lack of scalar invariance in this study raises the question of whether there are sociocultural factors that influence career approaches in different countries (e.g., work values); on the other hand, noninvariant intercepts across U.S. and Korean groups may indicate measurement artifacts (Chen, 2008). As such, this study raises some issues for future research in the area of careers, particularly how careers may be manifested differently across national cultures or whether individuals from different cultures respond to items differently, in general (e.g., Tay, Woo, Klafehn, & Chiu, 2010). Finally, based upon this study, researchers may consider using these scales in organizational and careers research not only in the United States, but also in Korea. Thus, this study contributes to careers research by providing an additional resource for careers researchers interested in investigating career approaches in Korea.
Conclusion
In an effort to provide a more efficient assessment of protean and boundaryless career attitudes, the three studies presented here developed and offered a variety of validity evidence for the PCA-SF and BCA-SF in both U.S. and Korean populations. We developed the PCA-SF and BCA-SF and provided validity evidence for their use by confirming their internal factor structures and evaluating whether they exhibit theoretically expected relationships with personality antecedents and work and career outcomes. Moreover, we statistically compared the current findings with findings from previous research using the full length measures, which revealed that the PCA-SF and BCA-SF relate to personality antecedents and work and career outcomes in a similar (but not the same) manner as the full-length measures. Finally, we extended the use of the PCA-SF and BCA-SF to a new cultural context (Korean), enabling researchers to more confidently use these scales for future cross-cultural research. Taken together, these findings suggest that the PCA-SF and BCA-SF are useful assessments of protean and boundaryless career attitudes in both U.S. and Korean samples.
Footnotes
Appendix
Acknowledgments
Part of this research was supported by the Research Grant of Kwangwoon University in 2013.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
