Abstract
The present study investigates the psychometric properties of decent work utilizing the bifactor exploratory structural equation modeling (Bifactor-ESEM) approach. Using a sample of 701 Chinese employees who completed the multidimensional Decent Work Scale (DWS: Duffy et al., 2017), this study reveals the superiority of the Bifactor-ESEM representation of DWS compared to alternative representations of the data (ICM-CFA, Bifactor-CFA, and ESEM). Additionally, the results of measurement invariance in the MIMIC framework indicate the DWS is equivalent in various age and job tenure samples of participants. Finally, the results provide evidence for the criterion validity by confirming the importance of accounting for both the G-factor (representing the global level of decent work) and the S-factors (representing the specific level of decent work), which shows that specific types of decent work explained variance in covariates (i.e., work well-being, life well-being, engagement, and turnover intention) over and above the variance already explained by the G-factor.
Keywords
Although decent work plays a significant role in meeting human needs, enhancing self-worth, and fulfilling individual well-being (Blustein et al., 2019; Duffy et al., 2016), it becomes increasingly difficult to obtain, especially for those living in marginalization or poverty (Blustein et al., 2016). For instance, unpredictable circumstances (e.g., the challenges of profound changes in globalization, advances in artificial intelligence technology, and ebbs and flows of the Novel Coronavirus Pneumonia unseen in a century) cast a shadow on the working situation. In light of these volatile circumstances, the International Labor Organization (ILO, 1999) first proposed the notion of decent work to emphasize the necessity of ensuring that employed individuals have access to decent work conditions regardless of individual characteristics. Duffy and colleagues (2016) further defined decent work as the centerpiece of well-being and work fulfillment from the Psychology of Working Theory (PWT; Blustein, 2006; 2013) perspective. They also developed the reliable and valid Decent Work Scale (DWS; Duffy et al., 2017) to evaluate individuals’ perceptions of their work conditions.
To date, many studies conducted under the PWT framework have demonstrated the prominent role of decent work using the DWS (Duffy et al., 2021). As a promising and inclusive theoretical framework, PWT reckons with decent work as a basic human right vital for individuals' lives (Blustein et al., 2019; Duffy et al., 2016), and interprets the contextual predictors and outcomes for decent work (Duffy et al., 2019). Proliferated empirical studies on decent work demonstrate that the structural and psychological context of work and non-work (i.e., economic constraints, marginalization experiences, work volition, and career adaptability) are crucial antecedents of decent work (Blustein et al., 2019; Duffy et al., 2019; Smith et al., 2020). Moreover, decent work positively affects individuals’ well-being (i.e., job and life satisfaction; Autin et al., 2019; Duffy et al., 2017; Masdonati et al., 2021), work meaning (Di Fabio & Kenny, 2019; Ribeiro et al., 2019), engagement (Ferreira et al., 2019), positive affect (Duffy et al., 2019), and affective commitment (Huang et al., 2021). However, decent work is negatively associated with individuals’ turnover intention (Buyukgoze-Kavas & Autin, 2019; Vignoli et al., 2020), burnout (Ferreira et al., 2019), depression (Nam & Kim, 2019), and negative affect (Duffy et al., 2019). On the other hand, the DWS changes across time following the PWT, which focuses on an individual’s experience during their lifespan. Some researchers discovered that the construct changes over time and provides insight into the connections between predictors (Duffy et al., 2020) and meaningful work and decent work. In general, these studies have contributed to the literature on PWT and have shown that the DWS is reliable and valid.
However, because organizational phenomena are complex, researchers usually use the total score and five subscale scores when investigating the predictors and outcomes associated with decent work in the PWT (e.g., Ribeiro et al., 2019; Wang et al., 2019). In this context, emphasizing the importance of the entire scale and subscales, as well as their relative strength, is beneficial for future decent work studies (Giordano et al., 2020). Morin, Arens, and Marsh (2016) developed the bifactor exploratory structural equation modeling (Bifactor-ESEM) as a framework for accounting for psychometric multidimensionality (e.g., global level of decent work and specific level of decent work) and accurately defining complex psychological characteristics. Accordingly, the current study aims to provide an improved representation of the structure of the DWS while relying on the Bifactor-ESEM framework. Additionally, we use measurement invariance tests to verify the extent to which it generalizes through age and job tenure to similar samples of participants. In a further test of the criterion-validity of the DWS factors, we assess the relations between DWS factors (both G-factor and S-factors) and work well-being, life well-being, engagement, and turnover intention.
Decent Work in China
In the Chinese context, contextual factors have been proven to significantly impact the attainment of decent work and well-being (Chen et al., 2020; Wang et al., 2019). The labor market has transitioned toward a free-market model of hiring and firing with reforms over the past 40 years, resulting in fierce workplace competition and instability. In this context, the household registration system (Hukou, in Chinese) classifies citizens as rural or urban residents, affecting their rights and access to some resources (Wang et al., 2019). Rural migrant workers face insurmountable barriers to equal opportunity in employment and social security provision. They may encounter labor market discrimination and are mostly engaged in informal employment that pays low wages, lacks security and protection, and is not accompanied by a formal employment contract (Cooke et al., 2019). Moreover, with the fierce workplace competition and financial pressure, Chinese employees may have excessive overtime. China has emerged with a “996” work culture, referring to working 12 hours a day (9 a.m.–9 p.m.) and 6 days a week (Bloomberg, 2019). Compared to other nations, Chinese workers work longer hours and have inadequate free time and rest (Nie et al., 2015). Furthermore, Guanxi refers to interpersonal connections and social networks, which significantly influences the potential resource that facilitates job promotion and career success (Chen et al., 2013). The relevance of cross-cultural concepts shows that, according to PWT, contextual factors affect career choices. Thus, it is crucial to provide more accurate evidence for decent work in the Chinese context.
Measurement of the Decent Work
The DWS, which is widely recognized in the PWT literature (Duffy et al., 2019; Wang et al., 2019), consists of 15 items and five dimensions: physically and interpersonally safe working conditions; access to healthcare; adequate compensation; hours that allow for free time and rest; and organizational values that complement family and social values (Duffy et al., 2017). The instrument has been used with diverse samples, such as sexual minorities (England et al., 2020; Tebbe et al., 2019), minoritized racial/ethnic groups (Douglass et al., 2017; Duffy et al., 2019), and colleges (Kim et al., 2019). Moreover, the DWS is also commonly accepted in various countries and cultural settings, including the United States (Duffy et al., 2019; Duffy et al., 2020), Australia (McIlveen et al., 2021), China (Wang et al., 2019), South Korea (Kim et al., 2019), and Sub-Saharan Africa (Atitsogbe et al., 2021). Accordingly, this instrument has received psychometric evidence for its reliability and predictive, convergent and discriminant validity.
Despite the robust psychometric properties reported in previous studies, there remain limitations on the validity of the DWS (Duffy et al., 2017; Dodd et al., 2019). The limitations are as follows: (a) CFA, the widely accepted approach to assessing the structure of psychological constructs, is increasingly questioned due to independent cluster assumption (ICM) (Su et al., 2019). Marsh et al. (2014) argued that this assumption is impractical and excessively strict for instruments measuring complex multidimensional dimensions. The ICM-CFA model is highly unidimensional, which means each item can only reflect on a latent factor. It cannot explain a common but important issue in multidimensional variable domains that two sources and their relative strength of construct-relevant psychometric multidimensionality (Giordano et al., 2020). Even the model fit is satisfactory, the factor correlations may be inflated (Asparouhov et al., 2015; Morin, Arens, Tran, & Caci, 2016). (b) In contrast, the Bifactor model, practical and acceptable in vocational domains, makes it easy to address these questions (Giordano et al., 2020). It provides a flexible alternative model (Morin, Arens, & Marsh, 2016), which allows the total item covariance matrix to be directly separated into one global factor and a series of specific factors, but not only explained by one global factor. Several studies have investigated the psychometric properties of decent work utilizing the Bifactor-CFA model (Duffy et al., 2017; Di Fabio & Kenny, 2019; Nam & Kim, 2019), which discovered that both the general factor and specific factors of decent work are present concurrently. Despite these promising results, Bifactor-CFA may report inaccurate estimates because it neglects the possibility that items may have cross-loadings on non-target specific factors, inflating the general factor’s variance (Morin, Arens, & Marsh, 2016). The CFA and a Bifactor-CFA model are presented on the left side of Figure 1. Therefore, a look into the construct-multidimensionality of decent work using more precise and scientific methods is warranted to provide an accurate conclusion. Graphical representation of the alternative models. Note. ICM-CFA = Independent cluster confirmatory factor analysis; ESEM = exploratory structural equation modeling; Bifactor-CFA = bifactor confirmatory factor analysis; Bifactor-ESEM = bifactor exploratory structural equation modeling; D1–D15 = Items; G = Global decent work factor; S1-S5 = Specific decent work factors, S1 = Safe working conditions, S2 = Access to adequate health care, S3 = Adequate compensation, S4 = Free time and rest, S5 = Complementary values.
The Bifactor Exploratory Structural Equation Modeling (Bifactor-ESEM) Framework
Although exploratory factor analysis (EFA) provides more precise estimates of latent factor correlations than CFA and is considered necessary for construct-relevant multidimensionality, it has frequently been questioned for being data-driven and unsuitable for confirmatory studies (Howard et al., 2018). In contrast, CFA relies on models that are assumed to be theory-driven. Asparouhov and Muthén (2009) established Exploratory Structural Equation Modeling (ESEM) by combining the advantages of each technique and incorporating them into an overarching structural equation modeling (SEM) framework. This model provides an appropriate model to investigate the source of multidimensionality due to the associations between indicators and the non-target construct in the form of cross-loadings (Su et al., 2019). ESEM yields better discriminant validity by providing more accurate and lower estimates of factor correlations (Asparouhov & Muthén, 2009; Morin, Arens, & Marsh, 2016). The ESEM solution, however, is still limited since it ignores the latent hierarchically higher-order factor, which may inflate cross-loadings (Morin et al., 2016). In practice, both generality and specificity are affirmed in the structure of decent work (Duffy et al., 2017). That is, individuals not only have a gestalt of perceptions of decent work conditions but also perceptions of five specific components of decent work conditions. For instance, a university professor may highly rate their work conditions as decent, yet, they may perceive having inadequate free time and time for rest due to various tasks. According to PWT, both global and specific perceptions of decent work are crucial for the fulfillment of essential human needs and individual well-being (Blustein et al., 2019). Thus, it might not be feasible to use ESEM to look into the psychometric features of decent work.
Morin, Arens, and Marsh (2016) further proposed the comprehensive and flexible Bifactor-ESEM approach, which integrates the Bifactor and ESEM models into an analytical framework to account for both relevant sources of psychometric multidimensionality. The ESEM and Bifactor-ESEM model are shown on the right side of Figure 1. The Bifactor-ESEM model, in theory, overcomes the shortcomings of the ICM-CFA, Bifactor-CFA, and ESEM models, which can better interpret complex psychological characteristics. Given these advantages, researchers have regarded this approach as a promising alternative to describing complex dimensional structures (Morin, Arens, Tran, & Caci, 2016; Howard et al., 2018). Several researchers have used this method to investigate multidimensional constructs, such as the short version of the workplace affective commitment scale (Perreira et al., 2018), the basic psychological needs at work scale (Sánchez-Oliva et al., 2017), and the engaged teacher scale (Perera et al., 2018). In summary, the Bifactor-ESEM model is recommended for verifying construct-relevant psychometric multidimensionality.
The Present Study
First, this research provides a substantive illustration of the sources of construct-relevant psychometric multidimensionality using Chinese working adults’ responses on the Decent Work Scale. Several alternative measurement models (ICM-CFA, Bifactor-CFA, ESEM, and Bifactor-ESEM) were compared initially to achieve this objective.
Second, although recent research revealed the complex dimensional structures through the Bifactor-ESEM solution, they didn’t conduct measurement invariance tests (Howard et al., 2018; Tóth-Király et al., 2019) or only focused on the gender variable when validating the generality of scale (Morin, Arens, & Marsh, 2016; Sánchez-Oliva et al., 2017). Indeed, it is crucial to demonstrate whether the representation generalizes to similar samples of participants like age or tenure (Sánchez-Oliva et al., 2017; Tóth-Király et al., 2018). In practice, the older workers may experience discrimination due to stereotypes, thus resulting in higher insecurity about work conditions. And the actual duration of the Medical Period and annual paid leave depends on job tenure, according to Chinese Labor Law. On the other hand, empirical research also found that employees’ perceptions about decent work may be influenced by their age and tenure. A meta-analysis (Ng et al., 2005) discovered a positive correlation between age, job tenure, and salary separately. Duffy et al. (2017) also observed a positive relationship between tenure and the dimension “Access to healthcare.” Thus, we investigated whether the DWS measurement is equivalent in age and tenure in the multiple-indicator-multiple-causes (MIMIC) framework through three alternative invariance conditions.
Third, to assess the criterion-related validity of the DWS, the present study adopted the optimal model emerging from the first phase of analysis to examine the relations between the relevant constructs and work well-being, life well-being, engagement, and turnover intention. These outcome variables are drawn from theory and practice. They are essential elements in interpreting the PWT and have been demonstrated positively linked to decent work (Autin et al., 2019; Huang et al., 2021). These variables can assist managers in grasping the importance of decent work and the cause of individuals' well-being, engagement, and turnover intention in practice, on the other hand. To explore additive effects, we systematically compared the added value from the model with only the G-factor and the complete model (including G-factor and S-factor) using the ESEM-within-CFA (EWC; Morin et al., 2013; Morin, Arens, & Marsh, 2016) method.
Method
Participants and Procedure
This study consists of 701 working adults in China, including 360 males (51.4%) and 341 females (48.6%), with a mean age of 30.32 years (SD = 7.13; ranging from 19 to 64 years). Education level is categorized as undergraduate degree (n = 440, 62.8%) and below (n = 90, 12.8%), and master degree (n = 165, 23.5%) or above (n = 6, 0.9%). The average job tenure of participants is 8.11 years (SD = 7.57), and the average weekly hours is 45.54 hours (SD = 9.93). Participants were employed in various occupations. For example, firm employees (n = 278, 39.6%), health care workers (n = 175, 25.0%), educators (n = 87, 12.5%), scientific researchers (n = 14, 2.0%), civil servants (n = 19, 2.7%), as well as others (n = 127, 18.1%).
The survey was created and distributed through an online survey website (http://www.obhrm.com/) in China. Following the American Psychological Association Ethics Code Principles and Standards (2017, Standard 9), we delivered an online informed consent on the first page of the survey, which stated the voluntary nature of participation and assurance of confidentiality and anonymity. The questionnaires also include the decent work scale, the scale of related constructs, and demographic information such as gender, age, job tenure, and weekly work hours. In the present study, 851 participants filled out the questionnaires. A total of 701 responses (82.37% response rate) were retained for analysis after eliminating fast responses (response time faster than 2 seconds per item, Huang et al., 2012), pattern answers (e.g., 111111, 555555, DeSimone et al., 2015), and outliers using the Mahalanobis distance (Meade & Craig, 2012). There were no missing responses due to the online questionnaire design. Moreover, the absolute values of skewness and kurtosis under two in the data met the criteria for univariate normality (skewness <3 and kurtosis <10; Chou & Bentler, 1995; Kline, 2005), suggesting non-normality of the data is not considered to be problematic.
Measures
We used Brislin’s (1980) translation and back-translation approach to translate the Decent Work Scale (DWS; Duffy et al., 2017) into Chinese. All items were independently translated into Chinese by two bilingual authors and reached a consensus on the translation of the scale. And then, all authors discussed the discrepancies and inconsistencies between the back-translated version and the original version, following the back translation of the Chinese version of DWS by the third author. Finally, we confirmed the definitive Chinese version of DWS. Additionally, all instruments are graded by a 5-point Likert-type scale (1 = strongly disagree; 5 = strongly agree).
Decent work
Decent work was measured using the DWS (Duffy et al., 2017), which consists of 15 items assessing five components (i.e., safe working conditions, adequate compensation, free time and rest, access to health care, and complementary values). The sample item is, “I get good healthcare benefits from my job.” In the original study of scale development, Duffy et al. (2017) revealed acceptable internal consistency reliability (ranged from .82 to .97). In the present study, the internal consistency for the total DWS score was .90. Furthermore, internal consistency reliability is acceptable for the subscales of safe working conditions (α = .75), access to healthcare (α = .84), adequate compensation (α = .88), free time and rest (α = .82), and complementary values (α = .90).
Work well-being
The Work Well-Being subscale of the Employee Well-Being Scale (EWB) developed by Zheng et al. (2015) was used to measure respondents' well-being at their current work. It comprises of six items. A sample item is, “I am satisfied with my work responsibilities”. Zheng et al. (2015) reported good reliability (α = .92) and significant relations with job satisfaction, affective organizational commitment, turnover intention, and job performance among Chinese working adults. In present study, the internal consistency was .89.
Life well-being
We used the Life Well-Being subscale of the EWB (Zheng et al., 2015) to evaluate their perception of life well-being. Which is a six items self-report inventory, a sample item as the following: “Most of the time, I do feel real happiness”. Zheng et al. (2015) reported that the scale’s internal consistency was higher than .90, which was significantly associated with job satisfaction, affective organizational commitment, turnover intention, and job performance among Chinese employees. Cronbach’s alpha was .90 in the present study.
Engagement
The Chinese version of the Utrecht Work Engagement Scale (UWES) was utilized to evaluate participants’ work engagement. Recently, Schaufeli et al. (2019) introduced the shorter version of UWES, which has three items and indicates the extent to which an individual engages in their work. Sample items are as follows: (1) “At my work, I feel bursting with energy” (vigor); (2) “I am enthusiastic about my job” (dedication); (3) “I am immersed in my work” (absorption). Reliability and validity evidence presented in the original study (Schaufeli et al., 2019). According to Xu et al. (2022), the scale had good reliability (higher than .80) and was significantly associated with work need satisfaction and life well-being in the Chinese context. In the present study, Cronbach’s alpha was .85.
Turnover intention
The Chinese version of the Turnover Intention Scale initially developed by Mobley et al. (1978) was adopted to measure participants’ intention to leave from their current organization. It comprises of four items, and a sample item is, “I will search for other alternative job opportunities”. Wang et al. (2019) found the scale has good internal consistency reliability (α = .87) and is significantly associated with work volition and decent work in the Chinese context. The estimated internal consistency of the scale in the current study was .90.
Statistical Analyses
Model estimation
In the first phase, we estimated and contrasted ICM-CFA, Bifactor-CFA, ESEM, and Bifactor-ESEM representations of participants’ responses to the DWS. In the ICM-CFA model, items were only allowed to load onto the priority factors of decent work, and the correlation between the factors was freely estimated, but the cross-loadings on other factors were not allowed. In the Bifactor CFA model, items were specified to simultaneously load onto one general factor and five specific factors, and G-factor and S-factor were specified as orthogonal, meaning they did not allow correlations with one another (Morin, Arens, & Marsh, 2016). Notedly, this orthogonality is a prerequisite to the proper disaggregation of the covariance into the G-factor and the S-factors components (Giordano et al., 2020; Reise, 2012). In the ESEM model, all cross-loadings were also freely estimated like the ICM-CFA model while “targeted” to be close to zero using target rotation (Morin, Arens, & Marsh, 2016). Finally, the Bifactor-ESEM model was estimated under classic bifactor assumptions, and all items were allowed to concurrently define a G-factor as well as the five S-factors in a confirmatory manner using an orthogonal bifactor target rotation procedure. We then reported omega coefficients of composite reliability estimated from the alternative models, calculated as ω = (Σ|λi|)2/([Σ|λi|]2 + Σδii) where λi stands for the factor loadings and δii corresponds to the error variances (McDonald, 1970).
Measurement invariance
In the second stage of the analysis, we applied the measurement invariance tests to investigate age and tenure differences in responses to the DWS based on the most appropriate model. The multiple-group approach provides full flexibility in assessing the measurement invariance of the optimal measurement model but might not be practical for continuous variables, multiple contrast variables, and their interactions (Morin, Arens, & Marsh, 2016). If the continuous variables (e.g., age) are divided into broad categories, there will be a significant loss of information (Marsh et al., 2013). In contrast, the MIMIC approach provides an appropriate and parsimonious approach to evaluating measurement invariance (Marsh et al., 2013; Morin, Arens, & Marsh, 2016), which permits both categorical and continuous individual difference variables, as well as their interactions. To prevent suboptimal categories in age and job tenure, the present paper adopted the MIMIC approach to evaluate measurement invariance.
By comparing three nested MIMIC models, potential non-invariance of item intercepts was assessed, that is, differential item functioning (Monotonic DIF). In the first (null effect) model, the predictor’s influence on latent means and items’ intercepts were constrained to be zero; in the second (saturated) model, the predictor’s influence on items’ intercepts was freely estimated, but not the latent means. The third (invariant) model assumes the invariance of items’ intercepts across levels of the predictors, which were allowed to influence all latent means but not items’ intercepts. We verified whether the predictors have an effect by comparing the second, third, and first models. Then, the comparison of the second and third models tested whether the effects of the predictors on the items were fully explained by their effects on the latent means, or demonstrated Monotonic DIF. Based on this, the MIMIC approach was adopted to assess the measurement invariance of DWS.
Criterion validity
To provide evidence for the validity of the DWS, we assessed the criterion-related validity of the various decent work factors in the third phase of the analysis. More precisely, we assessed two models: (a) In the first model, both the G-factor (representing the overall level of employees’ decent work) and the S-factors (representing the specific level of employees’ decent work) were allowed to predict all criterion-related variables while simultaneously accounting for the impact of G-factor and S-factors. (b) The second model, consistent with previous research (Howard et al., 2018; Tóth-Király et al., 2019), exclusively explored the G-factor predictive effect using the ESEM-within-CFA (EWC) approach (Morin et al., 2013; Morin, Arens, & Marsh, 2016), which do not investigate the S-factors' predictive effect. And then, we compared the information: the indices of the goodness of fit, standardized regression coefficients (β), and the percentage of explained variance (R2) in the covariates.
Goodness-of-fit assessment
We conducted all statistical analyses in Mplus 8.5 (Muthén & Muthén, 1998–2017). Items with five categories were treated as continuous (Rhemtulla et al., 2012; Sass et al., 2014). Models were assessed by the following fit indices: the χ2 (χ2 with a significant p value), comparative fit index (CFI), Tucker-Lewis index (TLI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). According to typical interpretation guidelines (Hu & Bentler, 1999), values greater than .90 and .95 for the CFI and TLI are respectively considered to indicate an adequate and excellent fit to the data, whereas values smaller than .08 or .06 for the RMSEA and SRMR, respectively support an acceptable and excellent fit. Notedly, in line with previous research (Morin et al., 2016; Perera, 2016; Tóth-Király et al., 2018), nested models in MIMIC tests were compared by considering changes (Δ) in goodness-of-fit indices, just like the multiple-group approach. A decrease in the CFI and an increase in RMSEA of less than .01 and .015, respectively, are suggestive of support for a more restrictive model (Chen, 2007; Cheung & Rensvold, 2002).
Results
Factor Structure and Reliability
Goodness-of-Fit Statistics for the Estimated Models.
Note: N = 701. ICM-CFA = independent cluster model-confirmatory factor analysis; Bifactor-CFA = bifactor confirmatory factor analysis; ESEM = exploratory structural equation modeling; Bifactor-ESEM = bifactor exploratory structural equation modeling; χ2 = robust chi-square statistic test of exact fit; df = degrees of freedom; CFI = comparative fit index; TLI = Tucker-Lewis index; RMSEA = root mean square error of approximation; 90% CI = 90% confidence interval; SRMR = standardized root mean square residual.
*p < .05; ** p < .01; *** p < .001.
Standardized Factor Correlations for the ICM-CFA (Below the Diagonal) And Five Factor ESEM (Above the Diagonal) Solutions.
Note: N = 701. ICM-CFA = independent cluster model-confirmatory factor analysis; ESEM: exploratory structural equation modeling; Safe = Safe working conditions, Health = Access to adequate health care, Comp = Adequate compensation, Rest = Free time and rest, Values = Complementary values. *p < .05; ** p < .01; *** p < .001.
Standardized Factor Loadings (|λ|) and Uniquenesses (δ) for the ICM-CFA and ESEM solutions.
Note: ICM-CFA = independent cluster model-confirmatory factor analysis; ESEM: exploratory structural equation modeling; ω = omega coefficient of composite reliability; Safe = Safe working conditions, Health = Access to adequate health care, Comp = Adequate compensation, Rest = Free time and rest, Values = Complementary values; λ: Factor loading; δ: Item uniqueness; Target factor loadings are in bold. Non-significant parameters (p ≥ .05) are marked in italics.
Standardized Factor Loadings (|λ|) and Uniquenesses (δ) for the Bifactor CFA and ESEM solutions.
Note: Bifactor-CFA = bifactor confirmatory factor analysis; Bifactor-ESEM = bifactor exploratory structural equation modeling; G-Factor = Global decent work factor; S-Factor = Specific decent work factors; ω = omega coefficient of composite reliability; Safe = Safe working conditions, Health = Access to adequate health care, Comp = Adequate compensation, Rest = Free time and rest, Values = Complementary values; λ: Factor loading; δ: Item uniqueness; Target factor loadings are in bold. Non-significant parameters (p ≥ .05) are marked in italics.
Measurement Invariance
Test of Measurement Invariance of DWS Across Age and Job Tenure.
Note: N = 701. χ2 = robust chi-square test of exact fit; df = degrees of freedom; CFI = comparative fit index; TLI = Tucker-Lewis index; RMSEA = root mean square error of approximation; 90% CI = 90% confidence interval of the RMSEA; CM = comparison model; ∆ = change in fit information relative to the CM; *p < .05; ** p < .01; *** p < .001.
First, the model of null effect (M1) was tested by constrained latent means and items’ intercepts of predictors to be zero, providing a satisfactory fit to the data across age and job tenure. The indices for age are: χ2 (45) = 75.42, p < .01, CFI = .995, TLI = .986, RMSEA = .018. Indices for job tenure are: χ2 (45) = 67.14, p < .05, CFI = .996, TLI = .990, RMSEA = .026. Fit indices of models suggest age and job tenure have limited effects on the factor structure.
Next, the saturated model (M2) and invariant model (M3) were then progressively assessed by constraining the latent means to be zero and constraining the items’ intercepts to be zero. The fit indices do not exceed the recommended guidelines (ΔCFI and ΔTLI <.01, ΔRMSEA <.015) by comparison of the invariant model and null effect model, the invariant model, and null effect model, further supporting that the effects of the predictors (age and job tenure) are not limited to latent means. And then, there is no evidence supporting monotonic DIF (ΔCFI and ΔTLI <.01, ΔRMSEA <.015) through contrasted the saturated model and invariant model. Thus, the Bifactor-ESEM representation of the DWS did not differ significantly between age and job tenure.
Criterion Validity
Relations with Covariates: Standardized Coefficients
Note: G-factor = the global level of decent work; Safe = Safe working conditions, Health = Access to adequate health care, Comp = Adequate compensation, Rest = Free time and rest, Values = Complementary values; *p < .05; ** p < .01; *** p < .001.
As expected, there are some significant relationships between the S-factors of decent work and the covariates. “Safe working conditions” factor positively correlates with work well-being (β = .17, p < .001), life well-being (β = .22, p < .001), and engagement (β = .25, p < .001). “Adequate compensation” factor negatively relates with turnover intention (β = −.07, p < .05) “Complementary values” factor significantly associates with work well-being (β = .09, p < .05), and turnover intention (β = −.09, p < .05). In summary, the results provide evidence for the criterion validity of the DWS by the additive effect.
Discussion
The present study aimed to investigate the psychometric properties of the DWS using the Bifactor-ESEM in the Chinese context. The Bifactor-ESEM framework is the appropriate approach to assess two sources of construct-relevant psychometric multidimensionality in organizational research (Perreira et al., 2018). Based on the Bifactor-ESEM representation, we further conducted the test of measurement invariance to verify whether the DWS is equivalent in various individuals (i.e., age and job tenure). Additionally, we also investigated the criterion validity through testing the relations between the Bifactor-ESEM representation of decent work and outcomes (i.e., work well-being, life well-being, engagement, and turnover intention).
First, this study revealed and verified the multidimensional construct of DWS using the Bifactor-ESEM approach in the Chinese context (Morin et al., 2016). The Bifactor-ESEM solution is more satisfactory, which simultaneously considers the global decent work and the five specific decent work factors in a single model that is not tainted by inflated factor correlations or measurement errors. Concretely, the results, on the one hand, strongly support the proposition that the Bifactor-ESEM solutions are superior to other solutions (ICM-CFA, Bifactor-CFA, and ESEM) (Morin, Arens, & Marsh, 2016; Howard et al., 2018; Perreira et al., 2018). Although the ESEM model provides more precise and lower estimates of factor correlations than ICM-CFA and Bifactor-CFA, the Bifactor-ESEM model, consistent with real-life decent work, shows a marginally better fit to the data but reveals a well-defined G-Factor (ω = 0.88) accompanied by lower cross-loadings. On the other hand, the results from the remained Bifactor-ESEM solution are in line with previous studies (Duffy et al., 2017; Di Fabio & Kenny, 2019; Ferreira et al., 2019), providing a more accurate consequence when defining both sources of psychometric multidimensionality.
Apart from the construct validity, the DWS also reports acceptable reliability. Especially, the subscale score accounts for a substantive amount of variance beyond the G-factor when the composite reliability of a specific factor met the criterion (ω > 0.5; Perreira et al., 2018). The findings show that the specific factors of health care (ω = 0.64), time and rest (ω = 0.71), and complementary values (ω = 0.62) had a substantial amount of specificity of its own, but the specific factors of safe work conditions (ω = 0.44) and adequate compensation (ω = 0.46) are marginally satisfactory. That implies the fact that the structure of decent work taps into meaningful specificity once considering the G-factor (Sánchez-Oliva et al., 2017). And two target loadings of safe work conditions and three target loadings of adequate compensation exceed 0.3, indicating that the two specific factors still have an acceptable level of specificity beyond the G-factor (Gu et al., 2020). Briefly, the DWS has satisfactory reliability and stable multidimensional construct validity in the Chinese context, which extends previous studies (Duffy et al., 2017; Masdonati et al., 2021) and may facilitate cross-cultural empirical research progress on decent work in China.
Second, the results of measurement invariance tests in a MIMIC framework revealed that the DWS was found to generalize to various age and job tenure samples of participants. Previous scholars believed that splitting the variables rely on the mean to create two categorical groups may simplify individual differences and lead to limited conclusions (MacCallum et al., 2002). Accordingly, age and job tenure are classic continuous variables, measurement invariance tests utilized the MIMIC approach in the present study to prevent suboptimal age and job tenure categorization. The MIMIC framework is a more parsimonious and appropriate approach to test measurement invariance when the tested variables are continuous (Morin, Arens, & Marsh, 2016; Tóth-Király et al., 2018). The minimal change in fit indices of the null effect model, the saturated model, and the invariant model indicates that the DWS could be used equally for various age and job tenure of participants.
Third, based on PWT, this research investigated the criterion validity of the Bifactor-ESEM solution, underlining the importance of considering both the G-factor and S-factor with the regression coefficients and higher proportion of explained variance in well-being, engagement, and turnover intention. Results suggest that employees' work well-being, life well-being, engagement, and turnover intention are greatly predicted by their global level of decent work. More precisely, whereas decent work is positively linked with individuals' well-being (i.e., work and life) and engagement, it is negatively related to individuals' turnover intention. This is in line with the assertion of PWT that global decent work is associated with increased well-being and work fulfillment (Blustein et al., 2016). Besides, the results also show that some S-Factors uniquely predict higher levels of well-being (i.e., work and life) and engagement, and lower levels of turnover intention, over and above the predictive effects of employees' global levels of decent work, which also support PWT.
Practical Implications
Although recent studies on decent work have confirmed the reliability and validity of DWS, the conclusion might be inaccurate due to the limitations of the method. The Bifactor-ESEM framework was used in this research to demonstrate the psychometric properties of the DWS in the Chinese context. The current study provides practitioners with a useful instrument for assessing employees' work environments, and proposing improvements. The reliable and valid measurement tool also facilitates vocational research in China and contributes to cross-cultural empirical research progress on PWT. Specifically, future studies could identify the different impacts of the structural and psychological context on both the G-factor and S-factors of decent work using the ESEM-within-CFA. Besides, future studies could consider the Bifactor-ESEM framework to provide more precise evidence on the relevant multidimensional construct (e.g., the Work Volition Scale, Duffy et al., 2012) in PWT.
Moreover, the present study extends the PWT by highlighting the importance and complementary role of global and specific levels of decent work on work outcomes. This implies that individuals may cultivate the overall and specific perception of decent work at the same time. That could be ineffective in the human resource management practice when only concerned with employees' general perceptions of their work and ignored their specific perception (e.g., free time and rest). Hence, to satisfy employees' well-being and keep them, managers and human resource practitioners should also pay attention to individuals' specific perceptions of safe work conditions, health care, adequate compensation, free time and rest, and complementary values.
Limitations and Future Research
There are some limitations in the present study that should be considered when interpreting the results. First, this research used cross-sectional data, which precludes directional or causal inferences. Duffy et al. (2020) also emphasize the importance of capturing change in future longitudinal studies of decent work. To reduce the risk of these issues, more sophisticated longitudinal, experimental, or intervention investigations would be necessary. Additionally, although the present study demonstrates the reliability and validity of the DWS in Chinese working adults, the generalizability of the findings may be limited. Future research not only can replicate the results using samples in other cultural contexts but also use a more flexible approach for evaluating measure invariance such as the moderated nonlinear factor analysis (MNLFA) method (Bauer, 2017). Finally, we only investigate the criterion validity using work well-being, life well-being, engagement, and turnover intention. Future studies could assess the criterion-related validity of the Bifactor-ESEM solution by using various variables, such as mental health (Duffy et al., 2021), work meaning (Dodd et al., 2019), and need satisfaction (Autin et al., 2019).
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Science Foundation of China (Grant no. 71772171), Public Computing Cloud, Renmin University of China and Outstanding Innovative Talents Cultivation Funded Programs 2021 of Renmin University of China.
