Abstract
OBJECTIVE:
The purpose of this study was to examine the factor structure of satisfaction ratings on a collection of 38 employment concerns items among people with Multiple sclerosis (MS).
RESULTS:
Analyses included a cross validation to establish and confirm a factor structure. The original 38 items were reduced to 17, which were found to form three distinct factors during the calibration portion of the cross validation. These three factors were Environmental/Personal Resources, Fair Treatment, and Legal Rights, which were confirmed during the validation portion of the cross validation.
CONCLUSION:
It appears that the three-factor structure of these 17 items is suitable for use with individuals with MS in the evaluation of their employment-related concerns and in the subsequent delivery of rehabilitation interventions.
Introduction
Multiple sclerosis overview
Multiple sclerosis (MS), also known as disseminated sclerosis or encephalomyelitis, is an inflammatory disease that results in damage to the central nervous system (National Multiple Sclerosis Society [NMSS], 2018). The range of symptoms that can result from this illness has the potential to affect virtually every aspect of human activity and functioning. Its impact results in about 40% of those diagnosed with MS not reaching their 70th year of life. Two-thirds of deaths in people with MS are caused by disease-related factors (Compston & Coles, 2008). Although a variety of medical and therapeutic treatments can help to alleviate the impact of this disease, none can completely stop its progression, which often leaves individuals with multiple impediments to daily life and significant barriers, both psychological and physical, to gainful employment (Rumrill et al., 2015).
Epidemiology
As of 2017, there were an estimated 2–2.5 million people with MS globally, which translates to about 30 for every 100,000 people, although illness rates vary widely across regions of the globe (NMSS, 2018). MS-related deaths are estimated at about 18,000 per year worldwide. Race/Ethnicity is a significant factor in the occurrence of MS, as demonstrated by global regional differences. The prevalence of MS is lowest in Africa, followed by South East Asia, the Americas, and highest in Europe. For those of Northern European descent, the prevalence climbs to over 200 cases for every 100,000 people (Bishop, Rumrill, & Timblin, 2016). The worldwide number of new cases increases at an approximate annual rate of 2.5 for every 100,000 (World Health Organization, 2008). Rates of MS appear to be increasing, though this may be a result of improved detection methods. The current national prevalence of MS is estimated to be around 450,000 cases in the U.S. (NMSS, 2018). This prevalence figure suggests that approximately 1 out of every 700 Americans is dealing with MS at any given time (Fraser et al., 2002). Along with this prevalence assessment, it is estimated that 10,000 new diagnoses of MS are made every year in the U.S., an incidence rate that has steadily increased over the past 50 years (Rumrill & Roessler, 2015).
Although the initial symptoms and subsequent diagnosis of MS can occur during any time of one’s life, most cases begin in early adulthood, generally between the ages of 20 and 40 (Schapiro, 2012). More than half of all MS diagnoses occur before the age of 30, and 75% happen before the age of 40 (Fraser, Kraft, Ehde, & Johnson, 2006). Women also acquire the disease more frequently than men, at a rate of 200–300%, which is somewhat typical of autoimmune diseases in general (NMSS, 2018). Regardless of whom MS affects and when, this disease intrudes upon every important personal and social activity in one’s life including employment.
MS and employment
A variety of factors contribute to the significant and deleterious effect that MS has on a person’s employment (Rumrill & Roessler, 2015). The sporadic and unpredictable symptom cycles, which vary in intensity and duration, can be particularly disruptive. Symptoms that spread over a wide range of functional domains including psychological and physiological health are particularly problematic. Additionally, difficulties in communicating the unpredictable and multifaceted effects of MS to employers and coworkers can be challenging (Nissen & Rumrill, 2016).
With the typical onset of MS occurring in people’s 20 s and 30 s, MS often strikes during the “prime of life.” In relation to vocational growth and activity, this span of time is often the busiest and most productive period in one’s entire career. This age range has also been characterized by important career exploration, establishment, and maintenance activities (Super, 1980). Unfortunately, the onset and progression of MS makes it extremely difficult for people to continue their engagement in these career developmental activities. The vast majority, more than 90%, of people with MS have employment histories, meaning that they have worked for pay at some time in the past (Rumrill et al., 2015). Additionally, 82% of people with MS were working at the time of diagnosis (Roessler, Rumrill, Li, & Leslie, 2015). As the disease begins to progress, however, there is a dramatic reduction in labor force participation. The nature of this decline has been estimated by Fraser et al. (2002) to result in only 20 to 30% of people with MS retaining employment 15 years after their initial diagnosis. Furthermore, less than half of people with MS in the United States are currently employed (Rumrill et al., 2015). The specific reasons for these high rates of unemployment are not known, but it is likely some combination of factors such as demographics, illness-related symptoms, medical and insurance issues, and workplace factors such as discrimination and accommodation availability.
Even though the jobless rate for people with MS is very high in general, it seems disproportionately so for women and non-Caucasians (Roessler et al., 2015). People with MS who experience cognitive impairments are four to six times more likely to be unemployed than people with MS who do not experience cognitive impairments, and people with MS who have a progressive disease course are more likely to disengage from the workforce than those with the relapsing-remitting form of MS (Bishop et al., 2016). Job satisfaction has been found to be a key component of both job tenure and employment status for both the general populous and for people with MS (Dawis & Lofquist, 1984; Hartung, 2013). Li, Roessler, Rumrill, and Ahmed (2017) found that many people with MS who were employed experienced high levels of dissatisfaction with their jobs. The key factors accounting for this dissatisfaction were the excessive amount of work they were being expected to do, not receiving enough pay, too few opportunities for advancement, not enough on-the-job training, and low job recognition. Some of these dissatisfaction factors were results of people with MS feeling that they were being treated differently than their co-workers in the workplace.
To identify high-priority employment concerns from the perspectives of people with MS, Rumrill et al. (2015) conducted a national survey containing 38 employment concerns items. The survey instrument was created with input from 13 members of the NMSS. Survey respondents assigned the highest priority to concerns related to access to information on disability benefits programs, discrimination in hiring retention practices or employer behavior, employment protections under major legislation, the quality of rehabilitation and employment services, access to assistive technology, support for returning to work and planning for the future, and reactions of employers and coworkers after the disclosure of one’s disability status.
Purpose of this study and research questions
Although the 38 employment concerns items from the Rumrill et al. (2015) survey have been used in previous research to determine groups of items in which participants find the most and least satisfaction, no analysis prior to the present study had been conducted to explore the nature of their interrelations. For the present study, an Exploratory Factor Analysis (EFA) was first conducted to examine the factorial structure of the items; then, the EFA was followed by a Confirmatory Factor Analysis (CFA) to validate any structure that emerged in the EFA. The combination of EFA and CFA in this format is referred to as a cross validation. Using the cross validation approach, this study aimed at identifying the composing factors of the MS employment concerns rating scale. To be specific, this study sought to answer the following questions: How many factors will emerge from the data when exploratory factor analysis is conducted? How are the factors interrelated and are the intercorrelations displayed among the factors substantively meaningful? How well do these factors fit the data, in other words, are the factors identified throughout the modeling process sufficient for the data?
Method
Participants
Descriptive statistics of the survey participants (N = 1,844)
Descriptive statistics of the survey participants (N = 1,844)
Illness-related symptoms reported by the group ranged from mild to severe and suggested a variety of MS conditions, including physiological, sensory, and psychological effects. Commonly reported symptoms were fatigue (indicated by 79% of respondents), balance/coordination problems (65%), diminished physical capacity (63%), gait/mobility impairment (56%), numbness (50%), bowel or bladder dysfunction (50%), cognitive impairment (49%), spasticity (44%), pain (43%), depression (35%), vision problems (33%), sexual dysfunction (27%), anxiety (28%), and speech problems (16%).
A national random sample of individuals with MS was drawn from 9 NMSS chapters across the United States (Rumrill et al., 2015). The aim of this sampling was to ensure that participants were representative of the total population of people with MS with regard to geographic location, gender, race/ethnicity, income, and education. For a complete description of sampling and data collection procedures that were used in the original survey, readers are referred to Rumrill et al. (2015).
Of the 7,369 people with MS whom Rumrill et al. (2015) included in the target sample, 1,932 people returned questionnaires, resulting in a response rate of 26%. A total of 1,844 members of the original respondent sample provided complete information on the variables of employment concerns and therefore formed the sample for the present investigation.
Measures
The 38 employment concerns items that were analyzed in this research included a two-part response set that elicited participants’ importance and satisfaction ratings for each item. For example, in responding to the item regarding health insurance coverage, respondents were asked, “Is it important that people with MS have adequate health insurance coverage?” and “Are you satisfied that people with MS have adequate health insurance coverage?” The 38 items cover a wide range of topics including access to information on disability benefits programs (e.g., “have adequate information about benefits such as health and disability insurance”), discrimination in employment such as hiring and retention practices (e.g., “are treated fairly in termination or demotion decisions made by employers”), employment protections under major legislation (e.g., “understand the employment protections of Title 1 in the Americans with Disabilities Act as Amended”), the quality of rehabilitation and employment services (e.g., “have access to service providers who understand the needs of people with MS”), access to assistive technology (e.g., “have access to assistive technology resources needed for work”), and support for returning to work and planning for the future (e.g., “are encouraged to take control of their lives”). Respondents answered either “yes” or “no” with regard to whether they thought each concern was important and if they were satisfied that the concern had been addressed in their communities. In this study, only the responses related to satisfaction with the employment concerns were analyzed, and the 38 items were dichotomously coded with 1 indicating “satisfied” and 0 indicating “dissatisfied”.
Data analysis
The goal of this study was to establish and validate a factor structure for the satisfaction ratings on the employment concerns of people with MS. A cross validation procedure was adopted, and the sample of participants was randomly split into two groups of roughly equal size. The first half was the calibration sample used for an exploratory factor analysis (EFA) to assess the psychometric properties of the items and to explore the possibilities of any overarching factor structure. After a factor structure emerged in the EFA, the factor structure was tested and validated with the second half of the sample (i.e., the validation sample) using confirmatory factor analysis (CFA).
As there is currently no single-model goodness-of-fit index that can directly confirm the fit of the model, five model goodness-of-fit indices were used to evaluate the fitted model: (a) the χ2 test, (b) the root mean square error of approximation (RMSEA), (c) the comparative fit index (CFI), (d) the Tucker-Lewis Index, and (e) the weighted root-mean-square residual (WRMR). Data management and descriptive statistics in this study were performed in the Statistical Package for the Social Sciences software (SPSS 21). The factor analysis was conducted in Mplus 7, a latent variable modeling program with a wide variety of analytic capabilities (Muth
Results
EFA
An EFA was conducted on the calibration subsample (N = 921) to explore the possibility of various factor structures within the data. Due to the dichotomous nature of the items in the survey, the weighted least squares mean and variance (WLSMV) estimator was used with CF-Parsimax oblique rotation to produce more interpretable factors. Mplus offers the option to run multiple EFA models, with the ability to specify how many factors are produced in each. Eigenvalues were generated and examined first to determine which range of factor solutions might be worth further testing. Among the 38 eigenvalues, the first three were greater than one (e.g., the largest six eigenvalues are λ1 = 26.41, λ2 = 1.84, λ3 = 1.67, λ4 = .98, λ5 = .94 and λ6= .71). Given the consideration of sampling errors, eigenvalues appeared to suggest the possibility of a three, four, and possibly five factor solution if based on the eigenvalue greater than 1 rule. Because the employment concern topics were taken from a variety of source themes during the creation of these 38 items, a minimum of a two factor solution was expected.
Summary of model goodness-of-fit indices for all EFA models
Summary of model goodness-of-fit indices for all EFA models
Notes.***p < 0.001. χ2 = Chi-Square Test (i.e., Minimum Fit Function); RMSEA = Root-Mean-Square-Error of Approximation; CFI = Comparative Fit Index; TLI = Tucker Lewis Index; WRMR = Weighted Root-Mean-Square Residual index.

Scree plot for exploratory factor analysis.
Rotated factor loadings for three factor EFA model based on the original 38 items
Note. Loadings less than 0.32 were suppressed to improve readability.
Manifest content of three factor 17-item model and factor loadings
Note.*p < 0.05.
The three factors were named Environmental/Personal Resources, Fair Treatment, and Legal Rights. The Environmental/Personal Resources factor was composed of seven items that were related to external supports helping an individual with MS in her or his maintenance of, or return to, employment (i.e., Items A2, A3, A4, A12, A13, A14, and A15). The resources reflected in these items included access to service providers, the physical workplace, assistive technology, and reasonable accommodation. One item (i.e., Item A3) also addressed support that may come from one’s social circle in the form of encouragement. The Fair Treatment factor contained four items examining training, benefits, evaluation, and the honoring of seniority that were primarily related to the expectation that an individual with MS should be treated in the same way as her or his coworkers who may or may not have disabilities (i.e., Items A21, A22, A23, and A28). The Legal Rights factor included six items that were related to the intersection of disability-related legislation, discrimination, and government benefits (i.e., Items A20, A25, A27, A31, A33, and A38).
Factor Correlation Coefficients for Three Factor Solution
Note. *p < 0.05.
Because three factors had emerged from the data, factor loadings less than 0.32 in the previous three-factor 17-item exploratory factor model were then fixed to zero. In other words, a three-factor 17-item confirmatory factor model, in which each item was only allowed to load onto one factor with factors inter-correlated and measurement errors uncorrelated, was subjected to model fitting and testing. Figure 2 displays the graphical representation of the three-factor 17-item confirmatory model. The CFA model was first fitted to the calibration subsample (N = 921). Based on the model fit indices of RMSEA, CFI, and TLI, this analysis indicated a close model fit (i.e., χ2 = 282.99, df = 116, p < 0.001; RMSEA = 0.040; CFI = 0.992; TLI = 0.990). Examination of the Lagrange Multiplier (LM) modification indices did not suggest that any changes to this model would dramatically improve the model fit.
The three-factor 17-item factor solution.
Summary of model goodness-of-fit for three factor models
Notes.***p < 0.001. χ2 = Chi-Square Test (i.e., Minimum Fit Function); RMSEA = Root-Mean-Square-Error of Approximation; CFI = Comparative Fit Index; TLI = Tucker Lewis Index Index; WRMR = Weighted Root-Mean-Square Residual index.
Existing research clearly indicates that MS has a unique and usually negative impact on a person’s prospects for ongoing employment, but it remains unclear why this is so. Certainly, the impact of acquiring a chronic, usually episodic, and unpredictable disease such as MS during the peak-performance years of career development requires significant personal, social, environmental, lifestyle, and financial adjustments. However, a unifying theory or explanation for the employment-related difficulties that await people with MS following diagnosis is not evident in current medical or rehabilitation literature. It is well established that the vast majority of people with MS have employment histories (98% in the present sample) and most (82% in the present sample) were still working at the time of diagnosis, yet only 20 to 30 % of people with MS are still employed 15 years after diagnosis (Fraser et al., 2002). Even those people with MS who are employed report significant dissatisfaction with many aspects of their jobs (Li et al., 2017; Roessler & Rumrill, 1995).
The overall understanding of the employment experiences and outcomes of people with MS could be enhanced by close examination of the highest-priority employment-related concerns of this population. This study examined the factor structure of 38 key employment concerns that formed the basis for a large, national survey of Americans with MS. Specifically, this research attempted to identify patterns in respondents’ satisfaction ratings on the 38 items.
The first question addressed in the present study sought to determine whether the collection of 38 employment concerns items contained separate individual factors. Results indicated that there were three distinct factors in the scale. Once items that did not contribute to a single factor were removed, the three themes that emerged were Environmental/Personal Resources, which was related to opportunities and services available to people with MS (e.g., “Have opportunities for job training or retraining,” “Have access to service providers who understand the needs of people with MS,” “Can expect employers to respond to their accommodation needs in a timely manner”); Fair Treatment, which related to the way people with MS are treated in comparison to other workers (e.g., “Are provided the same retirement benefits as other workers,” “Have their seniority honored in the same way as other employees,” “Are evaluated no more frequently than other workers”); and Legal Rights (e.g., “Understand the risks and benefits of disclosing disability status to employers,” “Know what to do if they encounter discrimination at work,” “Understand the employment protections of Title I in the Americans with Disabilities Act as Amended [ADA]”).
These three factors are informative, but they are not surprising given the fact that the identified themes appear quite often in existing vocational rehabilitation literature. For example, Environmental/Personal resource-related topics are often cited as factors that tie into the availability and effects of support within one’s immediate social system, but also into the availability of accommodations and amenities at work (Strauser, 2014; Wehman, 2013). Fair Treatment, or the absence thereof, is a commonly cited issue in the employment experiences of people with disabilities in general and people with MS in particular (Leslie et al., 2015; Smart, 2016). Similarly, Legal Rights are known to be a key factor in the employment experiences of people with MS and other disabilities (McMahon & McMahon, 2016), a factor that includes the navigation of federal protections and disability benefits programs.
To address the second set of questions related to the validity of the three-factor model, a cross-validation was conducted on the validation subsample of a split data file. When this model was tested on this specific subsample, it continued to exhibit excellent fit. Additionally, all factor loadings, factor intercorrelations, and error variances remained constant. This step of the analysis confirmed that this factor structure including Environmental/Personal Resources, Fair Treatment, and Legal Rights themes that were previously identified held their structure. The relevance and implications of these specific themes extend beyond the immediate realm of these analyses. Environmental/Personal Resources, Fair Treatment, and Legal Rights exist as active themes in defining what it means to work while coping with MS, and some of the most prominent employment issues facing Americans with MS cluster into those themes (Bishop et al., 2016; Li et al., 2017).
Environmental and personal resources
A variety of environmental and personal resources have been shown to influence the employment outcomes of people with MS. They include considerations such as the availability of on-the-job accommodations (Leslie et al., 2015), support from coworkers (Vickers, 2012), and the availability of vocational rehabilitation services (Fraser et al., 2006). Tailored interventions are needed to address the specific concerns contained within the environmental/Personal resources factor (i.e., “Have access to service providers who understand the needs of people with MS”; “Can expect employers to respond to their accommodation needs in a timely manner”; “Have physical access to workplace facilities”; “Are considered for other jobs in the same company if their MS prevents them from returning to their former jobs”; “Have access to assistive technology resources needed for work”).
To further underscore the importance of workplace issues and barriers, another study of unemployed people with MS indicated that, although 75% left their previous employment voluntarily, the majority of them cited worksite barriers as the primary reason (Allaire & LaValley, 2003). Somewhat conversely, in the study by Rumrill et al. (2015) that generated the data for the present analyses, people with MS were generally satisfied with their access to insurance, employment supports, equitable personnel policies, and the accessibility of accommodations. They were generally dissatisfied with limited information about funding for assistive devices, retraining, and the availability of employers to discuss their accommodation needs.
Fair treatment
The perception of unfair treatment or discrimination by coworkers and employers is not uncommon among people with MS. Nissen and Rumrill (2016) described workplace discrimination as the unifying feature of the employment experience for Americans with MS, suggesting that it is the number one explanation for the high rate of workforce attrition that follows the onset of the illness. Indeed, in a national survey conducted by Roessler, Rumrill, and Hennessey (2002), no fewer than six items related to implementation of the ADA and the Family and Medical Leave Act (FMLA) were reported among the 12 most prominent employment-related problems identified by Americans with MS. Specifically, the majority of respondents reported having been treated unfairly in the hiring process by employers (73%), having been denied reasonable accommodations (58%), having received lower pay compared to their peers who are without disabilities (53%), being refused schedule modifications that would have enabled them to continue working (59%), having received inadequate health insurance coverage (73%), and having received little or no information about their legal rights from employers (69%). Vickers (2012) reported similar findings highlighting workplace discrimination as a major employment obstacle for people with MS.
Legal rights
It is not surprising that legal rights emerged as a distinct factor in respondents’ satisfaction ratings on the employment concerns items. Kalb (2016) emphasized how important it is for people with MS and their significant others to stay abreast of the legal protections that are accorded them in the Affordable Care Act, the Americans with Disabilities Act Amendments Act, the Family and Medical Leave Act, and other Federal statutes. The Job Accommodation Network at West Virginia University (askjan.org) and the National ADA Centers Network (adata.org) are excellent sources of information on disability-related legal rights, as is the NMSS’ (2018) interactive website. Nissen and Rumrill (2016) reported that a lack of awareness of legal protections is one of the top five employment barriers facing Americans with MS. To address this problem, Strauser (2014) encouraged the deployment of disability navigators who can assist people with various disabilities in understanding disability benefits and Federal legal protections. He also exhorted vocational rehabilitation professionals to serve as liaisons to health care providers to ensure that people with MS and other significant disabilities receive much-needed legal information and advocacy in an early intervention context.
Support for the three factor model
The occurrence of the three factors identified in this series of analyses is supported not only by the rigor of the statistical techniques used, but also in previous research findings. Following the development of the original 38 employment concerns items, one report of their functioning explored those items that demonstrated the greatest overall satisfaction (i.e., employment strengths) and overall dissatisfaction (i.e., employment weaknesses; Rumrill et al., 2015). Rumrill and his colleagues emphasized the potential importance of multifactor models that could be used to understand the impact of MS on various personal issues and their impact on quality of life. One of the key components of this notion of quality of life was job satisfaction, which has been identified as a strong predictor of continued employment in several studies of people with MS (Li et al., 2017; Rumrill, Roessler, & Fitzgerald, 2004).
In another study, a large international group of people with MS was surveyed regarding their employment status (Uccelli, Specchia, Battaglia, & Miller, 2009). Several factors were identified as correlates of employment status, including MS-related symptoms, workplace environment, one’s attitude toward work, others’ attitudes toward people with MS, financial considerations, and personal issues. In particular, workplace environment, attitudes of others, financial considerations, and personal issues had indicators similar to those that composed the final three-factor model in the present study.
Further support for the potential relevance of the present findings can be found in a qualitative analysis of employment themes among people with MS (Johnson, Yorkston, Klasner, Kuehn, Johnson, & Amtmann, 2004). Following a series of interviews, the researchers identified four overall themes that appeared to impact employment. They were the cost-benefit economy of working, fatigue and cognitive changes, stress in the workplace, and accommodations to address barriers. Specifically within the theme of accommodations to address barriers, participants expressed the importance of coworker education regarding MS, accommodation through personal action, changing of roles and activities, and employer participation in the accommodation process. The importance of accommodations was frequently stressed as an element of both fair treatment in the workplace and environmental/personal supports.
Limitations
One limitation of this study is that data were collected in a purely self-report format. Self-report information is subjective, i.e., grounded in the unique experiences of each respondent and often biased in favor of responses that cast the respondent in a favorable light (Heppner et al., 2015). That said, because the purpose of this study was to analyze data regarding the specific attitudinal concerns of respondents, a self-report survey was the only way to elicit the requisite information regarding respondents’ employment concerns.
The low response rate (26%) in the original survey from which data for this study were drawn is another limitation. Even though the respondent sample was generally representative of known population parameters of people with MS, it is unknown whether the 74% of the target sample who did not return surveys are characteristically different from those who did respond. It is certainly possible that non-responders have different employment concerns, are employed at different rates, and have different experiences with MS symptoms than the respondent sample.
This sample was also limited to participants currently living in the U.S, although MS has been shown to exist throughout the world. International and intercultural differences in the incidence and prevalence of MS, treatment approaches and availability of health care services, societal attitudes toward people with disabilities, and laws regarding labor practices and disability benefits would almost certainly yield different results if a study like the present one were conducted in another country.
Conclusion
Findings from this factor analytic study provide new insights into how people with MS conceptualize their employment related concerns. The 38 items that formed the basis for the original national survey were reduced to 17 items that loaded into three distinct factors: environmental/personal resources, fair treatment, and legal rights. The stability of the underlying factor structure of these 17 employment concerns items lends to their validity and reliability. Additionally, the cross-validation tests that were conducted on these data were done so using dichotomous indicators reflecting a strong model fit. Future researchers may use these confirmed employment concern factors as both predictor and criterion variables to obtain a parsimonious and nuanced understanding of the themes inherent in the satisfaction that people with MS ascribe to their overall employment situation.
Most importantly, the three factors identified in this study illuminate the dynamics of employment acquisition, retention, and advancement among adults with MS. If individuals with MS, or any other severe disability or chronic illness for that matter, are to succeed in employment, critical long-term supports are needed with respect to Environmental and Personal Resources, Fair Treatment, and Legal Rights. For rehabilitation counselors, diagnostic consideration of the extent to which their clients are satisfied with each of these factors should guide the development and delivery of interventions needed to improve employment outcomes.
Conflict of interest
None to report.
Footnotes
Acknowledgments
This research was funded through a Health Care Delivery and Policy Research grant from the National Multiple Sclerosis Society, New York, NY. The authors wish to thank the National Multiple Sclerosis Society, its participating chapters, and the study participants for their support and assistance with this research.
