Abstract
The Short Health Anxiety Inventory is a brief instrument to assess health anxiety widely used across countries; however, no validated version is available for Portuguese-speaking population. Factorial structure, reliability, and equivalency factor with the Spanish version were analyzed with Portuguese adolescents aged 14–18 years. A Portuguese adolescent cohort (N = 629) and a comparative Spanish adolescent cohort (N = 1502) were evaluated. The original two-factor version was the best fitting model for the Portuguese version. The reliability was excellent. Complete measurement invariance across both countries was supported. The Portuguese version of the Short Health Anxiety Inventory is a valid screening inventory to assess health anxiety in adolescents.
Health anxiety (HA) involves preoccupation and fear with having or acquiring a serious illness based on misinterpretation of ambiguous and unexplained somatic symptoms (Hadjistavropoulos et al., 2012, 2014). Individuals with HA are easily alarmed about their health status and tend to check their body repeatedly for signs of illness. Despite appropriate medical evaluation, preoccupation and fears related to health persists, which causes distress and deteriorates multiple areas of functioning (American Psychiatric Association (APA), 2000). Abnormal illness behavior, inadequate coping strategies, and benefits from sick role contribute to maintain HA (Hart and Björgvinsson, 2010).
The prevalence of HA in community samples ranges from 1.3 to 10 percent, and from 3 to 8 percent in ambulatory medical samples with no gender differences (APA, 2013). Adolescence and early adulthood are critical periods to develop this disorder (Barlow et al., 2001). During the adolescence, somatic complaints are highly prevalent, which tend to co-occur with HA (Fergus and Valentiner, 2011; Goodwin et al., 2013). High levels of HA reduce severely personal well-being (physical symptoms and preoccupation on health), social relationships (spend less time with friends), and academic performance areas (school absenteeism related to medical appointments) and increase the use of medical resources (Asmundson et al., 2010; Bobevski et al., 2016; Rieffe et al., 2009; Tomenson et al., 2012). HA presents a high comorbidity with depressive and anxiety disorders, such as generalized anxiety disorder, panic disorder, and obsessive compulsive disorder (Abramowitz et al., 2007b; APA, 2013). Early diagnosis is important to reduce the negative impact of HA on the personal, social, and occupational functioning of the affected individual and avoid abusing medical resources and services.
Salkovskis et al. (2002) developed the 18-item Short Health Anxiety Inventory (SHAI), a shortened version of the 64-item Health Anxiety Inventory, in order to design a brief screening tool to detect HA, which is easy to implement in any setting. Based on the cognitive-behavioral model of HA (Salkovskis et al., 2002; Warwick and Salkovskis, 1990), SHAI measures fear of illness and fear of negative consequences of an illness using a two-factor structure. SHAI is one of the most widely used self-reports for assessing HA symptoms in community and clinical contexts (Alberts et al., 2013; Hedman et al., 2015b). Compared to other measures of health anxiety—such as Illness Attitude Scales (Kellner et al., 1987) and Whiteley Index (Pilowsky, 1967)—the SHAI includes a broader range of symptoms of HA and discriminates between individuals with high HA and those with somatic illness without exaggerated health concerns (Hedman et al., 2015a). Recently, the Somatic Symptom Disorder-B Criteria Scale (SSD-12) was developed based on the Diagnostic and Statistical Manual of Mental Disorders (DSM) (Toussaint et al., 2016). This new conceptualization of somatization-related disorders needs more evidence and presents some limitations. According to Barsky (2016), seriously ill medical patients may score high on the B criterion of the somatic symptom disorder in the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5) (excessive thoughts, feelings, and behaviors associated with health concerns or somatic symptoms) (APA, 2013), even when their psychological response to the medical illness is not disproportionate.
Previous research has shown that the SHAI is a valuable tool in the assessment of HA among adolescents and youth from the United Kingdom (Salkovskis et al., 2002), the United States (Abramowitz et al., 2007a; Wheaton et al., 2010), Japan (Yamauchi et al., 2009), Hungary (Köteles et al., 2011), China (Zhang et al., 2015), and Spain (Morales et al., 2015); but also samples of adults from the United States (Abramowitz et al., 2007b), Canada (Alberts et al., 2011), and Germany (Bailer et al., 2013).
There is considerable consensus on the adequacy of the two-factor structure of the SHAI (fear of illness and fear of negative consequences of an illness factors), although Abramowitz et al. (2007a) proposed a three-factor model for the SHAI in a study with American undergraduates. These factors are (1) illness likelihood factor, (2) illness severity factor, and (3) body vigilance factor. The SHAI has been highly used across samples; however, no studies have studied the invariance of this tool across countries and cultures. Only Alberts et al. (2011) proved loading invariance of the SHAI across clinical and non-clinical population. Since the SHAI is a highly used tool to assess HA (Hedman et al., 2015b), more research needs to be conducted on its factorial structure and invariance across samples and countries. To our knowledge, there is no validated version of the SHAI in Portuguese population to assess HA; therefore, the aims of this study are threefold: (1) test the latent structure of HA in a sample of Portuguese adolescents, (2) analyze the reliability of the Portuguese version of the SHAI, and (3) test the factorial invariance (FI) of the Portuguese version with respect to a previous validated version of the SHAI in a population with similar cultural background, such as the Spanish one.
Method
Study population and design
The sample was composed of 2131 adolescents aged 14–18 years, students at 28 high schools. Of them, 629 were resident in six cities from Portugal and 1502 from five provinces in Spain. Of the whole sample, most of them had married parents (71.2%) and 20 percent had divorced or separated parents. Table 1 shows the sociodemographic characteristics of the sample by country.
Sociodemographic characteristics of the sample (N = 2131) by country.
SD: standard deviation.
Contrast: Student’s t-test for quantitative variables and χ2 test for qualitative variables.
p < 0.001.
The cultural adaptation of the SHAI in Portugal was conducted based on the Spanish validated version (Morales et al., 2015). Permissions from the Regional Ministry of Education of the Autonomous Region of Madeira (Portugal) and the ethics committee of the Miguel Hernández University (Spain) were obtained for this study. In the first phase, the inventory in Spanish was translated into Portuguese by the method of translation and retro-translation by experts in clinical and health psychology. A bilingual translator translated the original items. Then, a bilingual member of the research team conducted the back translation. Members of the team confronted both versions and agreed when there were discrepancies. Later, two specialists in clinical and health psychology revised both translations independently and then the final version was agreed. A small sample of Portuguese scholars (n = 5) completed the questionnaire to check the understandability of the items and they had the possibility of make suggestions to improve the clarity of the items. No changes were necessary at that point. The last version of the SHAI in Portuguese was applied to students from secondary schools in Portugal and Spain. The implementation phase was conducted between January and July 2012 in both countries. A total of 28 high schools from six different areas from the autonomous region Portugal (n = 10) and five provinces of Spain (n = 18) participated in the study.
Permission of the participating high schools and consents from the parents of minor participants were obtained. Informed consent was obtained from all individual participants included in the study. Participation was voluntary, and data were treated confidentially. Students were asked to answer individually the items. Doubts that arose at the time were solved by a researcher. The evaluation lasted 1 hour and took place in the class during the academic schedule. After a month of the first application, participants from Portugal were reassessed at the schools to calculate the test–retest reliability of the Portuguese version of the SHAI.
Measures
SHAI
SHAI evaluates the level of HA, which is understood as the concern related to the health and fear of negative consequences of illness. This instrument consists of 18 items with four response options scored with 0 (no symptoms), 1 (mild symptoms), 2 (severe symptoms), or 3 (very severe symptoms). People diagnosed with hypochondriasis obtain higher scores than those with anxiety disorders, patients with some form of physical illness, and those without anxiety disorders. The original study reported two-factor structure of the SHAI with an excellent intern consistency: Cronbach’s alpha of 0.89 for the total scale, 0.84 for F1 (Fear of Illness), and 0.72 for F2 (Negative Consequences on an illness) (Salkovskis et al., 2002). Test–retest reliability was adequate (0.76). Reliability and validity of this inventory has been supported across the countries with clinical and non-clinical populations.
Sociodemographic characteristics (ad hoc)
Sex, age, and family situation were evaluated
Statistical analysis
Lavaan package for structural equation modeling version 0.5–12 (BETA) (Rossel, 2012) was used to test the classical latent structure of the SHAI with Portuguese adolescents. The factor structure of the SHAI was confirmed following the Hu and Bentler (1999) criteria. A proper adjustment of the model was determined by values greater than 0.90 for comparative fit index (CFI) and Tucker–Lewis index (TLI), less than 0.08 for root mean square error of approximation (RMSEA), and 3 or less for χ2/gl. As suggested by Finney and DiStefano (2006), the normality distributional assumption was checked by Mardia’s (1974) multivariate kurtosis index, in order to select the most appropriate method of estimation for confirmatory factorial analysis (CFA). Because of the lack of normality of the data, diagonally weighted least squares (DWLS) estimator was used. DWLS is a method recommended because of its robustness with ordinal data, small samples, and even in cases of violations of normality (Forero et al., 2009; Mîndrilă, 2010).
CFA models were specified including covariance between the errors of specific items on the identification of physical changes based on theoretical and substantial issues: items 1 and 3 (E1, E3), 2 and 3 (E2, E3), 3 and 10 (E3, E10), and 10 and 13 (E10, E13) (Figure 1). Item 1 refers to the worry about health, and item 3 refers to the awareness of bodily sensations or changes; so that a person who is aware of bodily sensations (evaluated in item 2) may be more worried about his or her health (item 1). The interpretation of aches/pains as appropriate or not to people of the similar age (item 2) is related to the awareness and worry about bodily sensation (item 3). If someone interprets that a specific pain body is common on his or her age, he or she probably will not be so worried than if he or she interprets it is not common. Someone who is aware of bodily sensations (item 3) is more likely that he or she wonder what it means bodily sensations (if he or she has them) (item 10). Finally, invested time in wondering what means bodily sensations (item 10) may be related to the difficulties to think other things rather than unexplained bodily sensations (item 13).

Two-factor structure of the SHAI with Portuguese sample.
The Statistical Package for Social Sciences (SPSS, v 21) was used for sample descriptive analyses. The effect size of the differences in characteristics of the sample from Portugal and Spain and gender was calculated using Cohen’s (1988) d index. Ordinal alpha coefficient was estimated because it is considered a more accurate estimation of reliability for ordinal response scales than Cronbach’s alpha (Gadermann et al., 2012; Zumbo et al., 2007). A two-way random-effects analysis of variance intraclass correlation coefficient (ICC) for absolute agreement was calculated to estimate the test–retest reliability of the SHAI for baseline to day 30. An ICC test–retest of 0.60 was set as the minimum acceptable ICC value in this study, as suggested by other researchers (Anastasi, 1998; Baumgartner and Chung, 2001).
EQS 6.1 was used to calculate FI that implies configural invariance and measurement invariance (MI). Configural invariance indicates whether the factorial structure is similar across the groups. MI refers to the degree in which the parameters of the instrument are similar across groups (Byrne, 2008). MI includes three levels: metric or weak, strong, and strict. A moment analysis and maximum likelihood, robust (ML, robust) estimator was used because of the lack of multivariate normality (Mardia = 34.28 in Portugal, and 93.01 in Spain). When the difference in the CFI between the two models is equal to or less than 0.01, all restrictions are accepted, and the process of analyzing invariance continues. Conversely, when the difference in the CFI between the both models is greater than 0.01, the least restrictive model is accepted and rejects the other one, that is, the more restrictive model does not hold (Cheung and Rensvold, 2002). Completed cases were included for the analyses.
Results
CFA
The indexes of adjustment of the single-factor model showed a poor fit to the data, as follows: χ2 (131) = 504.36, p ⩽ 0.001, CFI = 0.88, TLI = 0.86, and RMSEA = 0.067 (0.061, 0.074). CFA indicated that the two-factor model—proposed by the original authors (Salkovskis et al., 2002)—showed a good fit of the data: χ2 (130) = 368, p ⩽ 0.001, CFI = 0.92, TLI = 0.91, and RMSEA = 0.054 (0.047, 0.060); however, indices for the three-factor model were not acceptable (See Abramowitz et al., 2007b): χ2 (129) = 782.37, p ⩽ 0.001, CFI = 0.78, TLI = 0.74, and RMSEA = 0.090 (0.084, 0.096).
Based on the adjustment of the models and previous studies with similar results (Abramowitz et al., 2007b; Köteles et al., 2011; Yamauchi et al., 2009), we selected the two-factor solution proposed by the original authors (Salkovskis et al., 2002) as the best fitting model. The model is composed of two factors: Fear of Illness (items 1–14) and Negative Consequences of an illness (15–18). The correlation between both factors was moderate for the Portuguese (0.61). All item loadings were higher than 0.51, with the exception of item 7 (“Ability to control the thoughts on health”) for Fear of Illness factor (0.46) (Figure 1). All other analyses were performed based on the two-factor structural model.
CFA for the Spanish sample was carried out. According to the Portuguese model, the adjustment for the single-factor model was poor: χ2 (131) = 1144.24, p ⩽ 0.001, CFI = 0.86, TLI = 0.83, and RMSEA = 0.072 (0.068, 0.076). Indices for the two-factor were acceptable as follows: χ2 (153) = 688, p ⩽ 0.001, CFI = 0.92, TLI = 0.91, and RMSEA = 0.054 (0.050, 0.057). However, the three-factor model did not fit the data: χ2 (129) = 2238.39, p ⩽ 0.001, CFI = 0.69, TLI = 0.64, and RMSEA = 0.10 (0.101, 0.108). The model composed of two factors was selected based on the indices of adjustment, which coincides with the original version (Salkovskis et al., 2002), and a previous validation of the model in Spain (Morales et al., 2015).
Internal consistency and analysis of items
Table 2 shows the reliability and properties of the items of the Portuguese and Spanish versions of the SHAI. In the Portuguese version, the corrected item-total correlations
Psychometric characteristics of the Portuguese and Spanish versions of the SHAI.
SHAI: Short Health Anxiety Inventory; M: mean; SD: standard deviation;
The total ordinal alphas for the Portuguese and Spanish versions were excellent. It was moderately higher in the version of Spain (ordinal α = 0.88) compared with that of Portugal (ordinal α = 0.82). The reliability of each of the subscales was also adequate in both versions, being higher in the subscale Fear of Illness compared to the Negative Consequences of subscale an illness.
Factorial invariance
Table 3 shows the fit of the four models calculated to test the level of factorial invariance (FI) between the Portuguese and the Spanish versions of the SHAI. The first step was to calculate the configural invariance model. The model specified in the CFA (Figure 1) was used to estimate the two-dimensional model (nested) for Portugal and Spain. After weak and strong invariance models were confirmed (Table 3), strict invariance—in which the variances of errors are restricted—was estimated. The model showed a good fit, noting that the CFI value remained stable compared to the previous model. These results confirm that the versions of the SHAI from Portugal and Spain reached a strict level of invariance.
Goodness-of-fit indexes for different levels of invariance.
S-B χ2: Santorra–Bentler Scaled chi-square; df: degree of freedom; CFI: comparative fit index; ΔCFI: change in CFI between models; RMSEA: root mean square error of approximation; LL: lower limit; UL: upper limit.
Test–retest reliability
For the 540 (87% of retention) who completed the SHAI twice, ICC test–retest coefficients were 0.69 for total score (confidence interval (CI) 95%: 0.63, 0.74; F = 3.24; p ⩽ 0.001), 0.60 for Fear of Illness (CI 95%: 0.64, 0.74; F = 3.32; p ⩽ 0.001), and 0.62 for Negative Consequences of an illness (CI 95%: 0.55, 0.68; F = 2.65; p ⩽ 0.001). These ICC coefficients indicated a relatively satisfactory level of test–retest reliability (⩾0.60).
Age and gender differences
The average total score of the SHAI was higher in the sample recruited in Portugal (M = 17.25, SD = 6.87) compared to Spanish one (M = 13.15, SD = 7.11; p < 0.001, d = 0.58). Portuguese adolescents had higher scores on the subscales Fear of Illness (Portugal: M = 14.27, SD = 5.68 vs Spain: M = 10.82, SD = 5.71; p < 0.001, d = 0.59), and Negative Consequences of an illness (Portugal: M = 2.97, SD = 2.29 vs Spain: M = 2.33, SD = 2.27; p < 0.001, d = 0.28) compared with Spanish ones. Men from Portugal had higher scores on the overall scale (p < 0.001) and in the respective subscales (p < 0.001) compared to men from Spain. However, women from Spain had higher scores on the overall scale (p < 0.001) and subscales Fear of Illness (p = 0.005) and Negative Consequences of an illness (p < 0.001) than women from Portugal. HA was unrelated to age in Portugal (p = 0.10) and Spain (p = 0.06). Student’s t-test for independent means indicated that there were no differences in the level of HA between those aged 14–15 years and those aged 16–18 years (p = 0.10) in the sample from Portugal and Spain (p = 0.08).
Discussion
The CFA confirmed the good fit of the two-factor structure for the Portuguese version of the SHAI, according to the first study of Salkovskis et al. (2002) with patients with hypochondria, other clinical problems and students: Fear of Illness and Negative Consequences of an illness. Subsequent studies that test the latent structure of the SHAI confirmed the two-factor structure of the inventory in the United States with adult patients diagnosed with hypochondria (Abramowitz et al., 2007b) and college students without item 13 (Wheaton et al., 2010), in Japan (Yamauchi et al., 2009) and Hungary with undergraduate students (Köteles et al., 2011), in Germany with clinical and non-clinical adult population (Bailer et al., 2013), and recently in Spain with high school adolescents (Morales et al., 2015) and in China with undergraduate healthy medical students (Zhang et al., 2015). The adjustment of the two- and three-factor models of the SHAI has been compared in studies with clinical population in the United States (Abramowitz et al., 2007b) and non-clinical population in Japan (Yamauchi et al., 2009), Hungary (Köteles et al., 2011), and Spain (Morales et al., 2015). Despite the good fit of the three-factor model in most of these studies, the two-factor model proposed by Salkovskis et al. (2002) is commonly selected by the researchers because of its clarity and parsimony. The correlation between both factor was moderate (r = 0.61), indicating that both are related although they measure different issues of HA. It was consistent with the study of Morales et al. (2015) (r = 0.54).
The Portuguese version of the SHAI showed an adequate total reliably (ordinal α = 0.82), similar to the studies conducted in the United Kingdom (α = 0.89) (Salkovskis et al., 2002), Hungary (α = 0.83) (Köteles et al., 2011), and Japan (α = 0.85) (Yamauchi et al., 2009), slightly lower than in the United States (α = 0.96) and Spain (ordinal α = 0.93) (Morales et al., 2015), but higher than the version validated recently in China (Cronbach’s α = 0.74) (Zhang et al., 2015). In this study, the temporal stability of the response was adequate (ICC > 0.60 between both assessments). Other studies found similar results (Salkovskis et al., 2002; Zhang et al., 2015).
This study indicates a strict level of invariance between the Portuguese and Spanish versions of the SHAI. This implies that the results of both versions are comparable, with a minimum bias measure (Dimitrov, 2010). Total scores of the SHAI were higher in the sample from Portugal (M = 17.25; SD = 6.87) compared to the one from Spain (M = 13.15; SD = 7.11). In both cases, mean values were distant from 27, which is the cut-off score recommended by Alberts et al. (2013) when 0–3 scale range is used. Cultural, social, and economic factors can explain that Portuguese adolescents reported higher HA symptoms than their Spanish peers. Portugal and Spain national models of health system—whose funding is mainly public (The Beveridge model) —present significant differences in health care access. Unlike Spain, health system in Portugal includes patient copayment for doctor visits (Subdirección General de Información Sanitaria e Innovación, 2014). Since 2012, the cost doubled due to the economic crisis (from €3.80 to €10 for primary care emergency, and from €9.60 to €20 for specialized emergency) (Subdirección General de Información Sanitaria e Innovación, 2014). The cost of access to health resources can reduce the excessive costs associated with patients with HA, but it suggests that it does not reduce the concern about health from those affected by HA. Although it is not the aim of this study to compare the group means across the studies without having checked the FI, it is noteworthy that the level of HA of the Portuguese adolescents was similar to the young Chinese people with anxiety (M = 16.97; SD = 8.27) (Zhang et al., 2015). Another significant aspect is that the degree of HA of the Portuguese adolescents was higher than that reported by other studies with undergraduate students, as Abramowitz et al. (2007a) (M = 12.48; SD = 6.79) and Wheaton et al. (2010) (M = 10.79; SD = 6.38) in the United States, Yamauchi et al. (2009) in Japan (M = 14.04; SD = 6.90), and Morales et al. (2015) in Spain with high school students (M = 10.48; SD = 5.70) (see Albert et al., 2013).
This study has several limitations that provide directions for future research. The Portuguese version of SHAI was validated with non-clinical sample. It would be necessary to conduct a study to test the psychometric properties of this inventory with clinical sample from Portugal. Convergent and divergent validity of SHAI with other measures that assess HA in adolescent population of Portugal must be studied in future studies. Despite the limitations of this study, the outcomes provide evidence of the structure and reliability of the Portuguese version of SHAI to assess HA in adolescents. This is the first study to adapt and validate the SHAI with a Portuguese population and test equivalency factor with a previous validated version. Findings confirm the two-factor structure of the Portuguese version of SHAI, an adequate internal consistency and temporal stability, and its equivalence to the version validated recently in Spain (Morales et al., 2015). These results are promising for the use of the SHAI as a brief screening instrument to detect HA in Portuguese adolescents. The validation of SHAI in Portugal fills an important gap in the evaluation of HA with Portuguese-speaking population from the cognitive-behavioral perspective.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Support for this research was provided by the Regional Agency for the Development of Research Technology and Innovation in Portugal, Ref. 1080/1974, the Foundation for Research and Prevention of AIDS in Spain, Ref. FIPSE 360971/10, and by the Program VALi+d for Research Staff training of the Council of Culture, Education and Science of the Valencian Autonomous Government of Spain, Ref. ACIF/2012/132.
