Abstract
Lack of physical activity is associated with increased risk for coronary heart disease, the main cause of death in African American women. This integrative review aims to evaluate self-report instruments to assess physical activity in African American women, within the context of coronary heart disease. A systematic literature search was conducted using PubMed, CINAHL, PsycINFO, and PubMed Central databases. Only peer-reviewed studies (a) that included African American women and (b) that assessed the psychometric properties of physical activity instruments in the context of heart disease were included in the search. Initial search located 691 articles but only 7 studies were included in the final review. Of the 7 studies, 6 utilized a combination of self-report and objective measures. While most self-report instruments yielded modest validity and reliability, results were inconsistent and modest at best for African American women. Further studies are needed to identify psychometrically and culturally competent instruments for African American women.
The impact of physical activity (PA) as a major indicator of health and wellness has been well-established. Lack of PA is associated with increased risk for obesity, hypertension, hyperlipidemia, diabetes, and coronary heart disease (CHD; Masse et al., 2012; Thompson & Barksdale, 2010). African American (AA) women have one of the highest death rates from CHD among all ethnic groups (Roger et al., 2012). The high prevalence of risk factors contributes to high mortality and morbidity from CHD in AA women (Oexmann et al., 2000; Roger et al., 2012). Despite the known risks of inactive lifestyle, a large proportion of AA women do not engage in regular PA (Crespo, Smit, Andersen, Carter-Pokras, & Ainsworth, 2000; Marshall et al., 2007; Peterson, 2011). Studies show that adopting an active lifestyle reduces the risk for CHD and improves overall health outcomes (Elsawy & Higgins, 2010).
Increasingly, health initiatives such as Heart and Soul, Racial and Ethnic Approaches to Community Health (REACH), and Project Joy have focused on strategies to address PA in AA women due to their high risk for CHD (Peterson & Cheng, 2011; Plescia, Herrick, & Chavis, 2008; Yanek, Becker, Moy, Gittelsohn, & Koffman, 2001). Studies conducted to examine PA in AA women have primarily focused on the influence of socioecological factors in reducing risk factors for CHD (Ainsworth, Wilcox, Thompson, Richter, & Henderson, 2003; Fleury & Lee, 2006). The benefit of PA in reducing risk for CHD is well-established but how the different aspects of PA are associated with certain health outcomes remains unclear (Aadahl & Jorgensen, 2003). A greater understanding about the relationship between PA and health outcomes among AA women warrants the need to evaluate the reliability and validity of instruments to ensure accurate assessment of the impact of PA on CHD.
There are two main methods used for measuring PA: (a) objective measures and (b) subjective measures or self-report (Warren et al., 2010). Objective measures include direct calorimetry, indirect calorimetry, doubly labeled water (DLW), accelerometers, and pedometers. DLW provides measurement of PA by assessing the rate of metabolism of isotopes over a period of time. The difference in elimination rates of the isotopes provides a measure of energy expenditure represented by carbon dioxide production that directly relates to PA (Mindell, Coombs, & Stamatakis, 2014; Vanhees et al., 2005). Indirect calorimetry accurately measures energy expenditure from oxygen consumption and carbon dioxide production in a ventilated hood (Vanhees et al., 2005). Direct calorimetry is more accurate in assessing metabolic rate than indirect calorimetry and DLW but is primarily utilized for laboratory-based studies (Kaiyala & Ramsay, 2011). Although considered to be the gold standard for validating PA measures, these three methods are too complicated and too expensive to administer in large-scale studies (Kaiyala & Ramsay, 2011; Vanhees et al., 2005). Accelerometers and pedometers are wearable motion sensors that can objectively measure acceleration, duration, and intensity of PA. Previous studies have demonstrated the utility of pedometers and accelerometers as valid measures of PA (Crouter, Schneider, Karabulut, & Bassett, 2003; Freedson, Melanson, & Sirard, 1998). Relatively inexpensive and easy to use compared with DLW and indirect calorimetry, they require technical expertise to manage and analyze data (Mindell et al., 2014). While newer models have greatly improved their accuracy, the utility of wearable motion sensors on assessing improvement in health outcomes remains inconclusive (Heil, Brage, & Rothney, 2012). Self-reports are the most widely used measure for PA. They include PA questionnaires, surveys, logs, and diaries. Self-reports are inexpensive, easy to administer, and the instrument of choice in large population studies (Aadahl & Jorgensen, 2003). The validity of the instrument is based on the subjective assessment, recall, and interpretation of different aspects of PA over a period of time (Vanhees et al., 2005). Studies examining validity and reliability of self-report against objective measures of PA have concluded that self-report methods provide a valid measure of PA (Philippaerts, Westerterp, & Lefevre, 1999; Schuit, Schouten, Westerterp, & Saris, 1997; Singh, Fraser, Knutsen, Lindsted, & Bennett, 2001). However, validation studies on AA women are lacking. Therefore, the purpose of this integrative review is to evaluate the different self-report instruments used to measure PA in AA women in the context of their risk for CHD. Assessment of validity and reliability of self-report instruments used in AA women will provide additional insight to help designate which PA interventions offer the most significant health benefits for AA women.
Theoretical Definition and Operational Definition
The World Health Organization (WHO) defines PA “as any bodily movement produced by skeletal muscles that requires energy expenditure” (WHO, 2014). Although the term “physical activity” is sometimes used interchangeably with “exercise,” the WHO defines exercise as a subclass of PA in which physical fitness is the objective (WHO, 2014). PA encompasses exercise as well as other activities involving bodily movement including play, work, active transportation, house chores, and other recreational activities. The Department of Health and Human Services (DHHS) PA Guidelines defines “physical activity” as “any body movement that works your muscles and requires more energy than resting” (U.S. Department of Health and Human Services, 2014). In their early work investigating interventions to promote physical activity in AA women, Banks-Wallace and Conn (2002) expanded the definition to include bodily movements that produce progressive healthy benefits. Given the variability in how PA is defined, the following conceptual definition was used for this integrative review: Any bodily movement produced by skeletal muscles that results in energy expenditure. Operationalization is the process of outlining how a concept can be measured; this process is used to take an abstract idea and make it into an observable and measurable concept (Waltz, Strickland, & Lenz, 2010). The variability among the different instruments used to measure PA makes operationalization of the concept problematic. Previous studies have highlighted this challenge by advocating for greater precision and more clarity for the term PA in order to operationalize the concept in research (Cook, 2009). The DHHS PA Guidelines provide an operational definition of PA as “at least 150 minutes (2 hours and 30 minutes) a week of moderate-intensity, or 75 minutes (1 hour and 15 minutes) a week of vigorous-intensity aerobic physical activity, or an equivalent combination of moderate- and vigorous-intensity aerobic activity” (U.S. Department of Health and Human Services, 2014). However, in this review for PA among AA women within a CHD perspective, PA will be operationally defined as bodily activities performed for at least 10 minutes a day resulting in energy expenditure quantified using the following measures and standards: DHHS 2008 PA Guidelines, Centers for Disease Control and American College of Sports Medicine (CDC ACSM) PA Guidelines, DLW, indirect calorimetry, treadmill testing, actigraph, accelerometer, and pedometer; it is expressed as minutes of exercise per day or week, steps per day or week, metabolic equivalent (MET), maximum oxygen consumption (VO2max), kilocalories per day or week, and resting energy expenditure (REE). The self-report methods and objective measures used in AA women will be evaluated in the context of CHD.
Method
Search Strategy
The authors conducted a systematic search of the literature to review publications evaluating instruments used to measure PA in AA women. PubMed, CINAHL, PsycINFO, and PubMed Central databases were used to search for literature reporting on the reliability and validity of the instruments using various combinations of the following key terms: PA, motor activity, exercise, AAs, Blacks, African Continental Ancestry Group, female, women, data collection, surveys, questionnaires, measurement, reproducibility of results, and test validity. All located studies that described some form of PA among AA women and reported some form of measurement data were initially included. Located articles were excluded if there was no detailed description of reliability or validity measures, no full text English version, no association with CHD or chronic diseases, sample younger than 18 years of age, or fewer than 18% of AA women in the total sample. All the articles were collected in 2013. A summary of the systematic search of literature is presented in Figure 1.

Search strategy diagram.
Level of Evidence
The level of evidence for each study was appraised using the Center for Evidence Based Medicine Levels of Evidence (2009). Studies were evaluated and rated based on their strength of evidence.
Results
Initial search used a combination of key terminologies including Medical Subject Headings (MeSH®) terms and subject headings. Out of the initial 691 articles, 7 studies were included in the final review as summarized in Table 1.
Self-Report and Objective Measures of Physical Activity in African American Women.
Note. PAR = Physical Activity Recall; AAFQ = Arizona Activity Frequency Questionnaire; PHQ = Personal Habit Questionnaire; WHI = Women’s Health Initiative; DLW = doubly labeled water; AREE = activity-related energy expenditure; TEE = total energy expenditure; REE = resting energy expenditure; YPAS = Yale Physical Activity Survey; PAEE = Physical activity-related energy expenditure; IPAQ-S = International Physical Activity Questionnaire–Short; PAQ = Physical Activity Questionnaire; SEE = Self-Efficacy for Exercise Scale; OEE = Outcome Expectations for Exercise Scale; SESEP = Senior Exercise Self-Efficacy Pilot; MPA = Moderate Physical Activity; MET = metabolic equivalent; CDC ACSM = Centers for Disease Control and American College of Sports Medicine.
All seven studies included in this integrative review used self-report as the main measurement method. Six studies utilized a combination of self-reports and objective measures to assess validity and reliability of the primary instrument in the study (Buchowski et al., 2010; Masse et al., 2012; Neuhouser et al., 2013; Resnick, Luisi, Vogel, & Junaleepa, 2004; Resnicow et al., 2003; Whitt, Levin, Ainsworth, & Dubose, 2003; Wolin, Heil, Askew, Matthews, & Bennett, 2008). Only one study, “Reliability and Validity of the Self Efficacy for Exercise and Outcome Expectations for Exercise Scales with Minority Older Adults,” explicated a theoretical framework (Resnick et al., 2004).
Overall, 14 self-report questionnaires and surveys were used: Self-Efficacy for Exercise Scale (SEE), Outcome Expectations for Exercise Scale (OEE), Yale Physical Activity Survey (YPAS), Community Healthy Activities Model Program for Seniors (CHAMPS), Arizona Activity Frequency Questionnaire (AAFQ), 7-Day Physical Activity Recall (7-D PAR), Women’s Health Initiative Personal Habit Questionnaire (PHQ), Two-Part Survey Item to Assess Adherence to Moderate Physical Activity Recommendation (MPA), Physical Activity Records (PAR), Checklist Questionnaire, Global Questionnaire, 7-Day Diary Physical Activity Estimation Questionnaire, International Physical Activity Questionnaire–Short (IPAQ-S), and Physical Activity Questionnaire (PAQ; Buchowski et al., 2010; Masse et al., 2012; Neuhouser et al., 2013; Resnick et al., 2004; Resnicow et al., 2003; Whitt et al., 2003; Wolin et al., 2008). The self-report instruments were used to assess PA in sample of AAs along with other ethnic groups. None of the instruments were utilized exclusively on AA women.
Criterion validity was examined in the instruments used in this review. Five objective measures of PA were used to validate self-reports: DLW (Masse et al., 2012; Neuhouser et al., 2013), indirect calorimetry (Masse et al., 2012; Neuhouser et al., 2013), treadmill protocol (Resnicow et al., 2002), accelerometer (Masse et al., 2012; Whitt et al., 2003; Wolin et al., 2008), and pedometer (Whitt et al., 2003). Criterion validity correlations tended to be modest and inconsistent among AA women. The highest correlations were demonstrated between DLW total energy expenditure (TEE) and the Checklist and Global Questionnaires (.54-.62) and between diary and the questionnaires (.32-.67; Masse et al., 1998). Yet, correlations between accelerometer counts and the questionnaires in the same study were low (.30-.22; Masse et al., 1998). Higher correlations were found among males between maximum oxygen consumption (VO2max) and CHAMPS indices than among females; only the sports index significantly correlated among females (r = .19; Resnicow et al., 2002). Likewise, the IPAQ-S performed worse among AA women than among AA men when validated against accelerometer (Wolin et al., 2008). However, a study validating a two-part survey against accelerometer and pedometer revealed that the survey can reliably differentiate between higher and lower PA levels among AAs (Whitt et al., 2003). Participants who reported meeting the PA recommendation in the survey had significantly higher steps per day and kilocalories per day (all p < .0001) compared with those who reported not meeting the recommendation (Whitt et al., 2003).
Construct validity was established using factor analysis in one study (Resnick et al., 2004). Overall, construct validity demonstrated acceptable validity for body mass index (BMI), blood pressure, cholesterol, ethnicity, age, gender, educational attainment, and income (Buchowski et al., 2010; Masse et al., 2012; Neuhouser et al., 2013; Resnick et al., 2004; Resnicow et al., 2003; Whitt et al., 2003; Wolin et al., 2008). BMI and age were inversely correlated with steps per day, kilocalories per day, and self-reported PA among AA women (Buchowski et al., 2010; Masse et al., 2012; Neuhouser et al., 2013; Resnick et al., 2004; Resnicow et al., 2003; Whitt et al., 2003; Wolin et al., 2008). The study using the Modified CHAMPS Questionnaire reported high correlations with oxygen consumption for participants with income below US$30,000 and no college degree (Resnicow et al., 2002).
Internal consistency and reliability were reported in studies using the YPAS, SEE, and OEE, and in a study establishing reliability between the primary study with the reliability study group (Neuhouser et al., 2013; Resnick et al., 2004; Resnicow et al., 2003). Resnicow et al. (2003) reported 2-week test-retest correlations of total activity index of r = .5 and r = .65 for the YPAS. Although AA women and Hispanics under-reported PA in AAFQ and PAR, reproducibility of biomarker measures was reported examining energy expenditures using the self-report questionnaires, namely, AAFQ, PAR, and PHQ (R2 = 25.2, 21.5, and 21.8, respectively; Neuhouser et al., 2013). Furthermore, internal consistency was established for SEE and OEE with alpha coefficients of .89 and .90, and .72, and .88, respectively (Resnick et al., 2004).
Discussion, Gaps in the Literature, and Implications
The aim of this review was to evaluate self-report instruments that have been used to measure PA in AA women in the context of the risk for CHD. In general, the reviewed studies reported correlations between self-report and objective measures that were within previously observed ranges for determining PA levels. However, some of the self-report instruments used in the reviewed studies exhibited slight inconsistencies in validity among AA women. This was evident in both the self-report methods and objective measures. The use of objective measures was valuable for detecting systematic errors and bias. One study using indirect calorimeter and DLW as validation standards revealed differential bias by the instrument that resulted in over-reporting and under-reporting of some measures in the study (Neuhouser et al., 2013). Use of indirect calorimetry and DLW involve highly specified protocols using sophisticated laboratory equipment to analyze PA; if error is present among these methods, it is more likely to be systematic resulting from imprecise instrumentation across all participants.
Although all the studies examined the validity of the self-reports, only three studies evaluated reliability. A self-report instrument cannot be useful for what it intends to measure unless the instrument is able to assign scores consistently. Resnicow et al. (2003) reported 2-week test-retest correlations of total activity index of r = .5 and r = .65 for the YPAS. However, the authors did not perform test-retest reliability study on CHAMPS, the main self-report instrument used in the study. Reliability is an essential prerequisite of validity (Waltz, Strickland, Lenz, & Waltz, 2005). The variability and inconsistency in PA behavior adds additional challenges to establish reliability when administering self-report instruments.
Studies that utilized objective measures such as DLW and indirect calorimetry as criterion standards provide robust evidence of the test validity of self-report instruments in assessing PA in AA women. Moreover, DLW and indirect calorimetry are gold standards in measuring PA providing physiological evidence for precise validation (Vanhees et al., 2005). Logistical and financial constraints reduce feasibility and preclude widespread use of objective measures in many field-based studies (Aadahl & Jorgensen, 2003). In contrast, self-report methods are inexpensive, practical, and easy to administer in large-scale studies (Vanhees et al., 2005). Self-report instruments allow PA recommendations to be easily communicated and understood by the public. Issues such as under-reporting, over-reporting, or misreporting of actual PAs can restrict the reliability and validity of self-report methods (Mindell et al., 2014). As a result, establishing the validity of self-report instruments based on subjective assessment is extremely important.
Overall, findings in this review indicate that most self-report instruments evaluated in this review yielded modest validity and reliability consistent with previous studies. However, the limited number of AA women included in the studies used in this review may limit understanding about the direct effects of PA behaviors on specific health outcomes.
Conclusion and Limitations
The integrative review included a small spectrum of self-report instruments used to evaluate PA in AA women. The number of studies identified in this review may be limited by the search strategy method and publication date. Although a number of validation studies of self-report measures were included, none were conducted solely on AA women. However, the results are promising with the focus toward identifying the most accurate and practical instrument to measure PA in this population.
In conclusion, the findings highlight the need to identify and evaluate self-report instruments that can accurately assess PA behaviors among AA women and specifically support positive health outcomes. In addition, it is possible that AA women may have divergent views about PA and can influence their behavior toward PA measurement. Future studies should focus on developing culturally competent PA instruments and adapting self-report measures specifically for use on AA women. Identifying the most valid and reliable self-report instrument for AA women will help designate the most effective intervention to achieve their PA goals and ultimately reduce the risk for CHD.
Footnotes
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
