Construct validity of a revised Physical Activity Scale and testing by cognitive interviewing

Abstract

Aim: To validate the construct validity of a new version of a Physical Activity Scale (PAS 2) for measuring average weekly physical activity of sleep, work, and leisure time to determine whether a further criterion validation is justified. Methods: The validity of responses to the questionnaire was evaluated by cognitive interviewing in 16 Danish men and women aged 21—70 years. Construct validity was validated in 342 men and women aged 35—66 years by assessing agreement between 24-h MET-scores obtained from average weekly physical activity measured by PAS 2 and a 24-h Physical Activity Scale (PAS 1), previously found to overestimate physical activity. Results: Cognitive interviewing revealed few problems in the questions on physical activity in different domains. No problems regarding the structure of the questionnaire were identified. The agreement between PAS 1 and PAS 2 MET-scores was high among participants with a PAS 1 24-h MET-score <45 MET-hours. Among participants with a PAS 1 24-h MET-score ≥45 MET-hours, the weekly-based scale, PAS 2, systematically estimated fewer MET-hours compared to the 24-h based scale, PAS 1. The difference increased proportionally with the average of the two MET-scores. Conclusions: Few, small, lexical revisions were implemented into the new scale to improve the validity. As hypothesized, PAS 2 produced lower estimates of energy expenditure compared to PAS 1, indicating that the new scale may provide more valid measurements and that further validation against an objective criterion is justified.

Keywords

Cognitive interviewing energy expenditure MET-hours physical activity validity

Get full access to this article

View all access options for this article.

References

Pedersen BK , Saltin B. Evidence for prescribing exercise as therapy in chronic disease. Scand J Med Sci Sports 2006;16(Suppl 1):3-63.

Haennel RG , Lemire F.

Physical activity to prevent cardiovascular disease. How much is enough?

Can Fam Physician 2002 Jan;48:65-71.

Lagerros YT , Lagiou P. Assessment of physical activity and energy expenditure in epidemiological research of chronic diseases. Eur J Epidemiol 2007;22(6):353-62.

Shephard RJ Limits to the measurement of habitual physical activity by questionnaires. Br J Sports Med 2003;37(3):197-206.

Fayers PM , Machin D. Score and measurements: validity, reliability, sensitivity. In: Fayers PM , Machin D , editors. Quality of life: assessment, analysis, and interpretation . Chichester: John Wiley & Sons Ltd; 2001. pp. 45-71.

Lagerros YT , Mucci LA , Bellocco R. , Nyren O. , Balter O. , Balter KA Validity and reliability of self-reported total energy expenditure using a novel instrument . Eur J Epidemiol 2006;21(3):227-36.

Aadahl M. , Jorgensen T. Validation of a new self-report instrument for measuring physical activity . Med Sci Sports Exerc 2003;35(7):1196-202.

Ainsworth BE , Haskell WL , Leon AS , Jacobs DR, Jr. , Montoye HJ , Sallis JF , et al. Compendium of physical activities: classification of energy costs of human physical activities . Med Sci Sports Exerc 1993;25(1):71-80.

Aadahl M. , Kjaer M. , Kristensen JH , Mollerup B. , Jorgensen T. Self-reported physical activity compared with maximal oxygen uptake in adults . Eur J Cardiovasc Prev Rehabil 2007;14(3):422-8.

10.

Aadahl M. , Kjaer M. , Jorgensen T. Associations between overall physical activity level and cardiovascular risk factors in an adult population. Eur J Epidemiol 2007;22(6):369-78.

11.

Ainsworth BE , Haskell WL , Whitt MC , Irwin ML , Swartz AM , Strath SJ , et al. Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sports Exerc 2000;32(9 Suppl):S498-S504.

12.

Beatty PC , Willis GB Research synthesis: the practice of cognitive interviewing. Public Opin Q 2007 ;71(2):287-311.

13.

Conrad F. , Blair J. Aspects of data quality in cognitive interviews: the case of verbal reports . In: Presser S , Rothgeb J , Couper M , Lessler J , Martin E , Martin J , et al, editors. Questionnaire development, evaluation and testing methods. New York: John Wiley and Sons; 2004. pp. 67-88.

14.

Willis GB , Caspar RA , Lessler JT Cognitive interviewing: a ‘‘how to’’ guide. Reducing survey error through research on the cognitive and decision processes in surveys . Research Triangle Park, NC: Research Triangle Institute; 1999. pp. 1-41.

15.

Tourangeau R. Cognitive science and survey methods. In: Jabine TB , Straf ML , Tanur JM , Taurangeau R , editors. Cognitive aspects of survey methodology: building bridges between disciplines. Washington DC: National Academy Press; 1984. pp. 73-100.

16.

Linneberg A. Mere om helbred2006. Research Centre for Prevention and Health 2007 May 24. Available from: http://www.sundhed.dk/wps/portal/_s.155/1923?_ARTIKEL_ID_=2708060920104058&_ARTIKELGRUPPE_ID_=1021041102101619&contextfolderids=2708060920124850%2C2708060920124850 (accessed 19 October 2008).

17.

Conrad F. , Blair J. From impressions to data: increasing the objectivity of cognitive interviews . Alexandria, VA: American Statistical Association; 1996. pp. 1-10.

18.

Jorgensen T. , Borch-Johnsen K. , Thomsen TF , Ibsen H. , Glumer C. , Pisinger C. A randomized non-pharmacological intervention study for prevention of ischaemic heart disease: baseline results Inter99 . Eur J Cardiovasc Prev Rehabil 2003;10(5):377-86.

19.

Bland JM , Altman DG Measuring agreement in method comparison studies. Stat Methods Med Res 1999;8(2):135-60.

20.

Durante R. , Ainsworth BE The recall of physical activity: using a cognitive model of the question-answering process. Med Sci Sports Exerc 1996;28(10):1282-91.

21.

Conrad F. , Blair J. , Tracy E. Verbal reports are data! A theoretical approach to cognitive interviews . In: Proceedings of the Federal Committee on Statistical Methodology Research Conference, 1999 Tuesday B Sessions. Arlington, VA; 1999. pp. 11-20.

22.

Schmidt ME , Slanger T. , Chang-Claude J. , Wahrendorf J. , Steindorf K. Evaluation of a short retrospective questionnaire for physical activity in women. Eur J Epidemiol 2006;21(8):575-85.