Abstract
Adult Americans are encouraged to engage in at least 150 minutes of moderate to vigorous physical activity (MVPA) each week. National surveys that collect physical activity data to assess whether or not adults adhere to this guideline use self-report questionnaires that are prone to measurement error and nonresponse. Studies have examined the individual effects of each of these error sources on estimators of physical activity, but little is known about the consequences of not adjusting for both error sources. We conducted a simulation study to determine how estimators of adherence to the guideline for adults to engage in 150 minutes of MVPA each week respond to different magnitudes of measurement and nonresponse errors in self-reported physical activity survey data. Estimators that adjust for both measurement and nonresponse errors provide the least amount of bias regardless of the magnitudes of measurement error and nonresponse. In some scenarios, the naïve estimator, which does not adjust for either error source, results in less bias than estimators that adjust for only one error source. To avoid biased physical activity estimates using data collected from self-report questionnaires, researchers should adjust for both measurement error and nonresponse.
Keywords
References
1.
Adams, S.A., C.E. Matthews, C.B. Ebbeling, C.G. Moore, J.E. Cunningham, J. Fulton, and J.R. Hebert. 2005. “The Effect of Social Desirability and Social Approval on Self-Reports of Physical Activity.” American Journal of Epidemiology 161: 389–398. Doi: https://doi.org/10.1093/aje/kwi054.
2.
Ainsworth, B.E., W.L. Haskell, M.C. Whitt, M.L. Irwin, A.M. Swartz, S.J. Strath, W.L. O’Brien, D.R. Bassett, K.H. Schmitz, P.O. Emplaincourt, and D.R. Jacobs. 2000. “Compendium of Physical Activities: An Update of Activity Codes and MET Intensities.” Medicine and Science in Sports and Exercise 32: S498–S504. Available at: https://pdfs.semanticscholar.org/314e/dc8553c9a5920a14eb799b67c2a11e07b8bf.pdf (accessed April 2017).
3.
Bassett, D.R., A.L. Cureton, and B.E. Ainsworth. 2000. “Measurement of Daily Walking Distance: Questionnaire versus Pedometer.” Medicine and Science in Sports and Exercise 32: 1018–1023. Available at: http://journals.lww.com/acsm-msse/pages/articleviewer.aspx?year=2000&issue=05000&article=00021&type=abstract (accessed April 2017).
4.
Beyler, N., S. James-Burdumy, M. Bleeker, J. Fortson, and M. Benjamin. 2015. “Estimated Distributions of Usual Physical Activity During Recess”. Medicine and Science in Sports and Exercise 46: 1197–1203. Doi: https://doi.org/10.1249/MSS.0000000000000535.
5.
Carroll, R.J., D. Ruppert, and L.A. Stefanski. 2006. Measurement Error in Nonlinear Models . New York: CRC Press.
6.
Crouter, S.E., K.G. Clowers, and D.R. Bassett. 2006. “A Novel Method for Using Accelerometer Data to Predict Energy Expenditure.” Journal of Applied Physiology 100: 1324–1331. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1152/japplphysiol.00818.2005.
7.
Dodd, K.W., P.M. Guenther, L.S. Freedman, A.F. Subar, V. Kipnis, D. Midthune, J.A. Tooze, and S.M. Krebs-Smith. 2006. “Statistical Methods for Estimating Usual Intake of Nutrients and Foods: A Review of the Theory.” Journal of the American Dietetic Association 106: 1640–1650. Doi: http://doi.org/10.1016/j.jada.2006.07.011.
8.
Ferrari, P., C. Friedenreich, and C.E. Matthews. 2007. “The Role of Measurement Error in Estimating Levels of Physical Activity.” American Journal of Epidemiology 166: 832–840. Doi: https://doi.org/10.1093/aje/kwm148.
9.
Groves, R.M. and L. Lyberg. 2010. “Total Survey Error: Past: Present, and Future.” Public Opinion Quarterly 74: 849–879. Doi: https://doi.org/10.1093/poq/nfq065.
10.
Hill, A., J. Roberts, P. Ewings, and D. Gunnell. 1997. “Non-Response Bias in a Lifestyle Survey.” Journal of Public Health 19: 203–207. Doi: https://doi.org/10.1093/oxfordjournals.pubmed.a024610.
11.
Lessler, J.T. and W.D. Kalsbeek. 1992. Nonsampling Error in Surveys . New York: Wiley.
12.
Loustalot, F., S.A. Carlson, J.E. Fulton, J. Kruger, D.A. Galuska, and F. Lobelo. 2009. “Prevalence of Self-Reported Aerobic Physical Activity among US States and Territories–Behavioral Risk Factor Surveillance System, 2007.” Journal of Physical Activity and Health 6: S9–S17. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1123/jpah.6.s1.s9.
13.
Matthews, C.E. 2002. “Use of Self-Report Instruments to Assess Physical Activity.” In Physical Activity Assessments for Health Related Research , edited by G.J. Welk, 107–123. Champaign: Human Kinetics.
14.
Matthews, C.E. 2005. “Calibration of Accelerometer Output for Adults.” Medicine and Science in Sports and Exercise 37: S512–S522. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1249/01.mss.0000185659.11982.3d.
15.
Nusser, S.M., N.K. Beyler, G.J. Welk, A.L. Carriquiry, W.A. Fuller, and B. King. 2012. “Modeling Errors in Physical Activity Recall Data.” Journal of Physical Activity and Health 9: S56–S67. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1123/jpah.9.s1.s56.
16.
Sallis, J.F. and B.E. Saelens. 2000. “Assessment of Physical Activity by Self-Report: Status, Limitations and Future Directions.” Research Quarterly for Exercise and Sport 71: 1–14. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1080/02701367.2000.11082780.
17.
Schoenborn, C.A. and M. Stommel. 2011. “Adherence to the 2008 Adult Physical Activity Guidelines and Mortality Risk.” American Journal of Preventive Medicine 40: 514–521. Doi: http://doi.org/10.1016/j.amepre.2010.12.029.
18.
Smith, C. and D. Nutbeam. 1990. “Assessing Non-Response Bias: A Case Study from the 1985 Welsh Heart Health Survey.” Health Education Research 5: 381–386. Doi: https://doi.org/10.1093/her/5.3.381.
19.
Tooze, J.A., R.P. Troiano, R.J. Carroll, A.J. Moshfegh, and L.S. Freedman. 2013. “A Measurement Error Model for Physical Activity Level as Measured by a Questionnaire with Application to the 1999–2006 NHANES Questionnaire.” American Journal of Epidemiology 177: 1199–1208. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1093/aje/kws379.
20.
Troiano, R.P., D. Berrigan, K.W. Dodd, L.C. Masse, T. Tilert, and M. McDowell. 2008. “Physical Activity in the United States Measured by Accelerometer.” Medicine and Science in Sports and Exercise 40: 181–188. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1249/mss.0b013e31815a51b3.
21.
Tucker, J.M., G.J. Welk, and N.K. Beyler. 2011. “Physical Activity in U.S. Adults: Compliance with the Physical Activity Guidelines for Americans.” American Journal of Preventative Medicine 40: 454–461. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1016/j.amepre.2010.12.016.
22.
U.S. Department of Health and Human Services. 2008. 2008 Physical Activity Guidelines for Americans . Atlanta: HHS. Available at: http://health.gov/paguidelines (accessed November 2015).
23.
Van Loon, A.J.M., M. Tijhuis, H.S.J. Picavet, P.G. Surtees, and J. Ormel. 2003. “Survey Non-Response in the Netherlands: Effects on Prevalence Estimates and Associations.” Annals of Epidemiology 13: 105–110. Doi: http://doi.org/10.1016/S1047-2797(02)00257-0.
24.
Vink, J.M., G. Willemsen, J.H. Stubbe, C.M. Middeldorp, R.S. Ligthart, K.D. Baas, H.J. Dirkzwager, E.J. de Geus, and D.I. Boomsma. 2004. “Estimating Non-Response Bias in Family Studies: Application to Mental Health and Lifestyle.” European Journal of Epidemiology 19: 623–630. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1023/B:EJEp.0000036814.56108.66.
25.
Warnecke, R.B., T.P. Johnson, N. Chavez, S. Sudman, D.P. O’rourke, L. Lacey, and J. Horm. 1997. “Improving Question Wording in Surveys of Culturally Diverse Populations.” Annals of Epidemiology 7: 334–342. Doi: https://doi.org/10.1016/S1047-2797(97)00030-6.
26.
Welk, G.J. 2002. “Introduction to Physical Activity Research.” In Physical Activity Assessments for Health Related Research , edited by G.J. Welk, 3–18. Champaign: Human Kinetics.