This retrospective case study assessed the influence of item non-response error on subsequent response to questionnaire items assessing adolescent alcohol and marijuana use. Post-hoc analyses were conducted on survey results obtained from 4,371 7th to 12th grade students in Ohio in 2005. A skip pattern design in a conventional questionnaire appeared to increase non-response error rates at first introduction. In previous cigarette users, these errors were associated with under-reporting of alcohol and marijuana use on subsequent questions. These effects were less prevalent in high-achieving students. Skip patterns can contribute to substantial underestimation of alcohol and marijuana use in adolescents.
Get full access to this article
View all access options for this article.
References
1.
AdairE. B. (1995). Assessing consistency of responses to questions on cocaine use. Addiction, 90(11), 1497–1502.
2.
BethellC. D.ReadD.SteinR. E. K.BlumbergS. J.WellsN.NewacheckP. W. (2002). Identifying children with special health care needs: Development and evaluation of a short screening instrument. Ambulatory Pediatrics: The Official Journal of the Ambulatory Pediatric Association, 2(1), 38–48.
3.
BrenerN. D.KannL.KinchenS. A.GrunbaumJ. A.WhalenL.EatonD. (2004). Methodology of the youth risk behavior surveillance system. Morbidity and Mortality Weekly Report, 53(RR-12), 1–13.
4.
DillmanD. A.Carley-BaxterL.JacksonA. (1999). Skip pattern compliance in three test forms: A theoretical and empirical evaluation. SESRC Technical Report #99-01 Social and Economic Sciences Research Center, Washington State University, Pullman.
5.
FeatherstonF.MoyL. (1990). Item non-response in mail surveys. Paper presented at the International Conference of Measurement Errors in Surveys, Tucson, Arizona.
6.
GfroererJ.LesslerJ.ParsleyT. (1997). Studies of nonresponse and measurement error in the National Household Survey on Drug Abuse. In HarrisonL.HughesA. (Eds.), The validity of self-reported drug use: Improving the accuracy of survey estimates (NIH Publication No. 97-4147, NIDA Research Monograph 167, pp. 273–295). Rockville, MD: National Institute on Drug Abuse.
7.
GowerA. R.DibbsR. (1989). Cognitive research: Designing a respondent friendly questionnaire for the 1991 census. Proceeding from the Bureau of the Census Fifth Annual Research Conference, Washington, D.C.
8.
GrovesR. M. (1987). Research on survey data quality: Survey research as a methodology without a unifying theory. Public Opinion Quarterly, 51, S156–S172.
9.
GrovesR. M.DillmanD. A.EltingeJ. L.LittleR. J. A. (2002). Survey nonresponse. New York: Wiley-Interscience.
10.
HairJ. F.AndersonR. E.TathamR. L.BlackW. K. (1998). Multivariate data analysis (5th Ed.). New Jersey: Prentice Hall.
11.
HoltzS. A.StantonC. K. (2007). Assessing the quality of cesarean birth data in the demographic and health surveys. Studies in Family Planning, 38(1), 47–54.
12.
JenkinsC. R.DillmanD. A. (1997). Towards a theory of self-administered questionnaire design. In LybergL.BiemerP.CollinsM.DeckerL.DeleeuwE.DippoC.SchwarzN.TrewinD. (Eds.), Survey measurement and process quality. New York: Wiley-Interscience.
13.
JohnstonL. D.O'MalleyP. M.BachmanJ.G. (1997). National survey results on drug use from the Monitoring the Future study, 1975–1995. Volume II: College students and young adults. (NIH Publication No. 98-4140). Rockville, MD: National Institute on Drug Abuse.
14.
MessmerD. J.SeymourD. T. (1982). The effects of branching on item non-response. Public Opinion Quarterly, 46, 270–277.
15.
PeytchevA.CouperM.McCabeS.CrawfordS. (2006). Web survey design. Public Opinion Quarterly, 70(4), 596–607.
16.
RaglinD. A. (1997). Using the 1996 national content survey to measure the impact of alternative skip patterns on the collection of employment data. Proceedings from the 157th American Statistical Association Joint Statistical Meetings, the Survey Research Methods section. Anaheim, CA: Hilton/Marriott.
17.
RedlineC. D.DillmanD. A. (1999). The influence of auxiliary, symbolic, numeric, and verbal language on navigational compliance in self-administered questionnaires. Retrieved September 22, 2007, from Don A. Dillman, Social and Economic Sciences Research Center, Washington State University Website: http://survey.sesrc.wsu.edu/dillman/papers/Auxiliary,Symbolic,Numeric%20paper-with%20Cleo.pdf
18.
TurnerC. F.LesslerJ. T.GeorgeB. J.HubbardM. L.WittM. B. (1992). Effects of mode of administration and wording on reporting of drug use. In TunerC. F.LesslerJ. T.GfroererJ. C. (Eds.), Survey measurement of drug use methodological studies. (DHHS Publication No. ADM 92-1929, pp. 221–244). Rockville, MD: National Institute on Drug Abuse.
19.
U.S. Department of Education, Safe and Drug-Free Schools and Communities Advisory Committee. (2007). Enhancing achievement and proficiency through safe and drug-free schools. Washington, D.C.: Government Printing Office.
20.
ZukerbergA.HessJ. (1996). Uncovering adolescent perceptions: Experiences conducting cognitive interviews. Proceedings from the 156th American Statistical Association Joint Statistical Meetings, the Survey Research Methods section. Chicago, IL: Hyatt.
