Computer Literacy and the Accuracy of Substance Use Reporting in an ACASI Survey

Abstract

In recent years, audio computer-assisted self-interviews (ACASI) have been demonstrated to increase and presumably improve the quality of drug reporting in epidemiologic research. Surprisingly little research is available, however, regarding the potential limitations of this technique. For example, it is unclear what effects computer literacy may have on the validity of substance use information collected via ACASI. Respondents with limited computer skills may become distracted by the automated technology, requiring the devotion of considerable cognitive effort to the navigation of unfamiliar computer equipment and software that would otherwise be available for use to more carefully process and answer survey questions. In this study, we report findings from a community ACASI survey conducted in Chicago, which are used to address this problem. Using multiple indicators of computer literacy, a covariance structure model was developed to test the hypothesis that persons with low computer literacy skills may report drug use with less accuracy. Biological assays were used to evaluate 30-day cocaine use reporting accuracy. Model findings confirmed a positive relationship between computer literacy and the accuracy of cocaine use reports. Future research should investigate strategies for improving the usability of self-administrated computer reporting systems for persons with little direct computer experience.

Keywords

ACASI computer literacy drug use surveys

Get full access to this article

View all access options for this article.

References

American Association for Public Opinion Research. ( 2000). Standard definitions: Final dispositions of case codes and outcome rates for surveys. Ann Arbor, MI: Author.

Aquilino, W.S. ( 1994). Interview mode effects in surveys of drug and alcohol use: A field experiment. Public Opinion Quarterly , 58, 210-240.

Babor, T.F. , Brown, J. , & DelBoca, F.K. ( 1990). Validity of self-reports in applied research on addictive behaviors: Fact of fiction? Behavioral Assessment , 12, 5-31.

Bunz, U. ( 2004). The computer-email-web (CEW) fluency scale-development and validation. International Journal of Human-Computer Interaction , 17, 479-506.

Cone, E.J. ( 1997). New developments in biological measures of drug prevalence . In Harrison L. & Hughes A. (Eds.), The validity of self-reported drug use: improving the accuracy of survey estimates (pp. 108-129). NIDA Research Monograph 167. Rockville, MD: U.S. Department of Health and Human Services.

Couper, M.P. , & Rowe, B. ( 1996). Evaluation of a computer-assisted self interview component in a computer-assisted personal interview survey. Public Opinion Quarterly, 60, 89-105.

Couper, M.P. , Tourangeau, R. , & Marvin, T. ( 2009). Taking the audio out of audio-CASI. Public Opinion Quarterly, 73, 281-303.

Fendrich, M. , & Johnson, T.P. ( 2001). Examining prevalence differences in three national surveys of youth: Impact of consent procedures, mode, and editing rules. Journal of Drug Issues, 31, 695-716.

Fendrich, M. , Johnson, T.P. , Wislar, J.S. , & Hubbell, A. ( 2004). Drug test feasibility in a general population household survey. Drug and Alcohol Dependence, 73, 237-250.

10.

Fendrich, M. , Johnson, T.P. , Wislar, J.S. , Hubbell, A. , & Spiehler, V. ( 2004). The utility of drug testing in epidemiological research: results from a general population survey. Addiction , 99, 197-208.

11.

Groves, R.M. , & Couper, M.P. ( 1998). Nonresponse in household interview surveys. New York: John Wiley & Sons.

12.

Hargittai, E. ( 2005). Survey measures of web-oriented digital literacy . Social Science. Computer Review, 23, 371-379.

13.

Hargittai, E. ( 2009). An update on survey measures of Web-oriented digital literacy. Social Science Computer Review, 27, 130-137.

14.

Harrison, L. , & Hughes, A. ( 1997). The validity of self-reported drug use: Improving the accuracy of survey estimates. NIDA Research Monograph 167. Rockville, MD: National Institute on Drug Abuse.

15.

Harmon, T. , Turner, C.F. , Rogers, S.M. , Eggleston, E. , Roman, A.M. , Villarroel, M.A. , et al. (2009). Impact of T-ACASI on survey measurements of subjective phenomena. Public Opinion Quarterly, 73, 255-280.

16.

Hayduk, L.A. ( 1987). Structural equation modeling with LISREL: Essentials and advances. Baltimore: Johns Hopkins University Press.

17.

Johnson, T.P. , O’Rourke, D. , Burris, J. , & Warnecke, R.B. (2005). An investigation of the effects of social desirability on the validity of self-reports of cancer screening behaviors. Medical Care, 43, 565-573.

18.

Jöreskog, K.G. , & Sörbom, D. (1993a). PRELIS 2 user’s reference guide. Chicago: Scientific Software International.

19.

Jöreskog, K.G. , & Sörbom, D. (1993b). LISREL 8 user’s reference guide. Chicago: Scientific Software International.

20.

Kennet, J. , & Gfroerer, J. ( 2005). Evaluating and improving methods used in the National Survey on Drug Use and Health. Rockville, MD: Substance Abuse and Mental Health Services Administration.

21.

Levy, P.S. , & Lemeshow, S. ( 1991). Sampling of populations: Methods and applications . New York: John Wiley & Sons, Inc.

22.

Office of Applied Studies. (2001). Development of computer-assisted interviewing procedures for the National Household Survey on Drug Abuse. Rockville, MD: Substance Abuse and Mental Health Services Administration.

23.

O’Reilly, J.M. , Hubbard, M.L. , Lessler, J.T. , Biemer, P.P. , & Turner, C.F. ( 1994). Audio and video computer assisted self-interviewing: Preliminary tests of new technologies for data collection. Journal of Official Statistics, 10, 197-214.

24.

Rouse, B.A. , Kozel, N.J. , & Richards, L.G. (1985). Self-report methods of estimating drug use: Meeting current challenges to validity. NIDA Research Monograph 57. Rockville, MD: National Institute on Drug Abuse.

25.

Substance Abuse and Mental Health Services Administration. ( 2007). Results from the 2006 National Survey on Drug Use and Health: National findings. NSDUH Series H-32. DHHS Publication No. SMA 07-4293. Rockville, MD: Office of Applied Studies. Retrieved June 24, 2009, from http://www.oas.samhsa.gov/p0000016.htm#2k6

26.

Turner, C.F. , Ku, L. , Rogers, S.M. , Lindberg, L.D. , Pleck, J.H. , & Sonenstein , F.L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280, 867-873.

27.

Turner, C.F. , Lessler, J.T. , & Gfroerer, J.C. (1992). Survey measurement of drug use: Methodological studies. Rockville, MD: National Institute on Drug Abuse.

28.

Wolff, K. , Farrell, M. , Marsden, J. , Monteiro, M.G. , Ali, R. , Welch, S. , & Strang, J. ( 1999). A review of biological indicators of illicit drug use, practical considerations and clinical usefulness. Addiction , 94, 1279-1298.