This study examines response rates for mixed-mode survey implementation involving mail and e-mail/Web components. Using Dillman's Tailored Design Method, 1,500 participants were sent a survey either (a) via mail with a follow-up contact via e-mail that directed them to a Web-based questionnaire or (b) via e-mail that directed them to a Web-based questionnaire with a follow-up contact via mail. Results indicate that these mixed-mode procedures produce moderately high response rates. However, the mail survey tended to be more effective than the e-mail/Web survey, when serving either as the initial contact or as the follow-up contact. These results suggest that survey implementation involving mail followed by e-mail/Web, or even mail-only approaches, may result in larger samples than implementation involving e-mail/Web followed by mail.
Bates, N. (2001). Internet versus mail as a data collection methodology from a high coverage population. Proceedings of the Annual Meeting of the American Statistical Association. Retrieved September 13, 2007, from http://www.amstat.org/sections/srms/Proceedings/y2001/y2001.html
2.
Bierer, S.B., Fishleder, A.J., Dannefer, E., Farrow, N., & Hull, A.L. (2004). Psychometric properties of an instrument designed to measure the educational quality of graduate training programs. Evaluation & The Health Professions, 27, 410-424.
3.
Birnbaum, M.H. (2004). Human research and data collection via the internet . Annual Review of Psychology, 55, 803-832.
4.
Bowling, J.M., Rimer, B.K., Lyons, E.J., Golin, C.E., Frydman, G., & Ribisl, K.M. (2006). Methodologic challenges of e-health research. Evaluation and Program Planning, 29, 390-396.
5.
Caspar, R. (2004). Results from the response mode and incentive experiment in 2000 (Report No. 18). Washington, DC: U.S. Census Bureau.
6.
Cobanoglu, C., Warde, B., & Moreo, P.J. (2001). A comparison of mail, fax, and Web-based survey methods. International Journal of Market Research, 43, 441-452.
7.
Cole, S.T. (2005). Comparing mail and Web-based survey distribution methods: Results of surveys to leisure travel retailers. Journal of Travel Research, 43, 422-430.
8.
Cook, C., Heath, F., Thompson, R.L. (2000). A meta-analysis of response rates in Web- or Internet-based surveys. Educational and Psychological Measurement, 60, 821-836.
9.
Couper, M.P. (2000). Web surveys: A review of issues and approaches . Public Opinion Quarterly, 64, 464-494.
10.
de Leeuw, E.D. (2005). To mix or not to mix data collection modes in surveys. Journal of Official Statistics, 21, 233-255.
11.
Dillman, D.A. (2007). Mail and Internet surveys: The tailored design method (2nd ed., 2007 update). Hoboken, NJ: John Wiley & Sons.
12.
Dillman, D.A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., & Berck, J. (2001). Response rate and measurement differences in mixed mode surveys using mail, telephone, interactive voice response and the Internet . Retrieved May 1, 2007, from http://www.sesrc.wsu.edu/dillman/papers/Mixed%20Mode%20ppr%20_with%20Gallup_%20POQ.pdf
13.
Dillman, D.A., West, K.K., & Clark, J.R. (1994). Influence of an invitation to answer by telephone on response to census questionnaires. Public Opinion Quarterly , 58, 557-568.
14.
Fricker, R.D., & Schonlau, M. (2002). Advantages and disadvantages of Internet research surveys: Evidence from the literature. Field Methods, 14, 347-367.
15.
Karras, B.T., & Tufano, J.T. (2006). Multidisciplinary eHealth survey evaluation methods . Evaluation and Program Planning, 29, 413-418.
16.
Kiernan, N.E., Kiernan, M., Oyler, M.A., & Gilles, C. (2005). Is a Web survey as effective as a mail survey? A field experiment among computer users. American Journal of Evaluation, 26, 245-252.
17.
Klassen, R.D., & Jacobs, J. (2001). Experimental comparison of Web, electronic and mail survey technologies in operations management. Journal of Operations Management, 19, 713-728.
18.
Kwak, N., & Radler, B. (2002). A comparison between mail and Web surveys: Response pattern, respondent profile, and data quality. Journal of Official Statistics, 18, 257-273.
19.
Leece, P., Bhandari, M., Sprague, S., Swiontkowski, M.F., Schemitsch, E.H., Tornetta, P., et al. (2004). Internet versus mailed questionnaires: A controlled comparison. Journal of Medical Internet Research , 6. Retrieved January 15, 2007 , from http://www.jmir.org/2004/4/e39
20.
McCabe, S.E. (2004). Comparison of Web and mail surveys in collecting illicit drug use data: A randomized experiment. Journal of Drug Education, 34, 61-72.
21.
McCabe, S.E., Diez, A., Boyd, C.J., Nelson, T.F., & Weitzman, E.R. (2006). Comparing Web and mail responses in a mixed mode survey in college alcohol use research. Addictive Behaviors, 31, 1619-1627.
22.
Raziano, D.B., Jayadevappa, R., Valenzula, D., Weiner, M., & Lavizzo-Mourey, R. (2001). E-mail versus conventional postal mail survey of geriatric chiefs. The Gerontologist , 41, 799-804.
23.
Schaefer, D.R., & Dillman, D.A. (1998). Development of a standard e-mail methodology: Results of an experiment. Public Opinion Quarterly, 62, 378-397.
24.
Schonlau, M., Asch, B.J., & Du, C. (2003). Web surveys as part of a mixed-mode strategy for populations that cannot be contacted by e-mail. Social Science Computer Review, 21, 218-222.
25.
Truell, A.D., Bartlett, J.E., & Alexander, M.W. (2002). Response rate, speed, and completeness: A comparison of Internet-based and mail surveys. Behavior Research Methods, Instruments, & Computers, 34, 46-49.
26.
Yun, G.W., & Trumbo, C.W. (2000). Comparative response to a survey executed by post, e-mail, & Web form. Journal of Computer-Mediated Communication , 6. Retrieved January 15, 2007 , from http://jcmc.indiana.edu/vol6/issue1/yun.html
