To evaluate the cost-effectiveness of a lottery on physicians’ responses to a mail survey, a randomized controlled trial was conducted with a random sample of 1,000 members of the Quebec Federation of General Practitioners in 1997. For the first mailing of this survey, each respondent was randomly assigned to the control or experimental group, which was offered participation in a lottery upon return of the questionnaire. Response rate was 41.2% in the experimental group and 34.8% in the control group, a 6.4% difference (CI95%: 0.6% – 12.6%). The additional cost of the lottery was about Can$500, giving an incremental cost of Can$16 per questionnaire returned. In conclusion, a lottery resulted in a small but statistically significant increase in the response rate of physicians to a mail survey. This method may be a cost-effective option when applied to large surveys.
Get full access to this article
View all access options for this article.
References
1.
Aday, L. A.
(1996). Designing and conducting health surveys. San Francisco: Jossey-Bass.
2.
Armstrong, J. S.
, & Lusk, E. J. (1987). Return postage in mail surveys: A meta-analysis. Public Opinion Quarterly, 51, 233-248.
3.
Asch, D. A.
, Jedrziewski, M. K., & Christakis, N. A. (1997). Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology, 50, 1129-1136.
4.
Barrier, J. H.
, Briolet, V., & Peltier, P. (1988). Le généraliste et la vaccination antigrippale [The physician and the influenza vaccine]. Le Concours Medical, 110, 27-32.
5.
Berk, M. L.
, Edwards, W. S., & Gay, N. L. (1993). The use of a prepaid incentive to convert nonresponders on a survey of physicians. Evaluation & the Health Professions, 16, 239-245.
6.
Berry, S. H.
, & Kanouse, D. E. (1987). Physician response to a mailed survey: An experiment in timing of payment. Public Opinion Quarterly, 51, 102-114.
7.
Church, A. H.
(1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62-79.
8.
Daniel, W. W.
(1995). Biostatistics: A foundation for analysis in the health sciences. New York: John Wiley.
9.
Dillman, D. A.
(1978). Mail and telephone surveys: The total design method. New York: John Wiley.
10.
Everett, S. A.
, Price, J. H., Bedell, A. W., & Telljohann, S. K. (1997). The effect of a monetary incentive in increasing the return rate of a survey to family physicians. Evaluation & the Health Professions, 20, 207-214.
11.
Fleiss, J. L.
(1981). Statistical methods for rates and proportions. New York: John Wiley.
12.
Fox, R. J.
, Crask, M. R., & Kim, J. (1988). Mail survey response rate: A meta-analysis of selected techniques for inducing response. Public Opinion Quarterly, 52, 467-491.
13.
Hopkins, K. D.
, & Gullinckson, A. R. (1992). Response rates in survey research: A meta-analysis of the effects of monetary gratuities. Journal of Experimental Education, 61, 52-62.
14.
Hubbard, R.
, & Little, E. (1988). Promised contributions to charity and mail survey responses: Replication with extension. Public Opinion Quarterly, 52, 222-230.
15.
Nichol, K. L.
, & Hauge, M. (1997). Influenza vaccination of healthcare workers. Infection Control and Hospital Epidemiology, 18, 189-194.
16.
Pachucki, C. T.
, Lentino, J. R., & Jackson, G. G. (1985). Attitudes and behavior of health care personnel regarding the use and efficacy of influenza vaccine. Journal of Infectious Diseases, 151, 1170-1171.
17.
Shiono, P. H.
, & Klebanoff, M. A. (1991). The effect of two mailing strategies on the response to a survey of physicians. American Journal of Epidemiology, 134, 539-542.
18.
Warriner, K.
, Goyder, J., Gjertsen, H., Hohner, P., & McSpurren, K. (1996). Charities, no; lotteries, no; cash, yes: Main effects and interactions in a Canadian incentives experiment. Public Opinion Quarterly, 60, 542-562.
19.
Weingarten, S.
, Riedinger, M., Bolton, L. B., Miles, P., & Ault, M. (1989). Barriers to influenza vaccine acceptance: A survey of physicians and nurses. American Journal of Infection Control, 17, 202-207.
20.
Yammarino, F. J.
, Skinner, S. J., & Childers, T. L. (1991). Understanding mail survey response behavior: A meta-analysis. Public Opinion Quarterly, 55, 613-639.
21.
Yassi, A.
, Murdzak, C., Cheang, M., Tran, N., & Aoki, F. Y. (1994). Influenza immunization: Knowledge, attitude and behavior of health care workers. Canadian Journal of Infection Control, 9, 103-108.
22.
Yu, J.
, & Cooper, H. A. (1983). Quantitative review of research design effects on response rates to questionnaires. Journal of Marketing Research, 20, 36-44.
