Nonresponse is a serious threat to validity in mail surveys, prompting the need for research on techniques for increasing response rates. The relative effectiveness of personalized versus form covering letters in obtaining responses in a mail questionnaire survey was investigated for both initial and follow-up mailings. A questionnaire eliciting opinions about content in college courses in measurement was sent to 1000 Utah school teachers, randomly divided into two groups, with 500 receiving personalized letters and 500 receiving form letters. Nonrespondents in each group were randomly divided, with half receiving personalized follow-up letters and half receiving form follow-up letters. Using nondirectional hypothesis tests, no statistically significant differences were found in the relative effectiveness of personalized or form letters in either initial or follow-up mailings. These findings do not support the widely held belief that personalized covering letters improve response rates.
References
1.
AdamsL. L.GaleD.Solving the quandary between questionnaire length and response rate in educational research. Research in Higher Education, 1982, 17, 231–240.
2.
AndersonJ. F.BerdieD. R.Effects on response rates of formal and informal questionnaire follow-up Techniques. Journal of Applied Psychology, 1975, 60, 255–257.
3.
AndreasenA. R.Personalizing mail questionnaire correspondence. Public Opinion Quarterly, 1970, 34, 273–277.
4.
ArmstrongJ. S.Monetary incentives in mail surveys. Public Opinion Quarterly, 1975, 39, 111–116.
5.
ArmstrongJ. S.OvertonT. S.Estimating nonresponse bias in mail surveys. Journal of Marketing Research, 1977, 14, 396–402.
6.
BlumenfeldW. S.Effect of appearance of correspondence on response rate to a mail questionnaire survey. Psychological Reports, 1973, 32, 178.
7.
ButlerR. P.Effects of signed and unsigned questionnaires for both sensitive and nonsensitive items. Journal of Applied Psychology, 1973, 57, 348–349.
8.
ByrkitD. R.Elements of statistics: An introduction to probability and statistical inference. New York: Van Nostrand Reinhold, 1972.
9.
CarpenterE. H.Personalizing mail surveys, a replication and reassessment. Public Opinion Quarterly, 1974–75, 38, 614–620.
10.
ClausenJ. A.FordR. N.Controlling bias in mail questionnaires. Journal of the American Statistical Association, 1947, 42, 497–511.
11.
CoxE. P.AndersonW. T.FulcherD. G.Reappraising mail survey response rates. Journal of Marketing Research, 1974, 11, 413–417.
12.
DillmanD. A.FreyJ. H.Contribution of personalization to mail questionnaire response as an element of a previously tested method. Journal of Applied Psychology, 1974, 59, 297–301.
13.
ErdosP. L.MorganA. J.Professional mail surveys. New York: McGraw-Hill, 1970.
14.
FilionF. L.Estimating bias due to nonresponse in mail surveys. Public Opinion Quarterly, 1975–76, 39, 482–492.
15.
FrazierG.BirdK.Increasing the response of a mail questionnaire. Journal of Marketing, 1958, 23, 186–187.
16.
FutrellC. M.LambC. W.Jr.Effect on mail survey return rates of including questionnaires with follow-up letters. Perceptual and Motor Skills, 1981, 52, 11–15.
17.
HarrisJ. R.GuffeyH. J.Jr.Questionnaire returns: Stamps versus business reply envelopes revisited. Journal of Marketing Research, 1978, 15, 290–293.
18.
HopkinsK. D.PodolakJ.Class-of-mail and the effects of monetary gratuity on the response rates of mailed questionnaires. Journal of Experimental Education, 1983, 51, 169–170.
19.
HorowitzJ. L.SedlacekW. E.Initial returns on mail questionnaires: A literature review and research note. Research in Higher Education, 1974, 2, 361–367.
20.
HoustonM. J.JeffersonR. W.The negative effects of personalization on response patterns in mail surveys. Journal of Marketing Research, 1975, 12, 114–117.
21.
IsaacS.MichaelW. B.Handbook in research and evaluation. (2nd ed.) San Diego: EDITS, 1981.
22.
KawashM. B.AleamoniL. M.Effect of personal signature on the initial rate of return of a mailed questionnaire. Journal of Applied Psychology, 1971, 55, 589–592.
23.
KimballA. E.Increasing the rate of return in mail surveys. Journal of Marketing, 1961, 25, 63–64.
24.
LabrecqueD. P.A response rate experiment using mail questionnaires. Journal of Marketing, 1978, 42, 82–83.
25.
LinskyA. S.A factorial experiment in inducing responses to a mail questionnaire. Sociology and Social Research, 1965, 49, 183–189.
26.
LongworthD. S.Use of a mail questionnaire. American Sociological Review, 1953, 18, 310–313.
27.
MartinJ. D.McConnellJ. P.Mail questionnaire response induction: The effect of four variables on the response of a random sample to a difficult questionnaire. Social Science Quarterly, 1973, 51, 409–414.
28.
MattesonM. T.Type of transmittal letter and questionnaire color as two variables influencing response rates in a mail survey. Journal of Applied Psychology, 1974, 59, 535–536.
29.
McCrohanK. F.LoweL. S.A cost/benefit approach to postage used on mail questionnaires. Journal of Marketing, 1981, 45, 130–133.
30.
McDanielS. W.RaoC. P.An investigation of respondent anonymity's effect on mailed questionnaire response rate and quality. Journal of the Market Research Society, 1981, 23, 150–160.
31.
MooreC. C.Increasing the returns from questionnaires. Journal of Educational Research, 1941, 35, 138–141.
32.
ParsonsR. J.MedfordT. S.The effect of advance notice in mail surveys of homogeneous groups. Public Opinion Quarterly, 1972, 36, 258–259.
33.
RoeherG. A.Effective techniques in increasing response to mailed questionnaires. Public Opinion Quarterly, 1963, 27, 299–302.
34.
SiegelS.Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill, 1956.
35.
SimonR.Responses to personal and form letters in mail surveys. Journal of Advertising Research, 1967, 7, 28–30.
36.
TriceA. D.LaymanW. H.Hotel ratings: III. Method of return and return rate. Psychological Reports, 1984, 54, 372.
WalkerB. J.BurdickR. K.Advance correspondence and error in mail surveys. Journal of Marketing Research, 1977, 14, 379–382.
39.
WatsonJ. J.Improving the response rate in mail research. Journal of Advertising Research, 1965, 5, 48–50.
40.
WeilbacherW. M.WalshH. R.Mail questionnaires and the personalized letter of transmittal. Journal of Marketing, 1952, 16, 331–336.
41.
WiersmaW.Research methods in education: An introduction. (3rd ed.) Itasca, IL: F. E. Peacock, 1980.
42.
WorthenB. R.BrzezinskiE. J.An experimental study of techniques for increasing return rates in mail surveys. (Research Paper No. 64) University of Colorado, Boulder, Laboratory of Educational Research, 1973.
