Although landline telephone household surveys often draw inference about the general population, a proportion with only cell phones is excluded. In the United States, like in much of the world, this proportion is substantial and increasing, providing potential for coverage bias. Studies have looked at bias in means, but undercoverage can affect other essential statistics. The precision of point estimates can be biased, leading to erroneous conclusions. Research examining multivariate relationships will be further affected by bias in associations. A national landline telephone survey was conducted, followed by a survey of adults with only cell phones. In addition to estimates of means and proportions, differences were found for variances and associations. Bias in some point estimates was reduced through poststratification but became larger and in opposite direction for others. Different uses of survey data can be affected by omitting the cell-only population, and reliance on postsurvey adjustments can be misleading.
Aapor. (2006). Standard definitions: Final dispositions of case codes and outcome rates for surveys. Lenexa, KS: AAPOR.
2.
Blumberg, S.J., & Luke, J.V. ( 2007a). Coverage bias in traditional telephone surveys of low-income and young adults. Public Opinion Quarterly, 71, 734-749.
3.
Blumberg, S.J., & Luke, J.V. ( 2007b). Wireless substitution: Early release of estimates based on data from the National Health Interview Survey, January-June 2007. Retrieved on January 10, 2008, from http://www.cdc.gov/nchs/nhis.htm
4.
Blumberg, S.J., & Luke, J.V. ( 2007c). Wireless substitution: Early release of estimates based on data from the National Health Interview Survey, July-December 2006. Retrieved on December 10, 2007, from http://www.cdc.gov/nchs/nhis.htm
5.
Box, G.E.P. ( 1949). A general distribution theory for a class of likelihood criteria. Biometrika, 36, 317-346.
6.
Brick, J.M., Dipko, S., Presser, S., Tucker, C., & Yuan, Y. ( 2006). Nonresponse bias in a dual fame sample of cell and landline number. Public Opinion Quarterly, 70, 780-793.
7.
Carley-Baxter, L., Lynberg Black, M., & Twiddy, S. ( 2007). The impact of incentives on survey participation and reports of intimate partner and sexual violence. American Association for Public Opinion Research annual conference. Anaheim, CA: American Statistical Association.
8.
Curtin, R., Presser, S., & Singer, E. ( 2000). The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly, 64, 413-428.
9.
Deming, W.E., & Birge, R.T. ( 1934). On the statistical theory of errors. Review of Modern Physics, 6, 119-161.
10.
Folsom, R.E., & Singh, A.C. ( 2000). The generalized exponential model for sampling weight calibration for extreme values, nonresponse, and poststratification. Paper presented at the Joint Statistical Meetings of the American Statistical Association, Indianapolis, IN.
11.
Groves, R.M. ( 1989). Survey errors and survey costs. New York: Wiley.
12.
Groves, R.M. ( 2006). Nonresponse rates and nonresponse bias in household surveys . Public Opinion Quarterly, 70, 646-675.
13.
Groves, R.M., & Kahn, R.L. ( 1979). Surveys by telephone. New York: Academic Press.
14.
Hartley, H.O. ( 1962). Multiple frame surveys. Paper presented at theAmerican Statistical Association, Section on Social Statistics.
15.
Izrael, D., Hoaglin, D.C., & Battaglia, M.P. (2004). To rake or not to rake is not the question anymore with the enhanced raking macro. Paper presented at the Twenty-Ninth Annual SAS Users Group International Conference.
16.
Keeter, S., Kennedy, C., Clark, A., Tompson, T., & Mokrzycki, M. ( 2007). What’s missing from national landline RDD surveys? The impact of the growing cell-only population. Public Opinion Quarterly, 71, 772-792.
17.
Keeter, S., Miller, C., Kohut, A., Groves, R.M., & Presser, S. ( 2000). Consequences of reducing nonresponse in a national telephone survey. Public Opinion Quarterly, 64, 125-148.
18.
Kennedy, C. ( 2007). Evaluating the effects of screening for telephone service in dual frame RDD surveys. Public Opinion Quarterly, 71, 750-771.
19.
Kuusela, V., Vehovar, V., & Callegaro, M. ( 2007). Mobile phones’ influence on telephone surveys. In J. M. Lepkowski, C. Tucker, J. M. Brick, E. D. D. Leeuw, L. Japec, P. J. Lavrakas, et al. (Eds.), Advances in telephone survey methodology. New York: Wiley.
20.
Lepkowski, J.M., & Couper, M.P. ( 2002). Nonresponse in the second wave of longitudinal household surveys. In R. Groves, D. Dillman, J. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 259-272). New York: Wiley.
21.
Lin, I.-F., & Schaeffer, N.C. (1995). Using survey participants to estimate the impact of nonparticipation. Public Opinion Quarterly, 59, 236-258.
22.
Link, M.W., Battaglia, M.P., Frankel, M.R., Osborn, L., & Mokdad, A.H. ( 2007). Reaching the U.S. cell phone generation: Comparison of cell phone survey results with an ongoing landline telephone survey. Public Opinion Quarterly, 71, 814-839.
23.
Lynberg Black, M., Carley-Baxter, L., & Twiddy, S. ( 2007). Does the introductory context affect reporting of victimization and perpetration in a national survey of intimate partner violence or sexual violence?American Association for Public Opinion Research Conference. Anaheim, CA.
24.
Politz, A., & Simmons, W. ( 1949). An attempt to get the ‘not at homes’ into the sample without callbacks. Journal of the American Statistical Association, 44, 9-16.
25.
Raghunathan, T.E., Lepkowski, J.M., Van Hoewyk, J., & Solenberger, P. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models . Survey Methodology, 27, 85-95.
26.
Research Triangle Institute (2007). SUDAAN (Release 9.0.3). Research Triangle Park, NC, Research Triangle Institute.
27.
Tjaden, P., & Thoennes, N. ( 2000). Extent, nature, and consequences of intimate partner violence: Findings from the national violence against women survey ( Research Report No. NCJ 181867). Rockville, MD: National Criminal Justice Reference Service.
28.
Tjaden, P., & Thoennes, N. ( 2006). Extent, nature, and consequences of rape victimization: Findings from the national violence against women survey ( Research Report No. NCJ 210346). Rockville, MD: National Criminal Justice Reference Service.
29.
Tucker, N.C., Brick, J.M., & Meekins, B. ( 2007). Household telephone service and usage patterns in the United States in 2004: Implications for telephone samples. Public Opinion Quarterly, 71, 3-22.
