Nonrandomly Missing Data in Multiple Regression: An Empirical Comparison of Common Missing-Data Treatments

Abstract

This research is an investigation of the effects of nonrandomly missing data in two-predictor regression analyses and the differences in the effectiveness of five common treatments of missing data on estimates of R2 and of each of the two standardized regression weights. Bootstrap samples of 50, 100, and 200 were drawn from three sets of actual field data. Nonrandomly missing data were created within each sample, and the parameter estimates were compared with those obtained from the same samples with no missing data. The results indicated that three imputation procedures (mean substitution, simple and multiple regression imputation) produced biased estimates of R2 and both regression weights. Two deletion procedures (listwise and pairwise) provided accurate parameter estimates with up to 30% of the data missing.

Get full access to this article

View all access options for this article.

References

Basilevsky, A. , Sabourin, D. , Hum, D. , & Anderson, A. (1985). Missing data estimators in the general linear model: An evaluation of simulated data as an experimental design. Communications in Statistics, 14, 371-394.

Beale, E.M.L. , & Little, R.J.A. (1975). Missing values in multivariate analysis. Journal of the Royal Statistical Society, Series B, 37, 129-145.

Cohen, J. , & Cohen, P. (1975). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.

Donner, A. , & Rosner, B. (1982). Missing value problems in multiple linear regression with two independent variables. Communications in Statistics, 11, 127-140.

Efron, B. , & Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science, 1, 54-77.

Frane, J. W. (1976). Some simple procedures for handling missing data in multivariate analysis. Psychometrika, 41, 409-415.

Gleason, T. C. , & Staelin, R. (1975). A proposal for handling missing data. Psychometrika, 40, 229-252.

Guertin, W. H. (1968). Comparison of three methods of handling missing observations. Psychological Reports, 22, 896.

Kim, J. , & Curry, J. (1977). The treatment of missing data in multivariate analysis. Sociological Methods & Research, 6, 215-240.

10.

LePage, R. , & Billard, L. (1992). Exploring the limits of bootstrap. New York: Wiley.

11.

Light, R. J. , & Pillmer, D. B. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.

12.

Little, R. J. (1992). Regression with missing x's: A review. Journal of the American Statistical Association, 87, 1227-1237.

13.

Little, R. J. , & Rubin, D. B. (1987). Statistical analysis with missing data. New York: Wiley.

14.

Litde, R. J. , & Rubin, D. B. (1990). The analysis of social science data with missing values. Sociological Methods & Research, 18, 292-326.

15.

Raymond, M. R. (1987, April). An interactive approach to analyzing incomplete multivariate data. Paper presented at the meeting of the American Educational Research Association, Washington, DC. (ERIC Document Reproduction Service No. ED 281 854)

16.

Raymond, M. R. , & Roberts, D. M. (1987). A comparison of methods for treating incomplete data in selection research. Educational and Psychological Measurement, 47, 13-26.

17.

Stine, R. (1989). An introduction to bootstrap methods. Sociological Methods & Research, 18, 243-291.

18.

Timm, N. H. (1970). The estimation of variance-covariance and correlation matrices from incomplete data. Psychometrika, 35, 417-437.