Abstract
An extensive set of diagnostics for linear regression models has been developed to handle nonsurvey data. The models and the sampling plans used for finite populations often entail stratification, clustering, and survey weights, which renders many of the standard diagnostics inappropriate. In this article we adapt some influence diagnostics that have been formulated for ordinary or weighted least squares for use with stratified, clustered survey data. The statistics considered here include DFBETAS, DFFITS, and Cook's D. The differences in the performance of ordinary least squares and survey-weighted diagnostics are compared using complex survey data where the values of weights, response variables, and covariates vary substantially.
References
1.
Atkinson, A.C., and M. Riani. 2000. Robust Diagnostic Regression Analysis. New York: Springer-Verlag.
2.
Atkinson, A.C., and M. Riani. 2004. “The Forward Search and Data Visualization.” Computational Statistics 19: 29-54.
3.
Bates, D., M. Maechler, B. Bolker and S. Walker. 2014. “lme4: Linear Mixed-Effects Models Using Eiqen and S4. R package version 1.1-7.” Available at: http://CRAN.R-project.org/package= lme4 (accessed February 2, 2015).
4.
Belsley, D.A., R. E. Kuh, and R. Welsch. 1980. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. New York: John Wiley.
5.
Binder, D.A. 1983. “On the Variances of Asymptotically Normal Estimators from Complex Surveys.” International Statistical Review 51: 279-292. DOI: https://dx-doi-org.web.bisu.edu.cn/10.2307/1402588 Li and Valliant: Diagnostics in Cluster Samples 73
6.
Chambers, R.L., A.H. Dorfman, and T.E. Wehrly. 1993. “Bias Robust Estimation in Finite Populations Using Nonparametric Calibration.” Journal of the American Statistical Association 88: 268-277. DOI: https://dx-doi-org.web.bisu.edu.cn/10.1080/01621459.1993.10594319
7.
Chambers, R.L. 1996. “Robust Case-Weighting for Multipurpose Establishment Surveys.” Journal of Official Statistics 12: 3-32.
8.
Chambers, R.L., and C.J. Skinner. 2003. Analysis of Survey Data. New York: John Wiley.
9.
DuMouchel, W.H., and G.J. Duncan. 1983. “Using Sample Survey Weights in Multiple Regression Analysis of Stratified Samples.” Journal of the American Statistical Association 78: 535-543. DOI: https://dx-doi-org.web.bisu.edu.cn/10.1080/01621459.1983.10478006
10.
Elliott, M. 2007. “Bayesian Weight Trimming for Generalized Linear Regression Models.” Survey Methodology 33: 23-34.
11.
Fuller, W.A. 2002. “Regression Estimation for Survey Samples.” Survey Methodology 28: 5-23.
12.
Graubard, B.I., and E.L. Korn. 1996. “Modelling the Sampling Design in the Analysis of Health Surveys.” Statistical Methods in Medical Research 5: 263-281. DOI: https://dx-doi-org.web.bisu.edu.cn/10.1177/096228029600500304
13.
Henry, K.A., and R. Valliant. 2012. “Methods for Adjusting Survey Weights When Estimating a Total.” In Proceedings of the Federal Committee on Statistical Methodology, January 10-12. Washington, DC. Available at: http://fcsm.sites.usa.gov/files/2014/05/Henry_2012FCSM_V-A.pdf (accessed February 2, 2015)
14.
Korn, E.L., and B.I. Graubard. 1999. Analysis of Health Surveys. New York: Wiley.
15.
Korn, E.L., and B.I. Graubard. 2003. “Estimating Variance Components by Using Survey Data.” Journal of Royal Statistical Society B 65: 175-190. Part 1. DOI: https://dx-doi-org.web.bisu.edu.cn/10.1111/1467-9868.00379 Kott, P.S. 1991. “A Model-Based Look at Linear Regression with Survey Data.” American Statistician 45: 107-112. DOI: https://dx-doi-org.web.bisu.edu.cn/10.1080/00031305.1991.10475779.
16.
Li, J., and R. Valliant. 2009. “Survey Weighted Hat Matrix and Leverages.” Survey Methodology 35: 15-24.
17.
Li, J., and R. Valliant. 2011a. “Linear Regression Influence Diagnostics for Unclustered Survey Data.” Journal of Official Statistics 27: 99-119.
18.
Li, J., and R. Valliant. 2011b. “Detecting Groups of Influential Observations in Linear Regression using Survey Data––Adapting the Forward Search Method.” Pakistan Journal of Statistics 27: 507-528.
19.
Liao, D., and R. Valliant. 2012a. “Variance Inflation Factors in the Analysis of Complex Survey Data.” Survey Methodology 38: 53-62.
20.
Liao, D., and R. Valliant. 2012b. “Condition Indexes and Variance Decompositions for Diagnosing Collinearity in Linear Model Analysis of Survey Data.” Survey Methodology 38: 189-202.
21.
Longford, N.T. 1995. Models for Uncertainty in Educational Testing. New York: Springer-Verlag.
22.
Miller, R.G., Jr. 1974. “An Unbalanced Jackknife.” The Annals of Statistics 2: 880-891.
23.
Pfeffermann, D., and D.J. Holmes. 1985. “Robustness Considerations in the Choice of Method of Inference for the Regression Analysis of Survey Data.” Journal of the Royal Statistical Society A 148: 268-278. DOI: https://dx-doi-org.web.bisu.edu.cn/10.2307/2981971 74 Journal of Official Statistics
24.
Pfeffermann, D., C.J. Skinner, D.J. Holmes, H. Goldstein, and J. Rasbash. 1998. “Weighting for Unequal Selection Probabilities in Multilevel Models.” Journal of the Royal Statistical Society B 60: 23-40. DOI: http://onlinelibrary.wiley.com/ doi/10.1111/1467-9868.00106/abstract
25.
Potter, F.A. 1988. “Survey of Procedures to Control Extreme Sampling Weights.” In Proceedings of the Section on SurveyResearchMethods: American Statistical Association, 453-458. Available at: http://www.amstat.org/sections/SRMS/proceedings/.
26.
Potter, F.A. 1990. “Study of Procedures to Identify and Trim Extreme Sample Weights.” In Proceedings of the Survey Research Methods Section: American Statistical Association, 225-230. Available at: http://www/amstat.org/sections/SMRM/proceedings/.
27.
Pukelsheim, F. 1994. “The Three Sigma Rule.” The American Statistician 48: 88-91.
28.
Scott, A.J., and D. Holt. 1982. “The Effect of Two-Stage Sampling on Ordinary Least Squares Methods.” Journal of the American Statistical Association 77: 848-854.
29.
Skinner, C.J., D. Holt, and T.M.F. Smith (eds.). 1989. Analysis of Complex Surveys. New York: Wiley.
30.
Valliant, R., A.H. Dorfman, and R.M. Royall. 2000. Finite Population Sampling and Inference: A Prediction Approach. New York: Wiley.
31.
Wolter, K. 2007. Introduction to Variance Estimation. New York: Springer.
32.
Zaslavsky, A., N. Schenker, and T. Belin. 2001. “Downweighting Influential Clusters in Surveys: Application to the 1990 Post Enumeration Survey.” Journal of the American Statistical Association 96: 858-869.