Listwise deletion of cases with missing data prior to statistical analysis, the approach overwhelmingly used by cross-cultural survey researchers, requires the assumption that the missing data are missing completely at random. This assumption is not often likely to hold for cross-cultural sample data, and when it fails statistical analysis based only on complete-case subsamples introduces the possibility of biased estimates and standard errors. Over the past 20 or so years statisticians have made major advances in specifying the conditions under which missing data can be ignored when making inferences based on incomplete data. We review these conditions since they have a direct bearing on when the usual approaches to dealing with missing cross-cultural survey data are invalid.
Allison, P. (2002). Missing data. Thousand Oaks, CA: Sage.
2.
Burton, M.L. (1996). Constructing a scale of female contributions to agriculture: methods for imputing data. Cross-Cultural Research , 30, 3-23.
3.
Divale, W. (2004). Codebook of variables for the standard cross-cultural sample. World Cultures: Vol. 14 [CD data disk].
4.
Collins, L.M., Schaeffer, J.L., & Kam, C. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330-351.
5.
Dow, M.M., & Eff, E.A. (2008). Global, regional, and local network autocorrelation in the Standard Cross-Cultural Sample. Cross-Cultural Research , 42, 148-171.
6.
Dow, M.M., & Eff, E.A. (2009). Cultural trait transmission and missing data as sources of bias in comparative survey research. Cross-Cultural Research, 43,
7.
Eff, E.A., & Dow, M.M. (2009). Market integration and pro-social behavior. In Robert C. Marshall (Ed.), Cooperation in Economic and Social Life. Society for Economic Anthropology Monographs (Vol. 26). Walnut Creek, CA : AltaMira Press.
8.
Ember, C., & Ember, M. (2001). Cross-cultural research methods. Walnut Creek, CA: AltaMira Press.
9.
Ember, C., Ross. M., Burton, M., & Bradley, C. (1991). Problems of measurement in cross-cultural research using secondary data. Cross-Cultural Research, 25, 187-216.
10.
Graham, J.W., Olchowski, A.E., & Gilreath, T. (2007). How many imputations are really needed? Prevention Sciences, 8, 206-213.
11.
Heckman, J. (1976). The common structure of statistical models of truncation, sample selection, and limited dependent variables, and a simple estimator for such models. Annals of Economic and Social Measurement , 5, 475-492.
12.
Jorgensen, J. (1980). Western Indians. San Francisco : W. H. Freeman
13.
King, G., Honaker, J., Joseph, A., & Scheve, K. (2001). Analyzing incomplete political science data: an alternative algorithm for multiple imputation. American Political Science Review, 95, 49-69.
14.
Little, R., & Rubin, D.B. (2002). Statistical analysis with missing data (2nd ed.). New York: Wiley.
15.
McKnight, P.E., McKnight, K.M., Sidani, S., & Figueredo, A. (2007). Missing data: A gentle introduction. New York: Guilford Press.
16.
Meng, X.L. (1994). Multiple imputation inferences with uncongenial sources of input. Statistical Science, 10, 538-573.
17.
Murdock, G.P. (1967). Ethnographic atlas. Pittsburgh, PA: University of Pittsburgh Press.
Naroll, R. (1976). Worldwide theory testing. New Haven, CT: HRAF Press.
20.
Naroll, R., Michik, G., & Naroll, F. (1974). Hologeistic theory testing. In J. G. Jorgensen (Ed.), Comparative studies by Harold E. Driver and essays in his honor (pp. 121-148). New Haven, CT: HRAF Press.
21.
Otterbein, K. (1969). Basic steps in conducting a cross-cultural survey . Cross-Cultural Research, 4, 221-236.
22.
Raghunathan, T.E., Lepkowski, J.M., Van Hoewyk, J., & Solenberger, P. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models . Survey Methodology, 27, 85-95.
23.
Royston, P. (2004). Multiple imputation of missing values. Stata Journal, 4, 227-241.
24.
Royston, P. (2005). Multiple imputation of missing values: Update of ICE. Stata Journal, 5, 527-536.
25.
Rubin, D.B. (1976). Inference and missing data (with discussion). Biometrika, 63, 581-592.
26.
Rubin, D.B. (1977). Formalizing subjective notions about the effect of nonrespondents in sample surveys. Journal of the American Statistical Association, 72, 538-543.
27.
Rubin, D.B. (1987). Multiple imputation for nonresponse in surveys . New York: Wiley.
