Abstract
Classical Respondent-Driven Sampling (RDS) estimators are based on a Markov Process model in which sampling occurs with replacement. Given that respondents generally cannot be interviewed more than once, this assumption is counterfactual. We join recent work by Gile and Handcock in exploring the implications of the sampling-with-replacement assumption for bias of RDS estimators. We differ from previous studies in examining a wider range of sampling fractions and in using not only simulations but also formal proofs. One key finding is that RDS estimates are surprisingly stable even in the presence of substantial sampling fractions. Our analyses show that the sampling-with-replacement assumption is a minor contributor to bias for sampling fractions under 40%, and bias is negligible for the 20% or smaller sampling fractions typical of field applications of RDS.
References
1.
Barabási, A.L. and R. Albert. 1999. “Emergence of Scaling in Random Networks.” Science 286: 509-512. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1126/science.286.5439.509.
2.
Bernard, H.R., T. Hallett, A. Iovita, E.C. Johnsen, R. Lyerla, C. McCarty, M. Mahy, M.J. Salganik, T. Saliuk, O. Scutelniciuc, G.A. Shelley, P. Sirinirund, S. Weir, and D.F. Stroup. 2010. “Counting Hard-to-Count Populations: the Network Scale-Up Method for Public Health.” Sexually Transmitted Infections 86 (suppl. II): ii11-ii15. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1136/sti.2010.044446.
3.
Bernhardt, A., M.W. Spiller, and N. Theodore. 2012. “Employers Gone Rogue: Explaining Industry Variation in Violations of Workplace Laws.” Industrial and Labor Relations Review. Available at: http://papers.ssrn.com/sol3/papers.cfm?abstract_id¼2013376 (accessed January 2016).
4.
Curtis, R., K. Terry, M. Dank, K. Dombrowski, and B. Khan. 2008. The Commercial Sexual Exploitation of Children in New York City, Volume One: The CSEC Population in New York City: Size, Characteristics, and Needs, Final report submitted to the National Institute of Justice. New York: Center for Court Innovation and John Jay College of Criminal Justice. Available at: https://www.ncjrs.gov/pdffiles1/nij/grants/225083.pdf (accessed January 2016).
5.
Erdős, P. and A. Rényi. 1959. “On Random Graphs.” Publ. Math 6: 290-297.
6.
Gile, K.J. 2011. “Improved Inference for Respondent-Driven Sampling Data with Application to HIV Prevalence Estimation.” Journal of the American Statistical Association 106: 135-146. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1198/jasa.2011.ap09475.
7.
Gile, K.J. and M.S. Handcock. 2010. “Respondent-Driven Sampling: An Assessment of Current Methodology.” Sociological Methodology 40: 285-327. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1111/j.1467-9531.2010.01223.x.
8.
Goel, S. and M.J. Salganik. 2009. “Respondent-Driven Sampling as Markov Chain Monte Carlo.” Statistics in Medicine 28: 2202-2229. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1002/sim.3613.
9.
Hagberg, A.A., D.A. Schult, and P.J. Swart. 2008. “Exploring Network Structure, Dynamics, and Function Using NetworkX.” In Proceedings of the 7th Python in Science Conference (SciPy2008), Pasadena, CA, August 2008. Edited by G. Varoquaux, T. Vaught, and J. Millman. 11-15.
10.
Heckathorn, D. 1997. “Respondent-Driven Sampling: a New Approach to the Study of Hidden Populations.” Social Problems 44: 174-199. Doi: https://dx-doi-org.web.bisu.edu.cn/10.2307/3096941.
11.
Heckathorn, D.D. 2002. “Respondent-Driven Sampling II: Deriving Valid Population Estimates from Chain-Referral Samples of Hidden Populations.” Social Problems 49: 11-34. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1525/sp.2002.49.1.11.
12.
Heckathorn, D.D. 2007. “Extensions of Respondent-Driven Sampling: Analyzing Continuous Variables and Controlling for Differential Recruitment.” Sociological Methodology 37: 151-207. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1111/j.1467-9531.2007.00188.x.
13.
Heckathorn, D.D. 2010. “Sampling Elusive and Hard-to-Reach Populations: The Scope and Limits of Respondent-Driven Sampling.” Presented at the Duke Population Research Institute Workshop “Challenging Samples: Networks and Surveys in Demographic and Health Research” on May 7, 2010.
14.
Heckathorn, D.D. 2011. “Snow ball versus Respondent-driven Samping.” Sociological Methodology 41: 355-366. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1111/j.1467-9531.2011.01244.x.
15.
Heckathorn, D.D. and J. Jeffri. 2001. “Finding the Beat: Using Respondent-Driven Sampling to Study Jazz Musicians.” Poetics 28: 307-329. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1016/S0304-422X(01)80006-1.
16.
Heckathorn, D.D., R.S. Broadhead, and B. Sergeyev. 2001. “A Methodology for Reducing Respondent Duplication and Impersonation in Samples of Hidden Populations.” Journal of Drug Issues 31: 543-564.
17.
Heckathorn, D.D., S. Semaan, R.S. Broadhead, and J.J. Hughes. 2002. “Extensions of Respondent-Driven Sampling: A New Approach to the Study of Injection Drug Users Ages 18-25.” AIDS and Behavior 6: 55-67. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1023/A:1014528612685.
18.
Iguchi, M.Y., A.J. Ober, S.H. Berry, T. Fain, D.D. Heckathorn, P.M. Gorbach, R. Heimer, A. Kozlov, L.J. Ouellet, S. Shoptaw, and W.A. Zule. 2009. “Simultaneous Recruitment of Drug Users and Men Who Have Sex with Men in the United States and Russia Using Respondent-Driven Sampling: Sampling Methods and Implications.” Journal of Urban Health 86 (Suppl. 1): 5-31. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1007/s11524-009-9365-4.
19.
Jeffri, J., D.D. Heckathorn, and M.W. Spiller. 2011. “Painting Your Life: a Study of Aging Visual Artists in New York City.” Poetics 39: 19-43. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1016/j.poetic.2010.11.001.
20.
Lansky, A., A. Drake, and H.T. Pham. 2009. HIV-Associated Behaviors Among Injecting- Drug Users - 23 Cities, United States, May 2005-February 2006. Morbidity and Mortality Weekly Report April 10, 2009, 58: 329-332. Available at: www.cdc.gov/mmwr/pdf/wk/mm5813.pdf (accessed January 2016).
21.
Lee, C.-H., X. Xu, and D.Y. Eun. 2012. “Beyond Random Walk and Metropolis-Hastings Samplers.” In Proceedings of the 12th ACM SIGMETRICS/PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems - SIGMETRICS’12, 319. ACM Press. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1145/2254756.2254795.
22.
Lu, X., L. Bengtsson, T. Britton, M. Camitz, B.J. Kim, A. Thorson, and F. Liljeros. 2012. “The Sensitivity of Respondent-Driven Sampling.” Journal of the Royal Statistical Society. Series A: Statistics in Society 175: 191-216. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1111/j.1467-985X.2011.00711.x.
23.
Malekinejad, M., L.G. Johnston, C. Kendall, L.R.F.S. Kerr, M.R. Rifkin, and G.W. Rutherford. 2008. “Using Respondent-Driven Sampling Methodology for HIV Biological and Behavioral Surveillance in International Settings: A Systematic Review.” AIDS and Behavior 12(suppl. 4): 105-130. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1007/s10461-088-9421-1.
24.
Maslov, S. and K. Sneppen. 2002. “Specificity and Stability in Topology of Protein Networks.” Science 296: 910-913. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1126/science.1065103.
25.
Ramirez-Valles, J., D.D. Heckathorn, R. Vázquez, R.M. Diaz, and R.T. Campbell. 2005. “From networks to populations: the development and application of respondent-driven Sampling Among IDUs and Latino Gay Men.” AIDS and Behavior 9(4): 387-402. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1007/s10461-005-9012-3.
26.
Salganik, M.J. and D.D. Heckathorn. 2004. “Sampling and Estimation in Hidden Populations Using Respondent-Driven Sampling.” Sociological Methodology 34: 193-239. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1111/j.0081-1750.2004.00152.x.
27.
Smylie, J., M. Firestone, L. Cochran, C. Prince, S. Maracle, M. Morley, S. Mayo, M.W. Spiller, and B. McPherson. 2011. Our Health Counts Urban Aboriginal Health Database Research Project - Community Report First Nations Adults and Children, City of Hamilton. Hamilton: De Dwa Da Dehs Neys Aboriginal Health Centre. Available from: http://www.stmichaelshospital.com/crich/wp-content/uploads/ourhealth-counts-report.pdf (accessed January 2016).
28.
Tillé, Y. 2006. Sampling Algorithms. New York: Springer. Volz, E. and D.D. Heckathorn. 2008. “Probability Based Estimation Theory for Respondent Driven Sampling.” Journal of Official Statistics 24: 79-97.
29.
Wallace, R. 1991. “Social Disintegration and the Spread of AIDS: Thresholds for Propagation Along ‘Sociogeographic’ Networks.” Social Science & Medicine 33: 1155-1162. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1016/0277-9536(91)90231-Z.
30.
Wang, J., R.G. Carlson, R.S. Falck, H.A. Siegal, A. Rahman, and L. Li. 2005. “Respondent-Driven Sampling to Recruit MDMA Users: A Methodological Assessment.” Drug and Alcohol Dependence 78: 147-157. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1016/j.drugalcdep.2004.10.011.
31.
Watts, D.J. and S.H. Strogatz. 1998. “Collective Dynamics of ‘Small-World’ Networks.” Nature 393(6684): 440-442. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1038/30918.
32.
Wejnert, C., H. Pham, N. Krishna, B. Le, and E. DiNenno. 2012. “Estimating Design Effect and Calculating Sample Size for Respondent-Driven Sampling Studies of Injection Drug Users in the United States.” AIDS and Behavior 16(4): 797-806. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1007/s10461-012-0147-8.