Abstract
Most important large-scale surveys carried out by national statistical institutes are the repeated survey type, typically intended to produce estimates for several parameters of the whole population, as well as parameters related to some subpopulations. Small area estimation techniques are becoming more and more important for the production of official statistics where direct estimators are not able to produce reliable estimates. In order to exploit data from different survey cycles, unit-level linear mixed models with area and time random effects can be considered. However, the large amount of data to be processed may cause computational problems. To overcome the computational issues, a reformulation of predictors and the correspondent mean cross product estimator is given. The R code based on the new formulation enables the elaboration of about 7.2 millions of data records in a matter of minutes.
References
1.
Battese, G.E., R.M. Harter, and W.A. Fuller. 1988. “An Error Components Model for Prediction of County Crop Areas Using Survey and Satellite Data.” Journal of American Statistical Association 83: 28-36. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1080/01621459.1988.10478561.
2.
Boonstra, H., B. Buelens, and M. Smeets. 2007. “Estimation of Municipal Unemployment Fractions - A Simulation Study Comparing Different Small Area Estimators.” Internal report, BPA-no. DMK-DMH-2007-04-20-HBTA, Herleen: Statistics Netherlands.
3.
Cressie, N. 1992. “REML Estimation in Empirical Bayes Smoothing of Census Undercount.” Survey Methodology 18: 75-94.
4.
Cressie, N. 1993. Statistics for Spatial Data. New York: Wiley.
5.
D’Aló, M., L. Di Consiglio, S. Falorsi, M.G. Ranalli, and F. Solari. 2012. “Use of Spatial Information in Small Area Models for Unemployment Rate Estimation at Sub- Provincial Areas in Italy.” Journal of the Indian Society of Agricultural Statistics 66: 43-54.
6.
Datta, G.S. P. Lahiri, and T. Maiti. 2002. “Empirical Bayes Estimation of Median Income of Four-Person Families by State Using Time Series and Cross-sectional Data.” Journal of Statistical Planning and Inference 102: 83-97. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1016/S0378-3758(01)00173-2.
7.
Duncan, G.J. and G. Kalton. 1987. “Issues of Design and Analysis of Surveys across Time.” International Statistical Review 55: 97-117. Doi: https://dx-doi-org.web.bisu.edu.cn/10.2307/1403273.
8.
Fay, R. and R. Herriot. 1979. “Estimates of Income for Small Places: an Application of James-Stein Procedures to Census Data.” Journal of the American Statistical Association 74: 269-277. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1080/01621459.1979.10482505.
9.
Gershunskaya, J. 2015. “Combining Time Series and Cross-Sectional Data for the Current Employment Statistics Estimates.” In Proceedings of the Section on Statistical Computing: American Statistical Association, August 9, 2015. 1085-1096. Alexandria, VAL: American Statistical Association. Available at: http://www.amstat.org/sections/srms/proceedings/y2015/files/233962.pdf (January 16, 2017).
10.
Harville, D.A. 1977. “Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems.” Journal of the American Statistical Association 72: 320-338. Doi: https://dx-doi-org.web.bisu.edu.cn/10.2307/2286797.
11.
Hidiroglou, M.A. and Y. You. 2016. “Comparison of Unit Level and Area Level Small Area Estimators.” Survey Methodology 42: 41-61. Available at: http://www.statcan.gc.ca/pub/12-001-x/2016001/article/14540-eng.pdf (January 16, 2017).
12.
Kish, L. 1987. Statistical Designs for Research. New York: Wiley.
13.
Petrucci, A. and N. Salvati. 2004. “Small Area Estimation Considering Spatially Correlated Errors: the Unit Level Rrandom Effects Model.” Working Paper 2004/10, Department of Statistics, Florence University.
14.
Pfeffermann, D. 2002. “Small Area Estimation: New Developments and Directions.” International Statistical Review 70: 125-143. Doi: https://dx-doi-org.web.bisu.edu.cn/10.2307/1403729.
15.
Pfeffermann, D. 2013. “New Important Developments in Small Area Estimation.” Statistical Science 28: 40-68. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1214/12-sts395.
16.
Pfeffermann, D. and L. Burck. 1990. “Robust Small Area Estimation Combining Time Series and Cross-Sectional Data.” Survey Methodology 16: 217-237.
17.
Rao, J.N.K. 2003. Small Area Estimation. New York: Wiley.
18.
Rao, J.N.K. and M. Yu. 1994. “Small Area Estimation by Combining Time Series and Cross-Sectional Data.” Canadian Journal of Statistics 22: 511-528. Doi: https://dx-doi-org.web.bisu.edu.cn/10.2307/3315407.
19.
Royall, R.M. 1976. “The Linear Least-Squares Prediction Approach to Two-Stage Sampling.” Journal of the American Statistical Association 71: 657-664. Doi: https://dx-doi-org.web.bisu.edu.cn/10.1080/01621459.1976.10481542.
20.
Saei, A. and R. Chambers. 2003. “Small Area Estimation under Linear and Generalized Linear Mixed Models with Time and Area Effects”. Methodology Working Paper M03/15.University of Southampton: Southampton Statistical Sciences Research Institute. Available at: http://eprints.soton.ac.uk/8165/1/8165-01.pdf (January 16, 2017).
21.
Searle, S.R., G. Casella, and C.E. McCulloch. 1992. Variance Components. New York: Wiley.
22.
You, Y. 1999. “Hierarchical Bayes and Related Methods for Model Based Small Area Estimation.” Ph.D. Thesis, School of Mathematics and Statistics, Carleton University.