Adjustment for Maximum Likelihood Estimate of Negative Binomial Dispersion Parameter

Abstract

The negative binomial (NB) (or Poisson–gamma) model has been used extensively by highway safety analysts because it can accommodate the overdispersion often exhibited in crash data. However, it has been reported in the literature that the maximum likelihood estimate of the dispersion parameter of NB models can be significantly affected when the data are characterized by small sample size and low sample mean. Given the important roles of the dispersion parameter in various types of highway safety analyses, there is a need to determine whether the bias could be potentially corrected or minimized. The objectives of this study are to explore whether a systematic relationship exists between the estimated and true dispersion parameters, determine the bias as a function of the sample size and sample mean, and develop a procedure for correcting the bias caused by these two conditions. For this purpose, simulated data were used to derive the relationship under the various combinations of sample mean, dispersion parameter, and sample size, which encompass all simulation conditions performed in previous research. The dispersion parameter was estimated by using the maximum likelihood method. The results confirmed previous studies and developed a reasonable relationship between the estimated and true dispersion parameters for reducing the bias. Details for the application of the correction procedure were also provided by using the crash data collected at 458 three-leg unsignalized intersections in California. Finally, the study provided several discussion points for further work.

Get full access to this article

View all access options for this article.

References

Lord

, Washington

S. P.

, and Ivan

J. N.

Poisson, Poisson-Gamma and Zero Inflated Regression Models of Motor Vehicle Crashes: Balancing Statistical Fit and Theory. Accident Analysis and Prevention, Vol. 37, No. 1, 2005, pp. 35–46.

Hauer

Overdispersion in Modeling Accidents on Road Sections and in Empirical Bayes Estimation. Accident Analysis and Prevention, Vol. 33, No. 6, 2001, pp. 799–808.

Miaou

S. P.

Measuring the Goodness-of-Fit of Accident Prediction Models. Publication FHWA-RD-96-040. FHWA, U.S. Department of Transportation, 1996.

Wood

G. R.

Confidence and Prediction Intervals for Generalized Linear Accident Models. Accident Analysis and Prevention, Vol. 37, No. 2, 2005, pp. 267–273.

Piegorsch

W. W.

Maximum Likelihood Estimation for the Negative Binomial Dispersion Parameter. Biometrics, Vol. 46, No. 3, 1990, pp. 863–867.

Dean

C. B.

Modified Pseudo-Likelihood Estimator of the Overdispersion Parameter in Poisson Mixture Models. Journal of Applied Statistics, Vol. 21, No. 6, 1994, pp. 523–532.

Lord

Modeling Motor Vehicle Crashes Using Poisson-Gamma Models: Examining the Effects of Low Sample Mean Values and Small Sample Size on the Estimation of the Fixed Dispersion Parameter. Accident Analysis and Prevention, Vol. 38, No. 4, 2006, pp. 751–766.

Lord

, and Bonneson

J. A.

Calibration of Predictive Models for Estimating Safety of Ramp Design Configurations. In Transportation Research Record: Journal of the Transportation Research Board, No. 1908, Transportation Research Board of the National Academies, Washington, D.C., 2005, pp. 88–95.

Saha

, and Paul

Bias-Corrected Maximum Likelihood Estimator of the Negative Binomial Dispersion Parameter. Biometrics, Vol. 61, No. 1, 2005, pp. 179–185.

10.

Ross

G. J. S.

, and Preece

D. A.

The Negative Binomial Distribution. The Statistician, Vol. 34, No. 3, 1985, pp. 323–326.

11.

Cameron

A. C.

, and Trivedi

P. K.

Regression Analysis of Count Data. Cambridge University Press, Cambridge, U.K., 1998.

12.

Myers

R. H.

, Montgomery

D. C.

, and Vining

G. G.

Generalized Linear Models: With Applications in Engineering and the Sciences. John Wiley & Sons, Inc., New York, 2002.

13.

Morris

C. N.

Fitting Hierarchical Models. Presented at Summer Program: Statistics and Epidemiology: Environment and Health, Institute for Mathematics and Its Application, University of Minnesota, Minn., 1997. http://www.ima.umn.edu/summerstat/week6.html#wk6tue. Accessed July 2007.

14.

Lawless

J. F.

Negative Binomial and Mixed Poisson Regression. Canadian Journal of Statistics, Vol. 15, No. 3, 1987, pp. 209–225.

15.

Lloyd-Smith

J. O.

Maximum Likelihood Estimation of the Negative Binomial Dispersion Parameter for Highly Overdispersed Data, with Applications to Infectious Diseases. PLoS ONE, Vol. 2, No. 2, 2007, p. e180. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1791715. Accessed July 2007.

16.

Clark

S. J.

, and Perry

J. N.

Estimation of the Negative Binomial Parameter κ by Maximum Quasi-Likelihood. Biometrics, Vol. 45, No. 1, 1989, pp. 309–316.

17.

Toft

, Innocent

G. T.

, Mellor

D. J.

, and Reid

S. W. J.

The Gamma-Poisson Model as a Statistical Method to Determine If Micro-Organisms Are Randomly Distributed in a Food Matrix. Food Microbiology, Vol. 23, No. 1, 2006, pp. 90–94.

18.

R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2006. ISBN 3-900051-07-0. http://www.R-project.org. Accessed July 2007.

19.

Bonneson

J. A.

, Lord

, Zimmerman

, Fitzpatrick

, and Pratt

Development of Tools for Evaluating the Safety Implications of Highway Design Decisions. Publication FHWA/TX-07/0-4703-4. Texas Transportation Institute, College Station, 2007. http://tcd.tamu.edu/Documents/0-4703-4.pdf. Accessed July 2007.

20.

Lord

, and Bonneson

J. A.

Development of Accident Modification Factors for Rural Frontage Road Segments in Texas. In Transportation Research Record: Journal of the Transportation Research Board, No. 2023, Transportation Research Board of the National Academies, Washington, D.C., 2007, pp. 20–27.