The calibration and validation of traffic simulation models are critical procedures in ensuring that developed models accurately represent real-world conditions. When planned future systems are simulated, validation is not possible because field data cannot be collected for a system that has not yet been built. Instead, modelers have no choice but to follow standard calibration procedures and, in the absence of validating data, accept a model that appears to function correctly. Ex post evaluation of traffic simulation models is a neglected, yet valuable, area of research because it offers modelers a chance to validate their future system simulations with field data. The calibration assumptions used by modelers of future systems are investigated by checking whether improvised calibrations hold up to ex post evaluation. A case study directed at measuring the changes to user behavior in an existing and a reconstructed traffic system is presented. In addition, the benefits of ex post evaluation and methods to improve the calibration and validation of future models are discussed.
Get full access to this article
View all access options for this article.
References
1.
NaylorT. H., and FingerJ. M.Verification of Computer Simulation Models. Management Science, Vol. 14, No. 92, 1967, pp. B92-B106.
2.
MihramG. A.Some Practical Aspects of the Verification and Validation of Simulation Models. Operational Research Quarterly, Vol. 23, No. 1, 1972, pp. 17–29.
3.
OwenL. E., BrockG., MastbrookS., PavlikR., RaoL., StallardC., SunkariS., and ZhangY.A Compendium of Traffic Model Validation Documentation and Recommendations.FHWA, U.S. Department of Transportation, 1996.
4.
HellingaB. R.Requirements for the Calibration of Traffic Simulation Models.Canadian Society of Civil Engineering, University of Waterloo, Ontario, Canada, 1998.
5.
DowlingR., SkabardonisA., and AlexiadisV.Traffic Analysis Toolbox. Volume III: Guidelines for Applying Traffic Microsimulation Modeling Software. Publication FHWA-HRT-04-040. FHWA, U.S. Department of Transportation, 2004.
6.
HendersonS. G.Input Model Uncertainty: Why Do We Care and What Should We Do About It? In Proc., 35th Conference on Winter Simulation: Driving Innovation (ChickS., SánchezP. J., FerrinD., and MorriceD. J., eds.), IEEE Computer Society, Washington, D.C., 2003, pp. 90–100.
7.
BartonR. R., and SchrubenL. W.Resampling Methods for Input Modeling. In Proc., 33rd Conference on Winter Simulation (PetersB. A., SmithJ. S., MedeirosD. J., and RohrerM. W., eds.), IEEE Computer Society, Washington, D.C., 2001, pp. 372–378.
8.
BillerB., and NelsonB. L.Answers to the Top Ten Input Modeling Questions. In Proc., 34th Conference on Winter Simulation: Exploring New Frontiers (YücesanE., ChenC.-H., SnowdonJ. L., and CharnesJ. M., eds.), IEEE Computer Society, Washington, D.C., 2002, pp. 35–40.
9.
LuttrellT., SampsonW., IsmartD., and MatherlyD.Traffic Analysis Toolbox. Volume VII: Predicting Performance with Traffic Analysis Tools. Publication FHWA-HOP-08-055. FHWA, U.S. Department of Transportation, 2008.
10.
SacksJ., RouphailN. M., ParkB., and ThakuriahP.Statistically-Based Validation of Computer Simulation Models in Traffic Operations and Management. Journal of Transportation and Statistics, Vol. 5, No. 1, 2002, pp. 1–15.
11.
BartinB. O., OzbayK., Yanmaz-TuzelO., and ListG. F.Modeling and Simulation of Unconventional Traffic Circles. In Transportation Research Record: Journal of the Transportation Research Board, No. 1965, Transportation Research Board of the National Academies, Washington, D.C., 2006, pp. 201–209.
12.
DaganzoC.Estimation of Gap Acceptance Parameters Within and Across the Population from Direct Roadside Observation. Transportation Research B, Vol. 15, 1981, pp. 1–15.
13.
MahmassaniH., and SheffiY.Using Gap Acceptance Sequences to Estimate Gap Acceptance Functions. Transportation Research B, Vol. 15, No. 3, 1981, pp. 143–148.
14.
TroutbeckR.Estimating the Critical Acceptance Gap from Traffic Movements. Research Report 92-5. Queensland University of Technology, Brisbane, Australia, 1992.
15.
KyteM., TianZ., MirZ., HameedmansoorZ., KittelsonW., VandeheyM., RobinsonB., BrilonW., BondzioL., WuN., and TroutbeckR.Critical Gap and Follow-up Time. In NCHRP Web Document 5: Capacity and Level of Service at Unsignalized Intersections. Volume 1: Two-Way Stop-Controlled Intersections.Transportation Research Board of the National Academies, Washington, D.C., 1996, pp. 55–62.
16.
BrilonW., KoenigR., and TroutbeckR.Useful Estimation Procedures for Critical Gaps. Transportation Research A, Vol. 33, Nos. 3-4, 1999, pp. 161–186.
17.
GattisJ. L., and LowS.Gap Acceptance at Atypical Stop-Controlled Intersections. Journal of Transportation Engineering, Vol. 25, No. 3, 1999, pp. 201–207.
18.
OzbayK., BartinB., and RathiN.Operational Improvements at Traffic Circles. Report FHWA-NJ-2008-012. FHWA, U.S. Department of Transportation, 2008.
19.
LeeJ.-B., and OzbayK.New Calibration Methodology for Microscopic Traffic Simulation Using Enhanced Simultaneous Perturbation Stochastic Approximation Approach. In Transportation Research Record: Journal of the Transportation Research Board, No. 2124, Transportation Research Board of the National Academies, Washington, D.C., 2009, pp. 233–240.
20.
DingL.Evaluation of ITS Technologies in South Jersey Priority Corridor Project. Master's thesis. Rutgers, The State University of New Jersey, New Brunswick, 2003.
21.
MaJ., DongH., and ZhangH. M.Calibration of Microsimulation with Heuristic Optimization Methods. In Transportation Research Record: Journal of the Transportation Research Board, No. 1999, Transportation Research Board of the National Academies, Washington, D.C., 2007, pp. 208–217.
