Formulated problem verification as an explicit requirement of model credibility

Abstract

This paper deals with the formulation and formulation verifica tion of a class of problems to which "modeling solutions" are applied. Two main objectives are to develop a procedure for problem formulation and to propose indicators for the for mulated problem verification. The class of problems considered is analyzed in two categories as requiring prescriptive or descrip tive solutions. A detailed study of each category results in a pro cedure to guide the analyst during the problem formulation. This procedure is illustrated by a traffic intersection problem. The for mulated problem is measured by using indicators to accomplish an evalution for the formulated problem verification. Indicators are developed to measure (1) the probability of failing to solve the actual problem, (2) the acceptability of an alternative set of possible outcomes, and (3) how well the formulated problem is structured. An evaluation questionnaire, included in the Ap pendix, is employed in applying the proposed indicators.

Keywords

formulated problem verification measurement model credibility modeling problem formulation

Get full access to this article

View all access options for this article.

References

Ackoff, R.L. Scientific Method. Optimizing Applied Research Decisions. Wiley, N.Y. (1962).

Ackoff, R.L. and Sasieni, M.W. Fundamentals of Operations Research. Wiley, N.Y. (1968).

Bailey, J.E. and Pearson, S.W. "Development of a Tool for Measuring and Analyzing Computer User Satisfaction." Management Science 29:5 ( 1983), 530-545.

Balci, O. "Guidelines for Successful Simulation Studies." Technical report TR-85-2 , Department of Computer Science, Virginia Tech, Blacksburg, Va. (1985).

Balci, O. and Sargent, R.G. 'A Methodology for Cost-Risk Analysis in the Statistical Validation of Simulation Models." Communications of the ACM 24:4 (1981), 190-197.

Balci, O. and Sargent, R.G. 'A Bibliography on the Credibility Assessment and Validation of Simulation and Mathematical Models." Simuletter 15:3 (1984), 15-27.

Emshoff, J.R. and Sisson, R.L. Design and Use of Computer Simulation Models . MacMillan, N.Y. ( 1970).

Ives, B. ; Olson, M.H. ; and Baroudi, J.J. "The Measurement of User Information Satisfaction." Communications of the ACM 26:10 (1983), 785-793.

Nance, R.E. "Model Representation in Discrete Event Simulation: The Conical Methodology." Technical report TR-81-3, Department of Computer Science, Virginia Tech, Blacksburg, Va. ( 1981).

10.

Nance, R.E. and Balci, O. "The Objectives and Requirements of Model Management." In: M. Singh (editor-in-chief), Encyclopedia of Systems and Control. Pergamon Press, Oxford (to be published in 1986).

11.

Nunally, J.C. Psychometnc Theory. McGraw-Hill , N.Y. (1978).

12.

Ören, T.I. "Concepts and Criteria to Assess Acceptability of Simulation Studies: A Frame of Reference." Communications of the ACM 24:4 (1981), 180-189.

13.

Pidd, M. and Woolley, R.N. 'A Pilot Study of Problem Structuring." J. Operational Research Society 31:12 (1980), 1063-1068.

14.

Pidd, M. and Woolley, R.N. "Four Views on Problem Structuring." Interfaces 10:1 (1980), 51-54.

15.

Schlesinger, S. et al. "Terminology for Model Credibility ." Simulation 32:3 (1979), 103-104.

16.

Shannon, R.E. Systems Simulation The Art and Science. Prentice-Hall , N.J. (1975).

17.

U.S. General Accounting Office "Report to the Congress: Ways to Improve Management of Federally Funded Computerized Models." LCD-75-111, U.S. General Accounting Office, Washington, D.C. (1976).

18.

Watson, C.E. "The Problems of Problem Solving." Business Horizons 19:4 ( 1976), 88-94.

19.

Woolley, R.N. and Pidd, M. "Problem Structuring - A Literature Review ."). Operational Research Society 32:3 (1981), 197-206.