Four standards are proposed to assess instruments designed to evaluate group decision process effectiveness. These standards were applied to a multicriteria evaluative instrument based on the Competing Values Approach to decision process effectiveness. In a study using nine groups and three types of raters (facilitators, participants, and observers) in a field setting, the instrument was found to be appropriately insensitive to role differences between raters within groups and appropriately sensitive to differences across groups. Ratings of facilitators and participants within groups were the most consistent, although their ratings diverged on four of the effectiveness scales.
Get full access to this article
View all access options for this article.
References
1.
Bales, R.F., & Cohen, S.P. (1979). SYMLOG: A system for the observation of groupsNew York: Free Press.
2.
Churchman, C.W. (1971). The design of inquiring systemsNew York: Basic Books.
3.
Dalkey, N.C. (1968). Experiments in group predictionSanta Monica, CA: RAND Corporation.
4.
Dalkey, N.C. (1969). The delphi method: An experimental study of group opinionSanta Monica, CA: RAND Corporation.
5.
Delbecq, A.L., Van de Ven, A.H., & Gustafson, D.H. (1975). Group techniques for program planningGlencoe, IL: Scott, Foresman, and Co.
6.
DeSanctis, G., & Gallupe, R.B. (1987). A foundation for the study of group decision support systemsManagement Science, 33, 589-609.
7.
Harmon, J., & Rohrbaugh, J. (in press). Social judgment analysis and small group decision making: Cognitive feedback effects on individual and collective performanceOrganizational Behavior and Human Decision Processes .
8.
Huber, G.P. (1984). The nature and design of post-industrial organizationsManagement Science, 30, 928-951.
Lawrence, P.R., & Lorsch, J.W. (1967). Organization and environmentHomewood, IL: Richard D. Irwin, Inc.
11.
Lewin, A.Y., & Minton, J.W. (1986). Determining organizational effectiveness: Another look and an agenda for researchManagement Science , 32, 514-538.
12.
Linstone, H.A., & Turoff, M., (1975). The delphi method: Techniques and applicationsReading, MA: Addison-Wesley.
13.
McCartt, A.T. (1988). The effects of decision conferences on the processes and outcomes of group dectsion making Unpublished doctoral dissertation, State University of New York at Albany.
14.
McCartt, A.T., & Rohrbaugh, J. (1989). Evaluating group decision support system effectiveness: A performance study of decision conferencingJournal of Decision Support Systems, 5 , 243-253.
15.
McGrath, J.E. (1984). Groups: Interaction and performanceEnglewood Cliffs, NJ: Prentice-Hall.
16.
Milter, R.G. (1986). An exploration of criteria for effective decision making in organizations and an evaluation of a decision support system: A case study approach Unpublished doctoral dissertation, State University of New York at Albany.
17.
Mitroff, I.I., & Mason, R.O. (1982). Business policy and metaphysics: Some philosophical considerationsAcademy of Management Review , 7, 361-371.
18.
Nunnally, J.C. (1978). Pyschometric TheoryNew York : McGraw-Hill.
19.
Parsons, T. (1959). General theory in sociology In R. Merton, L. Browns, & L. S. Cottrell, Jr. (Eds.), Sociology today: Problems and perspectives.New York: Basic Books.
Quinn, R.E., & Rohrbaugh, J. (1981). A competing values approach to organizational analysisPublic Productivity Review, 5, 141-159.
22.
Quinn, R.E., & Rohrbaugh, J. (1983). A spatial model of effectiveness criteria: Towards a competing values approach to organizational effectivenessManagement Science, 29, 363-377.
23.
Quinn, R., Rohrbaugh, J., & McGrath, M.R. (1985). Automated decision conferencing: How it worksPersonnel, 62, 49-55.
24.
Rohrbaugh, J. (1987). Assessing the effectiveness of expert teams In J. L. Mumpower, L. D. Phillips, O. Renn, & V.R.R. Uppuluri (Eds.), Expert judgment and expert systems.Berlin : Springer-Verlag.
25.
Sillars, A., Coletti, S.F., & Rogers, M.A. (1982). Coding verbal conflict tacticsHuman Communications Research, 9, 73-95.
Steiner, I.D. (1972). Group process and productivityNew York: Academic Press.
28.
Taggert, W., & Robey, D. (1981). Minds and managers: On the dual nature of human information processing and managementAcademy of Management Review, 6, 197-195.
29.
Zakay, D. (1984). The evaluation of managerial decision's quality by managersActa Psychologica, 56, 49-57.
30.
Zander, A. (1979). The study of group behavior during four decadesJournal of Applied Behavioral Science , 15, 272-282.
