Using meta-analytic procedures, this article quantitatively integrated the results of 31 experimental studies on the effects of Group Support System (GSS) use. A total of eight dependent variables representing performance, satisfaction, consensus, and equality of participation were investigated. The use of GSSs was found to have positive main effects on decision quality, number of alternatives generated, and equality of participation, but negative main effects in terms of time to reach decision, consensus, and satisfaction. Further analysis showed the effects to be moderated by task, group, context, and technology variables. For example, larger groups achieved betterperformance and greater satisfaction from the use of GSS than smaller groups. Groups with a formal hierarchy using GSS did worse in terms of both performance and satisfaction compared to groups without formal hierarchy. Also, the level of GSS support emerged as influential on almost all dependent variables. Findings are discussed in terms of their implications for organizational use of GSS, design issues of GSS, andfuture research directions.
Get full access to this article
View all access options for this article.
References
1.
Ackoff, R. L. (1981). Creating the corporate future. New York: Wiley.
2.
Anson, R. , Bostrom, R., & Wynne, B. E. (in press). An experiment assessing Group Support System and facilitator effects on meeting outcomes. Management Science.
3.
Bangert-Drowns, R. L. (1986). Review of developments in meta-analytic method. Psychological Bulletin, 99, 388-399.
4.
Benbasat, I. , DeSanctis, G., & Nault, B. R. (1993). Empirical research in managerial support systems: A review and assessment. In C. Holsapple & A. Whinston (Eds.), Recent developments in decision support systems (NATO ASI Series Vol. 101, pp. 383-437). Berlin: Springer-Verlag.
5.
Bostrom, R. P. , Anson, R., & Clawson, V. K. (1993). Group facilitation and Group Support Systems. In L. M. Jessup & J. S. Valacich (Eds.), Group Support Systems: New perspectives (pp. 146-168). New York: Macmillan.
6.
Bui, T. , & Sivasankaran, T. R. (1990). Relation between GDSS use and group task complexity. Proceedings of the Twenty-Third Hawaii International Conference on Systems Sciences, 3, 69-78.
7.
Cass, K. , Heintz, T. J., & Kaiser, K. M. (1991). Using a voice-synchronous GDSS in dispersed locations: A preliminary analysis of participant satisfaction. Proceedings of the 24th Annual Hawaii International Conference on System Sciences, 3, 554-563.
8.
Chidambarum, L. , & Bostrom, R. P. (1993). Evolution of group performance overtime: A repeated measures study of GDSS effects. Journal of Organizational Computing.
9.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
10.
Daft, R. L. , & Lengel, R. H. (1986). Organizational information requirements, media richness and structural design. Management Science, 32, 554-571.
11.
Dennis, A. R. , & Gallupe, R. B. (1993). A history of Group Support Systems empirical research: Lessons learned and future directions. In L. M. Jessup & J. S. Valacich (Eds.), Group Support Systems (pp. 59-77). New York: Macmillan.
12.
Dennis, A. R. , George, J. F., Jessup, L. M., Nunamaker, J. H., Jr., & Vogel, D. R. (1988). Information technology to support group work. MIS Quarterly, 12, 591-624.
13.
Dennis, A. R. , Nunamaker, J. F., Jr., & Vogel, D. R. (1991). A comparison of laboratory and field research in the study of electronic meeting systems. Journal of Management Information Systems, 7(3), 107-135.
14.
Dennis, A. R. , Valacich, J. S., & Nunamaker, J. H., Jr. (1990). An experimental investigation of the effects of group size in an electronic meeting environment. IEEE Transactions on Systems, Man, and Cybernetics, 25, 1049-1057.
15.
DeSanctis, G. , & Gallupe, R. B. (1987). A foundation forthe study of group decision support systems. Management Science, 33(5), 589-609.
16.
DeSanctis, G. , & Poole, M. S. (in press). Capturing the complexity in advanced technology use: Adaptive structurative theory. Organization Science.
17.
Dickson, G. W. , Lee, J. E., Robinson, L., & Heath, R. (1989). Observations on GDSS interaction: Chauffeured, facilitated, and user-driven systems. Proceedings of the Twenty-Second Hawaii International Conference on Systems Sciences, 3, 337-343.
18.
Dubrovsky, V. J. , Kiesler, S., & Sethna, B. N. (1991). The equalization phenomenon: Status effects in computer-mediated and face-to-face decision-making groups. Human-Computer Interaction, 6, 119-146.
19.
Easton, A. C. , Vogel, D. R., & Nunamaker, J. F., Jr. (1989). Stakeholder identification and assumption surfacing in small groups: An experimental study. Proceedings of the Twenty-Second Hawaii International Conference on System Sciences, 3, 344-352.
20.
Fellers, J. W. (1989). The effect of group size and computer support on group idea generation for creativity tasks: An experimental evaluation using a repeated measures design. Unpublished doctoral dissertation, Indiana University.
21.
Gallupe, R. B. (1990). Suppressing the contribution of the group's best member: Is GDSS use appropriate for all group tasks?Proceedings of the Twenty-Third Hawaii International Conference on Systems Sciences, 3, 13-22.
22.
Gallupe, R. B. , Bastianutti, L. M., & Cooper, W. H. (1991). Unblocking brainstorms. Journal of Applied Psychology, 76(1), 137-142.
23.
Gallupe, R. B. , Cooper, W. H., & Bastianutti, L. (1990). Why is electronic brainstorming more productive than traditional brainstorming? An experimental study. Proceedings of the Administrative Sciences Association of Canada Conference.
24.
Gallupe, R. B. , DeSanctis, G., & Dickson, G. W. (1988). Computer-based support for problem finding: An experimental investigation. MIS Quarterly, 12(2), 277-296.
25.
Gallupe, R. B. , & McKeen, J. D. (1990). Enhancing computer-mediated communication: An experimental investigation into the use of a group decision support system for face-to-face versus remote meetings. Information & Management, 18, 1-13.
26.
George, J. F. , Easton, G. K., Nunamaker, J. F., Jr., & Northcraft, G. B. (1990). A study of collaborative group work with and without computer-based support. Information Systems Research, 1(4), 394-415.
27.
Glass, G. V. , McGraw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
28.
Gray, P. , Vogel, D., & Beauclair, R. (1990). Assessing GDSS empirical research. European Journal of Operational Research, 46, 162-176.
29.
Greene, C. N. , & Schriesheim, C. (1977). Causal paths among dimensions of leadership, group drive, and cohesiveness: A longitudinal field investigation. Proceedings of the Academy of Management.
30.
Hall, J. , & Williams, M. S. (1966). A comparison of decision-making performance in established and ad hoc groups. Journal of Personality and Social Psychology, 3, 214-222.
31.
Hare, A. P. (1981). Group size. American Behavioral Scientist, 24, 695-708.
32.
Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128.
33.
Hedges, L. V. , & Becker, B. J. (1986). Statistical methods in the meta-analysis of research on gender differences. In J. S. Hyde & M. C. Linn (Eds.), The psychology of gender: Advances through meta-analysis (pp. 14-50). Baltimore, MD: Johns Hopkins University Press.
34.
Hedges, L. V. , & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
35.
Hiltz, S. R. , Johnson, K., & Turoff, M. (1986). Experiments in group decision making, 1: Communications process and outcome in face-to-face vs. computerized conferences. Human Communication Research, 13(2), 225-252.
36.
Ho, T. H. , & Raman, K. S. (1991). The effect of GDSS and elected leadership on small group meetings. Journal of Management Information Systems, 8(2), 109-133.
37.
Huber, G. (1984). Issues in the design of group decision support systems. MIS Quarterly, 8(3), 195-204.
38.
Huber, G. (1988). Effects of decision and communication support technologies on organizational decision processes and structures. In R. M. Lee, A. M. McCosh, & P. Migliarese (Eds.), Proceedings of IFIP WG 8.3 Working Conference on Organizational Decision Support Systems (pp. 317-333). Amsterdam: North-Holland.
39.
Hunter, J. E. , & Schmidt, F. L. (1990). Methods of meta-analysis. Newbury Park, CA: Sage.
40.
Jarvenpaa, S. L. , Rao, V. S., & Huber, G. P. (1988). Computer support for meetings of medium-sized groups working on unstructured problems: A field experiment. MIS Quarterly, 12(4), 645-666.
41.
Jessup, L. M. , Connolly, T., & Galegher, J. (1990, September). The effects of anonymity on group process in an idea-generating task. MIS Quarterly, pp. 313-321.
42.
Joyner, R. , & Tunstall, K. (1970). Computer-augmented organizational problem solving. Management Science, 17(4), B212-B225.
43.
Lewis, L. F. (1987). A decision support system for face-to-face groups. Journal of Information Science, 13, 211-219.
44.
Lim, L. H. , & Benbasat, I. (1993). A theoretical perspective of negotiation support systems. Journal of Management Information Systems, 9(3), 27-44.
45.
Lim, L. H. , Raman, K. S., & Wei, K. K. (1990). Does GDSS promote more democratic decision-making? The Singapore experiment. Proceedings of the TWenty-Third Hawaii International Conference on Systems Sciences, 3, 59-68.
46.
McGrath, J. E. (1984). Groups: Interaction and performance. Englewood Cliffs, NJ: Prentice Hall.
47.
McGrath, J. E. , & Hollingshead, A. B. (1993). Putting the "group" back in Group Support Systems: Some theoretical issues about dynamic processes in groups with technological enhancements. In L. M. Jessup & J. S. Valacich (Eds.), Group Support Systems: New perspectives (pp. 78-96). New York: Macmillan.
48.
McGuire, T. W. , Kiesler, S., & Siegel, J. (1987). Group and computer-mediated discussion effects in risk decision making. Journal of Personality and Social Psychology, 52(5), 917-930.
49.
McLeod, P. L. (1992). An assessment of the experimental literature on electronic support of group work: Results of a meta-analysis. Human-Computer Interaction, 7(3), 257-280.
50.
McLeod, P. L. , & Liker, J. K. (1992). Electronic meeting systems: Evidence from a low-structure environment. Information Systems Research, 3(3), 195-223.
51.
Mennecke, B. , Hoffer, J., & Wynne, B. (1992). Group development and history in GSS research: A new research perspective. Proceedings of the TWenty-Fifth Hawaii International Conference on Systems Sciences, 4, 113-124.
52.
Morris, C. G. (1966). Task effects on group interaction. Joumal of Personality and Social Psychology, 4(5), 545-554.
53.
Nunamaker, J. F., Jr. , Dennis, A. R., Valacich, J. S., & Vogel, D. R. (1991a). Information technology for negotiating groups: Generating options for mutual gain. Management Science, 37(10), 1325-1346.
54.
Nunamaker, J. F., Jr. , Dennis, A. R., Valacich, J. S., Vogel, D. R., & George, J. F. (199lb). Electronic meeting systems to support group work. Communications of the ACM, 34(7), 40-61.
55.
Nunamaker, J. F., Jr. , Vogel, D., Heminger, A., Martz, B., Grohowski, R., & McGoff, C. (1989). Experiences at IBM with Group Support Systems: A field study. Decision Support Systems, 5(2), 183-196.
56.
Olson, G. M. , & Atkdns, D. E. (1990). Supporting collaboration with advanced multimedia electronic mail: The NSF EXPRES project. In J. Galegher, R. E. Kraut, & C. Egido (Eds.), Intellectual teamwork: Social and technologicalfoundations of cooperative work (pp. 429-451). Hillsdale, NJ: Lawrence Erlbaum.
57.
O'Reilly, C. A., III , & Roberts, K. H. (1978). Supervisor influence and subordinate mobility aspirations as moderators of consideration ratings and structure. Journal of Applied Psychology, 63, 96-102.
58.
Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157-159.
59.
Payne, J. W. (1976). Task complexity and contingent processing in decision making: An information search and protocol analysis. Organizational Behavior and Human Performance, 16, 366-387.
60.
Pinsonneault, A. , & Kraemer, K. L. (1990). The effects of electronic meetings on group processes and outcomes: An assessment of the empirical research. European Joumal of Operational Research, 46, 143-161.
61.
Rao, S. V. , & Jarvenpaa, S. L. (1991). Computer support of groups: Theory-based models for GDSS research. Management Science, 37(10), 1347-1362.
62.
Sambamurthy, V. , & DeSanctis, G. (1990). An experimental evaluation of GDSS effects on group performance during stakeholder analysis. Proceedings of the Twenty-Third Hawaii International Conference on Systems Sciences, 3, 79-88.
63.
Schriesheim, C. A. , Mowday, R. T., & Stogdill, R. M. (1979). Crucial dimensions of leader-group dimensions. In J. G. Hunt & L. L. Larson (Eds.), Crosscurrents in leadership (pp. 106-125). Carbondale: Southern Illinois University Press.
64.
Sharda, R. , Barr, S. H., & McDonnell, J. C. (1988). Decision support system effectiveness: A review and an empirical test. Management Science, 34(2), 139-159.
65.
Siegel, J. , Dubrovsky, V., Kiesler, S., & McGuire, T. W. (1986). Group processes in computer-mediated communication. Organizational Behavior and Human Decision Processes, 37, 157-187.
66.
Smith, J. , & Vanecek, M. T. (1989). A nonsimultaneous computer conference as a component of group decision support systems. Proceedings of the Twenty-Second Hawaii International Conference on Systems Sciences, 3, 370-377.
67.
Steeb, R. , &Johnston, S. C. (1981). Acomputer-based interactive systemforgroup decision making. IEEE Transactions on Systems, Man, and Cybernetics, SMC-11, 544-552.
68.
Tan, B. , Wei, K. K., & Raman, K. S. (1991). Effects of support and task type on group decision outcome: A study using SAMM. Proceedings of the 7Wenty-Fourth Hawaii Intemational Conference on Systems Sciences, 3, 537-546.
69.
Tripathi, K. N. (1991). Effect of contingency and timing of reward on intrinsic motivation. Journal of General Psychology, 118, 97-105.
70.
Valacich, J. S., Paranka, D., George, J. F., & Nunamaker, J. F., Jr. (1992). Communication concurrency and the new media: A new dimension for media richness. Unpublished manuscript.
71.
Valacich, J. S., & Schwenk, C. (1992). Devil's advocacy and dialectical inquiry effects on group decision making using computer-mediated versus verbal communication. Unpublished manuscript, Indiana University.
72.
VanSchaik, F. D. , & Sol, H. G. (1990). Effectiveness of decision support systems. Proceedings of the Twenty-Third Hawaii International Conference on Systems Sciences, 3, 50-58.
73.
Wagner, J. A., III , & Gooding, R. Z. (1987). Shared influence and organizational behavior: A meta-analysis of situational variables expected to moderate participation-outcome relationships. Academy of Management Journal, 30(3), 524-541.
74.
Watson, R. T. , DeSanctis, G., & Poole, M. S. (1988). Using a GDSS to facilitate group consensus: Some intended and unintended consequences. MIS Quarterly, 12(3), 463-478.
75.
Winniford, M. (1991). Issues in automated voting. Prmceedings of the Twenty-Fourth Hawaii International Conference on Systems Sciences, 3, 621-630.
76.
Zigurs, I. , & Dickson, G. W. (1990). Computersupportfordecision-making teams: The issue of outcome quality. Faculty Working Paper Series, College of Business and Administration, University of Colorado.
77.
Zigurs, I. , Poole, M. S., & DeSanctis, G. (1988). A study of influences in computer-mediated communication. MIS Quarterly, 12(4), 625-644.
