The purpose of this research was to develop a selection test for staffing work teams. The knowledge, skills, and abilities (KSAs) for effective teamwork (Stevens & Campion, 1994) were used to develop a paper-and-pencil test of teamwork situations. KSAs reflected conflict resolution, collaborative problem solving, communication, goal setting and performance management, and planning and task coordination. Standard test construction techniques were used, and the test contained 35 multiple-choice items on hypothetical teamwork situations. Two validation studies were conducted involving production employees in a pulp mill (n = 70) and box plant (n = 72). Results showed criterion-related validity with supervisory and peer ratings of teamwork and overall job performance. However, a key unexpected finding was the large correlation with employment aptitude tests, suggesting that the Teamwork Test has a significant general mental ability component. The study also has secondary implications for the literatures on both contextual performance and situational tests. It was concluded that a consideration of individual level KSAs can have both conceptual and practical value in the staffing of work teams.
Get full access to this article
View all access options for this article.
References
1.
Aiken, L. S., & West, S. G.1991. Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
Arvey, R. D., Strickland, W., Drauden, G., & Martin, C.1990. Motivational components of test taking. Personnel Psychology, 43: 695-716.
4.
Barrick, M. R., & Mount, M. K.1991. The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44: 1-26.
5.
Bennett, G. K., Seashore, H. G., & Wesman, A. G.1991. Technical manual for the Differential Aptitude Tests. Chicago, IL: Psychological Corporation.
6.
Borman, W. C.1991. Job behavior, performance, and effectiveness. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (vol. 2): 271-326. Palo Alto, CA: Consulting Psychologists Press.
7.
Borman, W. C., & Motowidlo, S. J.1993. Expanding the criterion domain to include elements of contextual performance. In N. Schmitt & W. C. Borman (Eds.), Personnel selection in organizations:71-98. New York: Jossey-Bass.
8.
Brief, A. P., & Motowidlo, S. J.1986. Prosocial organizational behaviors. Academy of Management Review, 11: 710-725.
9.
Campion, M. A., Campion, J. E., & Hudson, J. P.1994. Structured interviewing: A note on incremental validity and alternative question types. Journal of Applied Psychology, 79: 998-1002.
10.
Cohen, J.1977. Statistical power analysis for the behavioral sciences. New York: Academic Press.
11.
Cortina, J. M.1993. What is Coefficient Alpha? An examination of theory and applications. Journal of Applied Psychology, 78: 98-104.
12.
Dye, D. A., Reck, M., & McDaniel, M. A.1993. Moderators of the validity of written job knowledge measures. International Journal of Selection and Assessment, 1: 153-157.
13.
File, Q. W., & Remmers, H. H.1946. Studies in supervisory evaluation. Journal of Applied Psychology, 30:421-425.
Flesch, R.1948. A new readability yardstick. Journal of Applied Psychology, 32: 221-233.
16.
Fry, E.1968. A readability formula that saves time. Journal of Reading, 12: 513-519.
17.
Gladstein, D. L.1984. Groups in context: A model of task group effectiveness. Administrative Sciences Quarterly, 29: 499-517.
18.
Goodman, P. S.1986. Designing effective work groups. San Francisco: Jossey-Bass.
19.
Gordon, R. A.1968. Issues in multiple regression. American Journal of Sociology, 73: 592-616.
20.
Guzzo, R. A., & Shea, G. P.1992. Group performance and intergroup relations in organizations. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (vol. 3): 269-313. Palo Alto, CA: Consulting Psychologists Press.
21.
Harris, M. M., & Schaubroeck, J.1988. A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41: 43-62.
22.
Hunter, J. E.1986. Cognitive ability, cognitive aptitudes, job knowledge, and job performance. Journal of Vocational Behavior, 29: 340-362.
23.
Hunter, J. E., & Hunter, R. F.1984. Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96: 72-98.
24.
Jensen, A. R.1986. g: Artifact or reality?Journal of Vocational Behavior, 29: 301-331.
25.
Kane, J. S., & Lawler, E. E.1978. Methods of peer assessment. Psychological Bulletin, 85: 555-586.
26.
Latham, G. P., Saari, L. M., Pursell, E. D., & Campion, M. A. (1980). The situational interview. Journal of Applied Psychology, 65: 422-427.
27.
Mayo, E.1933. The human problems of an industrial civilization. New York: Macmillan.
28.
McDaniel, M. A., Finnegan, E. B., Morgeson, F. P., Campion, M. A., & Braverman, E. P. 1997. Predicting job performance from common sense. Paper presented at the meeting of the Society for Industrial and Organizational Psychology. St. Louis, MO.
29.
Motowidlo, S. J., Dunnette, M. D., & Carter, G. W.1990. An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75: 640-647.
30.
Nunnally, J. C.1978. Psychometric theory (2nd ed.). New York: McGraw-Hill.
31.
Organ, D. W.1988. Organizational citizenship behavior: The good soldier syndrome. Lexington, MA: Lexington Books.
32.
Pearce, J. A., & Ravliu, E. C.1987. The design and activation of self regulating work groups. Human Relations, 40: 751-782.
33.
Ramsay, R. T.1991. Manual for the Job Skills Test: Reading. Pittsburgh, PA: Author.
34.
Reilly, R. R., & Chao, G. T.1982. Validity and fairness of some alternative employee selection procedures. Personnel Psychology, 35: 1-62.
35.
Ruch, F. L., & Ruch, W. W.1980. Technical report for the Employee Aptitude Survey. Glendale, CA: Psychological Services, Inc.
36.
Ruch, W. W., Weiner, J. A., McKillip, R. H., & Dye, D. A.1985. Technical manual for the PSlBasic Skills Test. Glendale, CA: Psychological Services, Inc.
37.
Schmitt, N., Gooding, R. Z., Noe, R. A., & Kirsch, M.1984. Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37: 407-422.
38.
Schwab, D. P.1980. Construct validity in organizational behavior research. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior:3-43. Greenwich, CT: JAI Press.
39.
Science Research Associates. 1986. Reading and Arithmetic Indexes examiner’s manual. Chicago, IL: London House.
40.
Shore, T. H., Shore L. M., & Thornton, G. C.1992. Construct validity of self- and peer-evaluations of performance dimensions in an assessment center. Journal of Applied Psychology, 77: 42-54.
41.
Sternberg, R. J., Wagner, R. K., Williams, W. M., & Horvath, J. A.1995. Testing common sense. American Psychologist, 50: 912-927.
42.
Stevens, M. J., & Campion, M. A.1993. The Teamwork-KSA Test. Chicago, IL: NCS-London House.
43.
Stevens, M. J., & Campion, M. A.1994. The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management, 20: 503-530.
44.
Swezey, R. W., & Salas, E. (Eds.). 1992. Teams: Their training and performance. Norwood, N J: Ablex.
45.
Tett, R. P., Jackson, D. N., & Rothstein, M.1991. Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44: 703-742.
46.
Trist, E., & Bamforth, K.1951. Some social and psychological consequences of the long wall method of coal-getting. Human Relations, 1: 3-38.
47.
Van Scotter, J. R., & Motowidlo, S. J.1996. Interpersonal facilitation and job dedication as separate facets of contextual performance. Journal of Applied Psychology, 81: 525-531.
48.
Walton, R.1972. How to counter alienation in the plant. Harvard Business Review, 50:70-81.
49.
Weekley, J. A., & Gier, J. A.1987. Reliability and validity of the situational interview for a sales position. Journal of Applied Psychology, 72: 484-487.
50.
Wesman, A. G.1980. Personnel Tests for Industry: Verbal test manual. Chicago, IL: Psychological Corporation.
51.
Wherry, R. J., & Gaylord, R. H.1943. The concept of test and item reliability in relation to factor pattern. Psychometrika, 8: 247-264.
