Recent advances in methods of cumulating research results across studies (i.e., meta-analysis) and related advances in utility research have rapidly increased our knowledge about the usefulness of personnel selection procedures in identifying capable job applicants. This paper describes two computer-based systems, one designed to disseminate the existing knowledge base on personnel selection, and the second to expand this knowledge base. The dissemination system, called the Staffing Decision Support System (SDSS), is a computer-based information system designed to assist staffing decision makers in answering two questions: 1) What is the best personnel selection procedure for identifying capable applicants for a job 2) What is the economic value of a personnel selection procedure? This paper will summarize the research which forms the basis of the SDSS, and explain the capabilities of the system. This paper will conclude with a description of the research support system designed to update and expand the SDSS system.
Get full access to this article
View all access options for this article.
References
1.
BobkoP.KarreR.ParkingtonJ.J. (1983) Estimation of standard deviations in utility analysis: An empirical test. Journal of Applied Psychology, 68, 170–176.
2.
BoudreauJ.W. (1983) Economic considerations in estimating the utility of human resource productivity improvement programs. Personnel Psychology, 36, 551–576.
3.
BoudreauJ.W. (1983) Effects of employee flows on utility analysis of human resource productivity improvement programs. Journal of Applied Psychology, 68, 396–406.
4.
BoudreauJ.W. (1984) Decision theory contributions to HRM research and practice. Industrial Relations, 21, 198–217.
5.
BrogdenH.E. (1949) When testing pays off. Personnel Psychology, 2, 171–183.
6.
BurkeM.J.FrederickJ.T. (1986) A comparison of economic utility estimates for alternative SDy estimation procedures. Journal of Applied Psychology, 71, 334–339.
7.
BurkeM.J. (1985) Estimating performance standard deviations in dollars for clerical occupations. In MatbieuJ.Chair, Estimating SDy: Examination and Advancement. Symposium presented at the annual meeting of the Southeastern Psychological Association, Atlanta.
8.
BurkeM.J.FrederickJ.T. (1984) Two modified procedures for estimating standard deviations in utility analysis. Journal of Applied Psychology, 69, 482–489.
9.
CallenderJ.C.OsburnH.G. (1980) Development and test of a new model for validity generalization. Journal of Applied Psychology, 65, 543–558.
10.
CallenderJ.C.OsburnH.G. (1981) Testing the constancy of validity with computer-generated sampling distributions of the multiplicative model variance estimate: Results for petroleum industry validation research. Journal of Applied Psychology, 66, 274–281.
11.
CallenderJ.C.OsburnH.G.GreenerJ.M. (1979) Small-sample tests of two validity generalization models. Paper presented at the meeting of the American Psychological Association, New York City.
12.
CascioW.F. (1982) Costing human resources: The financial impact of behavior in organizations. Boston: Kent.
13.
CascioW.E.SilbeyV. (1979) Utility of the assessment center as a selection device. Journal of Applied Psychology, 64, 107–118.
14.
CronbachL.J.GlaserG.C. (1957) Psychological tests and personnel decisions.Urbana: University of Illinois Press.
15.
DistefanoM.L.PryerM.W. (1984) Meta-analysis of the validity of a verbal ability selection test with psychiatry aides. Psychological Reports, 54, 676–678.
16.
FoleyP.P. (1986) Validity generalization of Navy selector composites. Navy Personnel Research and Development Center, San Diego, CA. NPRDC TR 86–17.
17.
GandyJ.A. (1986) Job complexity, aggregated subsample, and aptitude test validity: Meta-analysis of the GATB data base. Washington, D.C: U.S. Office of Personnel Management, Office of Staffing Policy.
18.
GauglerB.B.RosenthalD.B.ThorntonG.C.IIIBentsonC. (in press) Meta-Analysis of assessment center validity. Journal of Applied Psychology..
19.
GlassC.V. (1976) Primary, secondary and meta-analysis of research. Educational Researcher, 5, 3–8.
20.
GutenbergR.L.ArveyR.D.OsburnM.G.JeanneretP.R. (1983) Moderating effects of decision-making/information-processing job demands on test validities. Journal of Applied Psychology, 68, 602–608.
21.
HirshM.R.SchmidtF.L.HunterJ.E.PearlmanK. (1985) An improved method for estimating the standard deviation of the distribution of true validities. Paper presented at the 93rd Annual Convention of the American Psychological Association, Los Angeles.
22.
HirshH.R.NorthropL.G.SchmidtF.L. (1986) Validity generalization results for law enforcement occupations. Personnel Psychology, 39, 399–420.
23.
HunterJ.E. (1983) Test Validation for 12,000 jobs: An application of job classification and validity generalization to the General Aptitude Test Battery (GATB)Washington, DC: U.S. Department of Labor, Employment and Training Administration, Division of Counseling and Test Development.
24.
HunterJ.E.HunterR.F. (1984) Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.
25.
HunterJ.E.SchmidtF.L. (1982) Fitting people to jobs: The impact of personnel selection on national productivity. In DunnetteM.D.FleishmanE.O. (eds.), Human Performance and productivity, Vol. I: Human capacity assessment. Hillsdale, NJ: Erlbaum.
26.
HunterJ.E.SchmidtF.L.JacksonG.B. (1982) Meta-analysis: Cumulating research findings across studies.Beverly Hills, CA: Sage.
27.
LowenbergC.FaustB.D.LoschenkohlG.H.ConradK.A. (1985) Meta-analyses demonstrating validity generalization for managerial assessment center dimensions. In HirshH.R.ChairMeta-analysis of Alternative Predictors of Job Performance. Symposium presented at the 93rd Annual Convention of the American Psychological Association, Los Angeles.
28.
LilienthalR.A.PearlmanK. (1983) The validity of federal selection tests for aid/technicians in the health, science and engineering fields. (OPRD-83-1) Washington, D.C.: U.S. Office of Personnel Management, Office of Personnel Research and Development. (NTIS No. PB 80 102 650).
29.
McDanielM.A. (1986) The evaluation of a causal model of job performance: the interrelationships of general mental ability, job experience, and job performance. Doctoral Dissertation, The George Washington University.
30.
McDanielM.A.ReckM. (1985) Validity generalization data base project: coding instructions. Washington, DC: U.S. Office of Personnel Management, Office of Staffing Policy.
31.
McDanielM.A.SchmidtF.L. (1985) A meta-analysis of the validity of training and experience ratings in personnel selection. (OSP-85-1) Washington, DC: U.S. Office of Personnel Management, Office of Staffing Policy. (NTIS No. PB 86 109618/AS.).
32.
NorthropL.C. (1986) Validity generalization results for apprentice and helper-trainee positions. Washington, DC: U.S. Office of Personnel Management, Office of Staffing Policy.
33.
OuterbridgeA.N. (1979) A survey of test validation study costs. (TM-79-18) Washington, DC: U.S. Office of Personnel Management, Personnel Research and Development Center, Research Section). (NTIS No. PB80 127319).
34.
PearlmanK. (1985) Development of a dollar criterion for high-level sales jobs. Paper presented at 93rd Annual Convention of the American Psychological Association, Los Angeles.
35.
PearlmanK. (1982) The Bayesian approach to validity generalization: A systematic examination of the robustness of procedures and conclusions. Doctoral Dissertation, The George Washington University, Dissertation Abstracts International, 42, 496O9A.
36.
PearlmanK. (1979) The validity of tests used to select clerical personnel: A comprehensive summary and evaluation (TS-79-1)Washington, D.C.: U.S. Office of Personnel Management, Personnel Research and Development Center. (NTIS No. PB80 102 650).
37.
PearlmanK.NorthropL.C. (1978) An analysis of criterion related validity evidence relevant to Test 650 (TM-78-7). Washington, D.C.: U.S. Civil Service Commission, Personnel Research and Development Center (NTIS No. PB 2984O6).
38.
PearlmanK.SchmidtF.L.HunterJ.E. (1980) Validity generalization results for tests used to predict training success and job proficiency in clerical occupations. Journal of Applied Psychology, 65, 373–406.
39.
RajuN.S.BurkeM.J. (1983) Two new procedures for studying validity generalization, Journal of Applied Psychology, 68, 382–395.
40.
SchmidtF.L.Gast-RosenbergL.HunterJ.E. (1980) Validity generalization: Results for computer programmers. Journal of Applied Psychology, 65, 643–661.
41.
SchmidtF.L.HunterJ.E., (1977) Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529–540.
42.
SchmidtF.L.HunterF.L. (1981) Employment testing: Old theories and new research findings. American Psychologist, 36, 1128–1137.
43.
SchmidtF.L.HunterJ.E.CaplanJ.R. (1981) Validity generalization results for two occupations in the petroleum industry. Journal of Applied Psychology, 66, 261–273.
44.
SchmidtF.L.HunterJ.E.OuterbridgeA.N. (1986) The impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance. Journal of Applied Psychology, 71, 432–439.
45.
SchmidtF.L.HunterJ.E.OuterbridgeA.N.TrattnerM.H. (1986) The economic impact of job selection on size, productivity, and payroll costs of the federal work force: An empirically based demonstration. Personnel Psychology, 39, 1–30.
46.
SchmidtF.L.HunterJ.E.PearlmanK. (1981) Task difference moderators of aptitude test validity in selection: A red herring. Journal of Applied Psychology, 66, 166–185.
47.
SchmidtF.L.HunterJ.E.PearlmanK.CaplanJ.R. (1981) Validity generalization results for three occupations in the Sears Roebuck Company. Unpublished manuscript.
48.
SchmidtF.L.HunterJ.E.PearlmanK.ShaneG.S. (1979) Further tests of the Schmidt-Hunter Bayesian validity generalization procedure. Personnel Psychology, 65, 643–661.
49.
SchmittN.GoodingR.Z.NoeR.D.KirschM. (1984) Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407–422.
50.
TrattnerM. (1985) Estimating the validity of aptitude and ability tests for semiprofessional occupations using the Schmidt-Hunter interactive validity generalization procedure. (OSP-85-3) Washington, D.C.: U.S. Office of Personnel Management, Office of Staffing Policy. (NTIS PB 86 169463/AS).
51.
U.S. Department of Labor, U.S. Employment Service. (1977) Dictionary of Occupational Titles (4th Ed) Washington, D.C.: U.S. Government Printing Office.
52.
WeekleyJ.A.FrankB.O'ConnorE.J.PetersL.H. (1985) A comparison of three methods of estimating the standard deviation of performance in dollars. Journal of Applied Psychology, 70, 122–126.
