Graduate Student WAIS-III Scoring Accuracy Is a Function of Full Scale IQ and Complexity of Examiner Tasks

Abstract

Research on the Wechsler Adult Intelligence Scale-Revised and Wechsler Adult Intelligence Scale-Third Edition (WAIS-III) suggests that practicing clinical psychologists and graduate students make item-level scoring errors that affect IQ, index, and subtest scores. Studies have been limited in that Full-Scale IQ (FSIQ) and examiner administration, recording, and scoring tasks have not been systematically varied. In this study, graduate student participants score a high (FSIQ = 112) and low (FSIQ = 85) IQ record form in one of two stimulus conditions: digitized film clips (N = 13) or partially completed record forms (N = 11). Results demonstrate that examiners are less accurate in the high IQ condition, and that recording examinee responses from scoring video clips results in more scoring errors. Obtained FSIQs are significantly higher than criterion IQ scores in the high IQ condition (8.46 for video condition, 2.55 for record form condition). Self-reported proficiency in WAIS-III administration and scoring is positively related to number of scoring errors.

Keywords

Wechsler scales scoring errors clinical decision making scoring confidence

Get full access to this article

View all access options for this article.

References

Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.

Franklin, F. R., Jr. , Stillman, P. A. , Burpeau, M. Y. , & Sabers, D. L. (1982). Examiner errors in intelligence testing: Are you a source? Psychology in the Schools, 19, 563-569.

Haynes, S. N. , & O’Brien, W. H. (2000). Principles and practice of behavioral assessment. Dordrecht, the Netherlands: Kluwer Academic.

Oakland, T. D. , & Zimmerman, S. A. (1986). The course on individual mental assessment: A national survey of course instructors. Professional School Psychology, 1, 51-59.

Patterson, M. , Slate, J. R. , Jones, C. H. , & Steger, H. S. (1995). The effects of practice administrations in learning to administer and score the WAIS-R: A partial replication. Educational and Psychological Measurement, 55(1), 32-37.

Pitman, E. J. G. (1939). A note on normal correlation. Biometrika, 31, 9-12.

The Psychological Corporation . (1997). Wechsler Adult Intelligence Scale-Third Edition technical manual. San Antonio, TX: Harcourt Brace.

Ryan, J. J. , Prifitera, A. , & Powers, L. (1983). Scoring reliability on the WAIS-R. Journal of Consulting and Clinical Psychology, 51(1), 149-150.

Ryan, J. J. , & Schnakenberg-Ott, S. D. (2003). Scoring reliability on the Wechsler adult intelligence scale-third edition (WAIS-III). Assessment, 10(2), 151-159.

10.

Slate, J. R. , & Jones, C. H. (1990a). Examiner errors on the WAIS-R: A source of concern. The Journal of Psychology, 124(3), 343-345.

11.

Slate, J. R. , & Jones, C. H. (1990b). Identifying students’ errors in administering the WAIS-R. Psychology in the Schools, 27, 83-87.

12.

Slate, J. R. , Jones, C. H. , & Murray, R. A. (1991). Teaching administration and scoring of the Wechlser Adult Intelligence Scale-Revised: An empirical evaluation of practice administrations. Professional Psychology: Research and Practice, 22(5), 375-379.

13.

Slate, J. R. , Jones, C. H. , Murray, R. A. , & Coulter, C. (1992). Evidence that practitioners err in administering and scoring the WAIS-R. Measurement and Evaluation in Counseling and Development, 25, 156-161.

14.

Stevens, J. (2002). Applied multivariate statistics for the social sciences (4th ed.). London: Lawrence Erlbaum.

15.

Wechsler, D. (2003). WISC-IV Technical and Interpretive Manual. San Antonio, TX: The Psychological Corporation.