Video-taped interviews and mock ratings of typical cases were employed to evaluate raters' consistency of 37 raters (14 staff psychiatrists, 11 psychiatric residents, 10 clinical psychologists and interns, 2 nurses). Total score across time was most stable, single scale scores least consistent. Trends between professional groups were not large and not always related to degree of training, but psychologists rated typical patients more consistently, psychiatric residents showed greater across-time and inter-rater consistency. The latter varied on taped interviews with symptoms being rated. Over-all, reliabilities on the Brief Psychiatric Rating Scale were as high as could be expected.
References
1.
EbelR. L.Estimation of the reliability of ratings. Psychometrika, 1951, 16, 407–424.
2.
FisherR. A.Statistical methods for the research workers. (10th ed.) Edinborough: Oliver & Boyd, 1946.
3.
GleserG. C.CronbachL. J.RajaratnamN.Generalizability of scores influenced by multiple sources of variance. Psychometrika, 1965, 30, 395–418.
4.
GuyW.BonnettelR. R. (Eds.) Manual for the ECDEU Assessment Battery. (2nd rev.) Chevy Chase, Md.: U. S. Department of Health, Education, and Welfare, Public Health Service, National Institute of Mental Health, July, 1970.
5.
KendellR. E.CooperJ. E.GourlayA. J.CoperlandJ. R. M.SharpeL.GurlandB. J.Diagnostic criteria of American and British psychiatrists. Archives of General Psychiatry, 1971, 25, 123–130.
6.
NortonW. A.A review of psychiatric rating scales. Canadian Psychiatric Association Journal, 1967, 12, 563–573.
7.
OverallJ. E.Estimating individual rater reliabilities from analysis of treatment effects. Educational and Psychological Measurement, 1968, 28, 255–264.
