The aim of this study was to examine the interrater reliability in the coding of the Defense Mechanism Test for 130 variables on both a variable and a subject level. Parallel with a traditional variable analysis, a multivariate strategy for measurement of interrater reliability, built upon principal component analysis, is presented. The results showed high agreement between judges with an overall interrater reliability coefficient of .98 but indicates the need for elucidation in the coding instructions for nine single variables. It also showed that multivariate modeling methods for handling personality test data are highly resistant to occasional differences on single variables but sensitive to major differences.
Get full access to this article
View all access options for this article.
References
1.
ArmeliusB-Å.JeanneauM. (1995) The treatment home evaluation project in Sweden. Department of Applied Psychology, Umeå Univer.
2.
CramerR. D.BunceJ. D.PattersonD. E. (1988) Crossvalidation, bootstrapping, and Partial Least Squares compared with multiple regression in conventional QSAR studies. Quantitative Structure-Activity Relationships, 7, 18–25.
3.
ErikssonL.JohanssonE.WoldS. (1996) QSAR model validation. Presented at Proceedings of the 7th International Workshop on QSAR in Environmental Science, Helsingör, Denmark, 24–28 June. Pensacola, FL: SETAC.
4.
HenningssonM.SundbomE. (1996) Defensive characteristics in individuals with amalgam illness as measured by the percept-genetic method Defense Mechanism Test. Acta Odontologica Scandinavica, 54, 176–181.
5.
HenningssonM.SundbomE. (unpublished a) Conversion Disorder and “Multiple Chemical Sensitivity”: A comparative study of psychological defense strategies.
6.
HenningssonM.SundbomE. (unpublished b) Empirical and theoretical models for defensive strategies in psychosomatic groups: A comparative study of Chronic Fatigue Syndrome, Conversion Disorder and Multiple Chemical Sensitivity.
7.
HenningssonM.SundbomE.ArmeliusB-Å.ErdbergP. (in press) PLS model building: A multivariate approach to personality test data. Scandinavian Journal of Psychology.
8.
JohnsonD. E. (1998) Applied multivariate methods for data analysts. Pacific Grove, CA: Brooks/Cole.
9.
KraghU. (1955) The actual-genetic model of perception-personality. Lund, Sweden: Gleerup.
10.
KraghU. (1985) DMT manual. Stockholm: Swedish Psychology International AB.
11.
NunnallyJ. C.BernsteinI. H. (1994) Psychometric theory. (3rd ed.) New York: McGraw-Hill.
12.
SharmaS. (1996) Applied multivariate techniques. New York: Wiley.
13.
ShroutP. E. (1995) Measuring the degree of consensus in personality judgements. In ShroutP. E.FiskeS. T. (Eds.), Personality, research, methods, and theory. Hillsdale, NJ: Erlbaum.79–92.
14.
ShroutP. E.FleissJ. L. (1979) Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.
15.
StåhleL.WoldS. (1988) Multivariate data analysis and experimental design in biomedical research. Progress in Medicinal Chemistry, 25, 290–338.
16.
SundbomE.ArmeliusB-Å. (1992) Reaction to DMT as related to psychotic and borderline personality organizations. Scandinavian Journal of Psychology, 33, 178–188.
17.
SundbomE.BinzerM.KullgrenG. (1999) Psychological defensive strategies according to the Defense Mechanism Test among patients with severe conversion disorder. Psychotherapy Research, 9, 194–208.
18.
SundbomE.BodlundO. (1999) Prediction of outcome in transsexualism by means of the Defense Mechanism Test and multivariate modeling: A pilot study. Perceptual and Motor Skills, 88, 3–20.
19.
SundbomE.BodlundO.HöjerbackT. (1995) Object relations and defensive operations in transsexuals and borderline patients as measured by the Defense Mechanism Test. Nordic Journal of Psychiatry, 49, 379–388.
20.
SundbomE.JacobssonL.KullgrenG.PenayoU. (1998) Personality and defenses: A cross-cultural study of psychiatric patients and healthy individuals in Nicaragua and Sweden. Psychological Reports, 83, 1331–1347.
21.
SundbomE.KullgrenG. (1992) Multivariate modeling and the Defense Mechanism Test: A comparative study of defensive structures in borderline, other personality disorders and schizophrenic disorder. Acta Psychiatrica Scandinavica, 86, 379–385.
22.
WoldS.AlbanoC.DunnW.EsbensenK.JohanssonE.SjöströmM. (1983) Pattern recognition: Finding and using regularities in multivariate data. In MartelliH.RusswurmH. (Eds.), Food research and data analysis. London: Applied Science.147–188.
