Sample Homogeneity and Coefficient Alpha: Comment on Mji and Alkhateeb's Reliability Generalization Study and a Theoretical Clarification

Abstract

Reliability generalization studies are increasingly frequently reported in the literature, including Mji and Alkhateeb's 2005 study of the Conceptions of Mathematics Questionnaire. The present article comments on an issue of reliability generalization as used in that study and clarifies a theoretical point regarding the meaning of coefficient alpha and what data features tend to influence it as a measure of score reliability.

Get full access to this article

View all access options for this article.

References

Charter

R. A.

(2003) Combining reliability coefficients: Possible application to meta-analysis and reliability generalization. Psychological Reports, 93, 643–647.

Crawford

Gordon

Nicholas

Prosser

(1998) University mathematics students' conceptions of mathematics. Studies in Higher Education, 23, 87–94.

Crocker

Algina

(1986) Introduction to classical and modern test theory. Chicago, IL: Holt, Rinehart & Winston.

Cronbach

L. J.

Shavelson

R. J.

(2004) My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64, 391–418.

Henson

R. K.

(2001) Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189.

Henson

R. K.

Thompson

(2002) Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113–127.

Mji

Alkhateeb

H. M.

(2005) Combining reliability coefficients: Toward reliability generalization of the Conceptions of Mathematics Questionnaire. Psychological Reports, 96, 627–634.

Shavelson

Webb

N. M.

(1991) Generalizability theory: A primer. Newbury Park, CA: Sage.

Thompson

Vacha-Haase

(2000) Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174–195.

10.

Vacha-Haase

(1998) Reliability generalization: Exploring variance in measurement error affecting score affecting score reliability across studies. Educational and Psychological Measurement, 58, 6–20.

11.

Vacha-Haase

Henson

R. K.

Caruso

J. C.

(2002) Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562–569.