This study investigated the psychological assessment literature to determine what applied researchers are using and reporting from confirmatory factor analysis (CFA) studies for evidence of construct validation. One hundred and one articles published in four major psychological assessment journals between 1990 and 2002 were systematically reviewed. Information from each article was collected across four broad areas: Background, Data Screening, Reporting Results, and Discussing Results. Temporal trends were assessed with point-biserial correlations to determine how practices have changed over time. From the review, several recommendations were provided to assist assessment researchers report validity evidence from CFA studies.
Get full access to this article
View all access options for this article.
References
1.
American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
2.
Bandalos, D. L., & Finney, S. J. (2001). Item parceling issues in structural equation modeling. In G. A. Marcoulides & R. E. Schumaker (Eds.), New developments and techniques in structural equation modeling (pp. 269-296). Mahwah, NJ: Erlbaum.
3.
Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17, 10-22.
4.
Benson, J., & Nasser, F. (1998). On the use of factor analysis as a research tool. Journal of Vocational Education, 23, 13-33.
5.
Bollen, K. A. (1989). Structural models with latent variables. New York: Wiley.
6.
Boomsma, A. (1982). The robustness of LISREL against small sample sizes in factor analysis models. In K. G. Jöreskog and H. Wold (Eds.), Systems under indirect observation: Causality, structure, prediction, Part 1 (pp. 149-173). Amsterdam: North-Holland.
7.
Breckler, S. J. (1990). Applications of covariance structure modeling in psychology: Cause for concern? Psychological Bulletin, 107, 260-273.
8.
Browne, M. W. (1984). Asymptotic distribution free methods in the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 127-141.
9.
Byrne, B. A. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
10.
Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Hillside, NJ: Erlbaum.
11.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston.
12.
DiStefano, C. (2002). Effects of ordered categorical data with confirmatory factor analysis. Structural Equation Modeling, 9, 327-346.
13.
Fabrigar, L. R., Wegener, D. T., Mac-Callum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
14.
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment7, 286-299.
15.
Gerbing, D. W., & Anderson, J. C. (1993). Monte Carlo evaluations of goodness-of-fit indices for structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 40-65). Newbury Park, CA: Sage.
16.
Hoyle, R. H., & Panter, A. T. (1993). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues and applications (pp. 158-176). Newbury Park, CA: Sage.
17.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
18.
Hulland, J., Chow, Y. H., & Lam, S. (1996). Use of causal models in marketing research: A review. International Journal of Research in Marketing, 13, 181-197.
19.
Jöreskog, K. G., & Sörbom, D. (1996). LIS REL 8: User’s reference guide. Chicago, IL: Scientific Software International.
20.
Kaplan, D. (2000). Structural equation modeling: Foundations and extensions. Thousand Oaks, CA: Sage.
21.
MacCallum, R. C., & Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51, 201-226.
22.
Marsh, H. W., Hau, K. T., Balla, J. R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181-220.
23.
Muthén, B. O. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115-132.
24.
Muthén, B., & Kaplan, D. (1985). A comparison of some of the methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171-189.
25.
Muthén, L. K., & Muthén, B. O. (2001). Mplus user’s guide (2nd ed). Los Angeles, CA: Muthén & Muthén.
26.
Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000). The performance of ML, GLS, and WLS estimation in structural equation modeling under conditions of misspecification and non-normality. Structural Equation Modeling, 7, 557-595.
27.
Rakov, T., & Marcoulides, G. A. (2000). A first course in structural equation modeling. Mahwah, NJ: Erlbaum.
28.
Russell, D. W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28, 1629-1646.
29.
Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variables analysis: Applications for developmental research (pp. 399-419). Thousand Oaks, CA: Sage.
30.
Schumaker, R. E., & Lomax, R. G. (1996). A beginner’s guide to structural equation modeling. Mahwah, NJ: Erlbaum.
31.
SPSS (2003). SPSS: Version 12.0 for Windows. Chicago: SPSS, Inc.
32.
Tanaka, J. S. (1993). Multifaceted conceptions of fit in structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 10-39). Newbury Park, CA: Sage.
33.
Thompson, B., & Daniel, L. G. (1996). Factor analytic evidence for the construct validity of scores: A historical overview and some guidelines. Educational and Psychological Measurement, 56, 197-208.
34.
West, S. G., Finch, J. F., & Curran, P. J. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed), Structural equation modeling: Concepts, issues, and applications. (pp. 56-75). Thousand Oaks, CA: Sage.
