The underlying factor structure of L2 close test performance in Francophone,university-level students: causal modelling as an approach to construct validation

Abstract

This study begins to address the question of cloze test construct validity through causal modelling. It investigates the underlying factor structure of L2 cloze test performance as explained by a theoretical model including the following hypothetical constructs: cloze-taking ability; knowledge of language; content domain; and knowledge of contextual constraints. Eight cloze tests reflecting the posited factors were constructed and administered to 182 Francophone, university-level students. The factors were examined separately and in combination through a model building process which included model fitting and model comparison. A model composed of three orthogonal factors was confirmed and accepted as the best explanation of the data. The results indicate that cloze performance is dependent upon language factors (a second language factor or a first language factor) and nonlinguistic specific knowledge related to cloze-taking ability that crosses over linguistic boundaries. Cloze has been considered as an overall L2 proficiency measure. This study empirically demonstrates that factors other than language are significantly contributing to cloze test performance. It also demonstrates the potential of a causal modelling approach.

Get full access to this article

View all access options for this article.

References

Bachman, L.F. 1982: The trait structure of cloze test scores. TESOL Quarterly 16, 61-70.

— 1985: Performance on cloze tests with fixed-ratio and rational deletions. TESOL Quarterly 19, 535-56.

Bachman, L.F. and Palmer, A.S. 1981: Basic concerns in test validation. In Read, J.A.S. editor, Directions in language testing, Singapore: Singapore University Press, 41-57.

— 1983: The construct validation of the FSI Oral Interview. In Oller, J. W. Jr. editor, Issues in language testing research, Rowley, MA: Newbury House, 154-69.

Bentler, P.M. 1978: The interdependence of theory, methodology, and empirical data: causal modeling as an approach to construct validation. In Kandel, D. B. editor, Longitudinal research on drug use: empirical findings and methodological issues, New York: John Wiley and sons, 267-302.

Bentler, P.M. and Bonett, D.G. 1980: Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin 88, 588-606.

Bridge, C.A. and Winograd, P.N. 1982: Readers' awareness of cohesive relationships during cloze comprehension. Journal of Reading Behaviour 14, 299-312.

Carrell, P.L. and Eisterhold, J.C. 1983: Schema theory and ESL reading pedagogy. TESOL Quarterly 17, 553-573.

Carroll, J.B. 1983: Psychometric theory and language testing. In Oller, J.W. Jr. editor, Issues in language testing research, Rowley, MA: Newbury House, 80-107.

10.

— 1987: [Review of C-Tests in der Praxis]. Language Testing 4, 99-106. Clarke, M.A. 1979: Reading in Spanish and English: evidence from adult ESL students. Language Learning 29, 121-50.

11.

Connor, U. 1984: Recall of text: differences between first and second language readers. TESOL Quarterly 18, 239-56.

12.

Floyd, P. and Carrell, P.L. 1987: Effects on ESL reading of teaching cultural content schemata . Language Learning 37, 89-108.

13.

Harley, B. , Allen, P. , Cummins J. and Swain, M. 1987: The development of bilingual proficiency: final report . Toronto, Ontario: The Ontario Institute for Studies in Education.

14.

Hudson, T. 1982: The effects of induced schemata on the "short circuit" in L2 reading: non-decoding factors in L2 reading performance. Language Learning 32, 1-31.

15.

Johnson, P. 1982: Effects on reading comprehension of building background knowledge. TESOL Quarterly 16, 503-16.

16.

Jöreskog, K.G. and Sörbom, D. 1984: LISREL VI: User's guide to anaysis of linear structural relationships by the method maximum likelihood, fourth edition. Mooresville, IN: Scientific Software.

17.

Loehlin, J.C. 1987: Latent variable models: an introduction to factor, path, and structural analysis. Hillsdale, NJ: Lawrence Erlbaum.

18.

MacLean, M. 1984: Using rational cloze for diagnostic testing in L1 and L2 reading. TESL Canada Journal 2, 53-63.

19.

Nelson, F.H. , Lomax, R.G. and Perlman, R. 1984: A structural equation model of second language acquistion for adult learners. Journal of Experimental Psychology 53, 29-39.

20.

Pedhazur, E.J. 1982: Multiple regression in behavioural research, second edition. New York: Holt, Rinehart and Winston.

21.

Purcell, E.T. 1983; Models of pronunciation accuracy. In Oller, J. W. Jr. editior, Issues in language testing research, Rowley, MA: Newbury House, 133-53.

22.

Rand, E. 1978: The effects of test length and scoring method on the precision of cloze test scores. In Working papers in teaching English as a second language 12, Los Angeles: University of California in Los Angeles, 62-71.

23.

Sang, F. , Schmitz, B. , Vollmer, H.J. , Baumert, J. and Roeder, P.M. 1986: Models of second language competence: a structural equation approach. Language Testing 3, 54-79.

24.

Stevenson, D.K. 1983: Foreign language testing: all of the above. In James, C. J. editor, Practical applications of research in foreign language teaching, Lincolnwood, IL: National Textbook Company, 153-203.

25.

Thurstone, L.L. 1947: Multiple factor analysis: a development and expansion of the vectors of mind. Chicago: University of Chicago.

26.

Turner, C.E. 1988: The underlying factor structure of L2 cloze test performance in Francophone, university-level students: causal modeling as an approach to construct validation. Unpublished doctoral dissertation, McGill University, Montreal.