This construct validation study investigated the factor structure of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis was conducted for a test form completed by participants in a field study. A higher-order factor model was identified, with a higher-order general factor (ESL/EFL ability) and four first-order factors for reading, listening, speaking and writing. Integrated Speaking and Writing tasks, which require language processing in multiple modalities, defined the target modalities (speaking and writing). These results broadly supported the current practice of reporting a total score and four scores corresponding to the modalities for the test, as well as the test design that permits the integrated tasks to contribute only to the scores of the target modalities.
Bachman, L.F. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2, 1-34.
2.
Bachman, L.F., Davidson, F., Ryan, K., & Choi, I.-C. (1995). An investigation into the comparability of two tests of English as a foreign language: The Cambridge-TOEFL comparability study. Cambridge: Cambridge University Press.
3.
Bachman, L.F., & Palmer, A. (1981). The construct validation of the FSI oral interview . Language Learning, 31, 67-86.
4.
Bachman, L.F., & Palmer, A. (1982). The construct validation of some components of communicative proficiency. TESOL Quarterly, 16, 449-465.
5.
Bachman, L.F., & Palmer, A. (1996). Language testing in practice. Oxford: Oxford University Press.
6.
Bagozzi, R.P., & Yi, Y. (1992). On the evaluation of structural equation models . Journal of the Academy of Marketing Science, 16, 74-94.
7.
Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen, & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
8.
Carr, N.T. (2003). An investigation into the structure of text characteristics and reader abilities in a test of second language reading. Unpublished doctoral dissertation. Los Angeles: University of California Press.
9.
Carroll, J.B. (1983). Psychometric theory and language testing. In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 80-107). Rowley, MA: Newbury House.
10.
Chapelle, C., Enright, M. K., & Jamieson, J. (Eds.) (2008). Building a validity argument for the Test of English as a Foreign Language. New York: Routledge.
11.
Chapelle, C., Grabe, W., & Berns, M. (2000). Communicative language proficiency: Definition and implications for TOEFL 2000 (TOEFL Monograph Series MS-10). Princeton, NJ: Educational Testing Service.
12.
Chen, F.F., West, S.G., & Sousa, K.H. (2006). Comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41, 189-225.
13.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
14.
Davidson, F.D. (1988). An exploratory modeling of the trait structures of some existing language test datasets. Unpublished doctoral dissertation . Los Angeles: University of California Press.
15.
Educational Testing Service (2003). TOEFL test and score data summary: 2002-03 test year data. Princeton, NJ: Educational Testing Service.
16.
Farhady, H. (1983). On the plausibility of the unitary language proficiency factor. In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 11-28). Rowley, MA: Newbury House.
17.
Hale, G.A., Rock, D.A., & Jirele, T. (1989). Confirmatory factor analysis of the Test of English as a Foreign Language (TOEFL Research Report No. 32). Princeton, NJ: Educational Testing Service.
18.
Hale, G.A., Stansfield, C.W., Rock, D.A., Hicks, M.M., Butler, F.A., & Oller, J.W. Jr. (1988). Multiple-choice cloze items and the Test of English as a Foreign Language (TOEFL Research Report No. 26). Princeton, NJ: Educational Testing Service.
19.
Hoyle, R.H., & Panter, A.T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 158-176). Thousand Oaks, CA: Sage.
20.
Jöreskog, K.G. (1993). Testing structural equation models. In K. A. Bollen, & J. S. Long (Eds.), Testing structural equation models (pp. 294-316). Newbury Park, CA: Sage.
21.
Jöreskog, K., & Sörbom, D. (2003a). PRELIS (Version 2.54) [Computer software]. Chicago, IL: Scientific Software International.
22.
Jöreskog, K., & Sörbom, D. (2003b). LISREL (Version 8.54) [Computer software]. Chicago, IL: Scientific Software International.
23.
Kline, R.B. (1998). Principles and practice of structural equation modeling. New York: Guilford.
24.
Kunnan, A. (1995). Test taker characteristics and test performance: A structural equation modeling approach. Cambridge: Cambridge University Press.
25.
Lewkowicz, J.A. (1997). The integrated testing of a second language. In C. Clapham, & D. Corson (Eds.), Encyclopedia of language and education, Vol. 7: Language testing and assessment (pp. 121-130). Dordrecht, The Netherlands: Kluwer Academic.
26.
Manning, W.H. (1987). Development of cloze-elide tests of English as a second language (TOEFL Research Report RR-87-18). Princeton, NJ: Educational Testing Service.
27.
McLeod, L.D., Swygert, K.A., & Thissen, D. (2001). Factor analysis for items scored in two categories . In D. Thissen, & H. Wainer (Eds.), Test scoring (pp. 189-216). Mahwah, NJ: Lawrence Erlbaum.
28.
Oller, J.W., Jr. (1976). Evidence of a general language proficiency factor: An expectancy grammar. Die Neuen Sprachen, 76, 165-74.
29.
Oller, J.W., Jr. (1983). A consensus for the eighties? In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 351-356). Rowley, MA: Newbury House.
30.
Oller, J.W., Jr., & Hinofotis, F.A. (1980). Two mutually exclusive hypotheses about second language ability: Factor analytic studies of a variety of language subtests. In J. W. Oller, Jr., & K. Perkins (Eds.), Research in language testing (pp. 13-23). Rowley, MA: Newbury House.
31.
Raykov, T., and Marcoulides, G.A. (2000). A first course in structural equation modeling. Mahwah, NJ: Lawrence Erlbaum.
32.
Rindskopf, D., & Rose, T. (1988). Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research, 23, 51-67.
33.
Sawaki, Y., Stricker, L., & Oranje, A. (2008). Factor Structure of the TOEFL(R) Internet-Based Test (iBT): Exploration in a Field Trial Sample. (TOEFL iBT Research Report No. TOEFLiBT-04). Princeton, NJ: ETS.
34.
Sasaki, M. (1996). Second language proficiency, foreign language aptitude, and intelligence: Quantitative and qualitative analyses. New York: Lang.
35.
Satorra, A. (1990). Robustness issues in structural equation modeling: Areview of recent developments. Quality & Quantity, 24, 367-86.
36.
Satorra, A., & Bentler, P. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, pp. 507-514.
37.
Shin, S.-K. (2005). Did they take the same test? Examinee language proficiency and the structure of language tests. Language Testing, 22, 31-57.
38.
Swinton, S.S., & Powers, D.E. (1980). Factor analysis of the Test of English as a Foreign Language for several language groups (TOEFL Research Report No. 6). Princeton, NJ: Educational Testing Service.
39.
Stricker, L.J., & Rock, D.A. (2005). Factor analysis of New Generation TOEFL. Unpublished analysis memorandom. Princeton, NJ: Educational Testing Service.
40.
Stricker, L.J., Rock, D.A., & Lee, Y.-W. (2005). Factor structure of the LanguEdge test across language groups (TOEFL Monograph Series MS-32). Princeton, NJ: Educational Testing Service.
41.
Urquhart, S., & Weir, C.J. (1998). Reading in a second language: Process, product and practice. London: Longman.
42.
Weir, C.J. (1990). Communicative language testing. (2nd ed.). New York: Prentice Hall.
43.
Wesche, B. (1987). Second language performance testing: The Ontario test of ESL as an example. Language Testing, 4, 28-37.
