Rasch Investigation of the CogAT Form 8 Verbal,Quantitative,and Nonverbal Domains in Grades 3 Through 5

Abstract

This study investigates the CogAT Form 8, which is widely used to help determine student eligibility for gifted education programs in K-12 schools, using dichotomous Rasch modeling to determine the psychometric properties of the test items. Scores were collected from 1,689 students in grades 3–5 from a large urban public school district in Texas in the 2022–2023 school year. Results indicate strong but preliminary evidence supporting the validity and use for assessing cognitive abilities in this diverse student population. On average, item difficulties were slightly lower than the person measure distributions, which aligns with usage in gifted education programs. Item fit statistics were acceptable for most items, and the person and item reliability indices suggest the CogAT supports consistent inferences about student ability across domains and grade levels. Overall, the results of our Rasch analyses support the continued, but cautiouse of the CogAT with similar student populations.

Keywords

CogAT Rasch psychometrics validity gifted ability testing

Get full access to this article

View all access options for this article.

References

Ackerman

P. L.

(2017). Review of the cognitive abilities test, form 7. In Carlson

J. F.

Geiser

K. F.

Jonson

J. L.

(Eds.), The twentieth mental measurements yearbook. Buros Center for Testing.

Bond

T. G.

Yan

Heene

(2020). Applying the Rasch model: Fundamental measurement in the human sciences. Routledge.

Cao

T. H.

Jung

J. Y.

Lee

(2017). Assessment in gifted education: A review of the literature from 2005 to 2016. Journal of Advanced Academics, 28(3), 163–203. https://doi.org/10.1177/1932202x17714572

Carlson

J. F.

Geisinger

K. F.

Jonson

J. L.

(Eds.). (2017). The twentieth mental measurements yearbook. Buros Center for Testing.

Carman

C. A.

Walther

C. A. P.

Bartsch

R. A.

(2018). Using the cognitive abilities test (CogAT) 7 nonverbal battery to identify the gifted/talented: An investigation of demographic effects and norming plans. Gifted Child Quarterly, 62(2), 193–209. https://doi.org/10.1177/0016986217752097

Carman

C. A.

Walther

C. A. P.

Bartsch

R. A.

(2020). Differences in using the cognitive abilities test (CogAT) 7 nonverbal battery versus the Naglieri nonverbal ability test (NNAT) 2 to identify the gifted/talented. Gifted Child Quarterly, 64(3), 171–191. https://doi.org/10.1177/0016986220921164

Cronbach

L. J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/bf02310555

Hoyt

C. J.

(1941). Note on a simplified method of computing test reliability. Educational and Psychological Measurement, 1(1), 91–103. https://doi.org/10.1177/001316444100100109

Kuder

G. F.

Richardson

M. W.

(1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–160. https://doi.org/10.1007/bf02288391

10.

Lakin

(2012). Assessing the cognitive abilities of culturally and linguistically diverse students: Predictive validity of verbal, quantitative, and nonverbal tests. Psychology in the Schools, 49(8), 756–768. https://doi.org/10.1002/pits.21630

11.

Lakin

Driver

(2017). CogAT: Introducing form 8. Riverside Insights, LLC. https://info.riversideinsights.com/hubfs/CogSpeakings/CognitivelySpeaking-IntroducingCogATForm8.pdf

12.

Lee

Karakis

Olcay Akce

Azzam Tuzgen

Karami

Gentry

Maeda

(2021). A meta-analytic evaluation of Naglieri nonverbal ability test: Exploring its validity evidence and effectiveness in equitably identifying gifted students. Gifted Child Quarterly, 65(3), 199–219. https://doi.org/10.1177/0016986221997800

13.

Linacre

J. M.

(2006). WISTEPS: Rasch measurement software. https://www.winsteps.com/winsteps.htm

14.

Lohman

D. F.

(2012). Cognitive abilities test form 7 research and development guide. Riverside Insights, LLC.

15.

Lohman

D. F.

(2015). Test review. Journal of Psychoeducational Assessment, 33(2), 188–192.

16.

Lohman

D. F.

Korb

K. A.

Lakin

J. M.

(2008). Identifying academically gifted English-language learners using nonverbal tests: A comparison of the Raven, NNAT, and CogAT. Gifted Child Quarterly, 52(4), 275–296. https://doi.org/10.1177/0016986208321808

17.

Mair

Hatzinger

(2007). Extended Rasch modeling: The eRm package for the application of IRT models in R. Journal of Statistical Software, 20(9), 1–20. https://doi.org/10.18637/jss.v020.i09

18.

Miller

M. D.

(2017). Review of the cognitive abilities test, form 7. In Carlson

J. F.

Geiser

K. F.

Jonson

J. L.

(Eds.), The twentieth mental measurements yearbook. Buros Center for Testing.

19.

Naglieri

J. A.

Ford

D. Y.

(2015). Misconceptions about the Naglieri nonverbal ability test: A commentary of concerns and disagreements. Roeper Review, 37(4), 234–240. https://doi.org/10.1080/02783193.2015.1077497

20.

Ozen

Pereira

Karatas

Castillo-Hermosilla

Maeda

(2025). A meta-analytic evaluation: Investigating evidence for the validity of the cognitive abilities test. Gifted Child Quarterly, 69(1), 3–15. https://doi.org/10.1177/00169862241285593

21.

R Core Team . (2024). R: A language and environment for statistical computing. R Foundation for Statistical Computing.

22.

Schumaker

R. E.

(2004). Rasch measurement: The dichotomous model. In Smith

E. V.

Smith

R. M.

(Eds.), Introduction to Rasch measurement (pp. 226–257). JAM Press.

23.

Smith

E. V.

Smith

R. M.

(2004). Introduction to Rasch measurement. JAM Press.

24.

Wilson

(2023). Constructing measures: An item response modeling approach (2nd ed.). Routledge.

25.

Wright

B. D.

Masters

G. N.

(1982). Rating scale analysis. MESA Press.

26.

Wright

B. D.

Stone

M. H.

(1979). Best test design. MESA Press.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.85 MB