Are Schools Deemed Effective Based on Overall Student Growth Also Closing Achievement Gaps? Examining the Black

Abstract

Background/Context:

Closing achievement gaps is a major concern in U.S. education. These gaps can develop in a wide range of ways over the course of a student’s schooling. Yet, research on school effectiveness and accountability policies for schools often focuses on rank orderings of schools based on value-added models, which could mask those complex gap trends altogether.

Purpose:

In this study, schools’ contributions to student growth were estimated for Black versus White students such that some of the complex trends in how gaps develop can be disaggregated. Research questions were the following: (1) How different are the rank orderings of schools for Black versus White students? (2) Does relying on rank ordering alone mask any differences in how schools contribute to achievement gaps, including whether or not schools are (a) closing gaps, (b) preparing students for college differentially by race, and (c) generating comparable growth for White and Black students?

Sample:

Students in the sample, who ranged from roughly 92,000 to 139,000 in number depending on the year, all took a vertically scaled achievement test in math/reading and were followed longitudinally.

Research Design:

Rather than simply fit lag score models common in the value-added literature, growth curve models were estimated in a multilevel modeling framework.

Conclusion:

Results show that focusing on rank orderings of schools alone can mask troubling trends in relative achievement over time, including masking differential rates of progress toward college readiness for minoritized students.

Keywords

school accountability achievement gaps student growth assessment/testing

Get full access to this article

View all access options for this article.

References

Aaronson

Barrow

Sander

(2007). Teachers and student achievement in the Chicago public high schools. Journal of labor Economics, 25(1), 95–135.

Albert

P. S.

Follmann

D. A.

(2009). Shared-parameter models. In Fitzmaurice

Davidian

Verbeke

Molenberghs

(Eds.), Longitudinal data analysis (pp. 433–452). Chapman & Hall.

Briggs

D. C.

Domingue

(2013). The gains from vertical scaling. Journal of Educational and Behavioral Statistics, 38(6), 551–576.

Brown-Jeffy

(2009). School effects: Examining the race gap in mathematics achievement. Journal of African American Studies, 13(4), 388–405.

Downey

D. B.

Broh

(2003). Are schools the great equalizer? School and non-school influences on socioeconomic and Black/White gaps in reading skills [Working paper]. The Ohio State University, Columbus.

Downey

D. B.

Von Hippel

P. T.

Broh

B. A.

(2004). Are schools the great equalizer? Cognitive inequality during the summer months and the school year. American Sociological Review, 69(5), 613–635.

Ferguson

(2001). Test score trends along racial lines, 1971-1996: Popular culture and community academic standards. America Becoming: Racial Trends and Their Consequences, 1, 348–390.

Fox

(2016). Playing to teachers’ strengths: Using multiple measures of teacher effectiveness to improve teacher assignments. Education Finance and Policy, 11(1), 70–96.

Friedman

(1989). Mathematics and the gender gap: A meta-analysis of recent studies on sex differences in mathematical tasks. Review of Educational Research, 59(2), 185–213.

10.

Fryer

R. G.

Jr. Levitt

S. D.

(2004). Understanding the Black-White test score gap in the first two years of school. Review of Economics and Statistics, 86(2), 447–464.

11.

Gaddis

S. M.

Lauen

D. L.

(2014). School accountability and the Black–White test score gap. Social Science Research, 44, 15–31.

12.

Haertel

E. H.

(2013). Reliability and validity of inferences about teachers based on student scores. Educational Testing Service.

13.

Hainmueller

(2012). Entropy balancing for causal effects: A multivariate reweighting method to produce balanced samples in observational studies. Political Analysis, 20(1), 25–46.

14.

Haller

Hunt

Pacha

Fazekas

(2016). Lessons for states: The “Every Student Succeeds Act” (ESSA) increases focus on and investment in supporting principal preparation and development. Center for the Study of Education Policy.

15.

Hedeker

Gibbons

R. D.

(1997). Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods, 2(1), 64–78.

16.

Hedges

L. V.

Nowell

(1999). Changes in the Black-White gap in achievement test scores. Sociology of Education, 72(2), 111–135.

17.

Jencks

Phillips

(2011). The Black-White test score gap. Brookings Institution Press.

18.

Kolen

M. J.

Brennan

R. L.

(2004). Test equating, scaling, and linking: Methods and practices. Springer.

19.

Loeb

Soland

Fox

(2014). Is a good teacher a good teacher for all? Comparing value-added of teachers with their English learners and non-English learners. Educational Evaluation and Policy Analysis, 36(4), 457–475.

20.

LoGerfo

Nichols

Chaplin

(2007). Gender gaps in math and reading gains during elementary and high school by race and ethnicity. Urban Institute. http://www.urban.org/url.cfm?ID=411428

21.

Maple

S. A.

Stage

F. K.

(1991). Influences on the choice of math/science major by gender and ethnicity. American Educational Research Journal, 28(1), 37–60.

22.

Marsh

J. A.

Bush-Mecenas

Hough

(2017). Learning from early adopters in the new accountability era: Insights from California’s CORE waiver districts. Educational Administration Quarterly, 53(3), 327–364.

23.

McCaffrey

D. F.

Sass

T. R.

Lockwood

J. R.

Mihaly

(2009). The intertemporal variability of teacher effect estimates. Education Finance and Policy, 4(4), 572–606.

24.

McEachin

Atteberry

(2017). The impact of summer learning loss on measures of school performance. Education Finance and Policy, 12(4), 468–491.

25.

Murnane

R. J.

Willett

J. B.

Bub

K. L.

McCartney

Hanushek

Maynard

(2006). Understanding trends in the Black-White achievement gaps during the first years of school [with comments]. In Brookings-Wharton Papers on Urban Affairs (pp. 97–135). Brookings Institution Press. https://www-jstor-org-443.web.bisu.edu.cn/journal/broowharurbanaff

26.

Murnane

R. J.

Willett

J. B.

Duhaldeborde

Tyler

J. H.

(2000). How important are the cognitive skills of teenagers in predicting subsequent earnings? Journal of Policy Analysis and Management, 19(4), 547–568.

27.

Neal

(2006). Why has Black–White skill convergence stopped? Handbook of the Economics of Education, 1, 511–576.

28.

Phillips

Crouse

Ralph

(1998). Does the Black–White test score gap widen after children enter school? In Jencks

Phillips

(Eds.), The Black–White test score gap (pp. 229–272). Brookings Institution Press.

29.

Quinn

D. M.

(2015). Kindergarten Black–White test score gaps: Re-examining the roles of socioeconomic status and school quality with new data. Sociology of Education, 88, 120–139. https://doi.org/10.1177/0038040715573027

30.

Quinn

D. M.

Cooc

McIntyre

Gomez

C. J.

(2016). Seasonal dynamics of academic achievement inequality by socioeconomic status and race/ethnicity: Updating and extending past research with new national data. Educational Researcher, 45(8), 443–453.

31.

Quinn

D. M.

McIntyre

(2017). Do learning rates differ by race/ethnicity over kindergarten? Reconciling results across gain score, first-difference, and random effects models. Economics of Education Review, 59, 81–86.

32.

Reardon

S. F.

Baker

Klasik

(2012). Race, income, and enrollment patterns in highly selective colleges, 1982–2004. Center for Education Policy Analysis, Stanford University.

33.

Rothstein

(2009). Student sorting and bias in value-added estimation: Selection on observables and unobservables. Education Finance and Policy, 4(4), 537–571.

34.

Soland

(2017). Is teacher value added a matter of scale? The practical consequences of treating an ordinal scale as interval for estimation of teacher effects. Applied Measurement in Education, 30(1), 52–70.

35.

Soland

(2018a). The achievement gap or the engagement gap? Investigating the sensitivity of gaps estimates to test motivation. Applied Measurement in Education, 31(4), 312–323.

36.

Soland

(2018b). Are achievement gap estimates biased by differential student test effort? Putting an important policy metric to the test. Teachers College Record, 120(12), 1–26.

37.

Soland

. (2019). Can item response times provide insight into students’ motivation and self-efficacy in math? An initial application of test metadata to understand students’ social–emotional needs. Educational Measurement: Issues and Practice, 38(3), 86–96.

38.

Soland

Thum

Y. M.

(2022). Estimating and comparing growth using longitudinal interim achievement data with seasonal trends. Journal of Research on Educational Effectiveness. Advance online publication. https://doi.org/10.1080/19345747.2021.2018744

39.

Thomas

W. P.

Collier

V. P.

(2002). A national study of school effectiveness for language minority students’ long-term academic achievement. Center for Research on Education, Diversity and Excellence, University of California-Santa Cruz.

40.

Thum

Y. M.

Matta

(2015). MAP college readiness benchmarks: A research brief. NWEA.

41.

von Hippel

P. T.

Hamrock

. (2019). Do test score gaps grow before, during, or between the school years? Measurement artifacts and what we can know in spite of them. Sociological Science, 6, 43–80.

42.

von Hippel

P. T.

Workman

Downey

D. B

. (2018). Inequality in reading and math skills forms mainly before kindergarten: A replication, and partial correction, of “Are Schools the Great Equalizer?” Sociology of Education, 91(4), 323–357.

43.

Yeh

S. S.

(2010). Understanding and addressing the achievement gap through individualized instruction and formative assessment. Assessment in Education: Principles, Policy & Practice, 17(2), 169–182.

44.

Yeh

S. S.

(2015). Two models of learning and achievement: An explanation for the achievement gap? Teachers College Record, 117(12), 12–18.

Are Schools Deemed Effective Based on Overall Student Growth Also Closing Achievement Gaps? Examining the Black–White Gap by School

Abstract

Background/Context:

Purpose:

Sample:

Research Design:

Conclusion:

Keywords

Get full access to this article

References