The Impact of School District Turnaround on Postsecondary Outcomes: Evidence From Lawrence,Massachusetts

Abstract

Limited research examines the impact of accountability interventions on outcomes beyond test-based measures of short-term academic achievement. We examine the effects of the 2012 state takeover and district-wide turnaround of Massachusetts’s Lawrence Public Schools—a district serving a majority-low-income, majority-Hispanic student population—on high school and postsecondary outcomes using statewide, student-level data covering 2005–2006 to 2019–2020 and event study methods. These interventions have served as a model for other district turnaround efforts in the state and nationally. We find reforms improved high school graduation rates but find no impact on college enrollment and null to small negative effects on postsecondary persistence.

Keywords

accountability achievement educational policy equity postsecondary education quasi-experimental analysis

Get full access to this article

View all access options for this article.

References

Abadie

(2021). Using synthetic controls: Feasibility, data requirements, and methodological aspects. Journal of Economic Literature, 59(2), 391–425. https://doi.org/10.1257/jel.20191450

Abadie

Diamond

Hainmueller

(2010). Synthetic control methods for comparative case studies. Journal of the American Statistical Association, 105(490), 493–505. https://doi.org/10.1198/jasa.2009.ap08746

Abadie

Diamond

Hainmueller

(2015). Comparative politics and the synthetic control method. American Journal of Political Science, 59(2), 495–510. https://doi.org/10.1111/ajps.12116

Abel

J. R.

Deitz

(2014). Do the benefits of college still outweigh the costs? Current Issues in Economics and Finance, 20(3). https://www.newyorkfed.org/medialibrary/media/research/current_issues/ci20-3.pdf

Arkhangelsky

Athey

Hirshberg

D. A.

Imbens

G. W.

Wager

(2021). Synthetic difference-in-differences. American Economic Review, 111(12), 4088–4118. https://doi.org/10.1257/aer.20190159

Ashworth

Ransom

(2019). Has the college wage premium continued to rise? Evidence from multiple U.S. surveys. Economics of Education Review, 69, 149–154. https://doi.org/10.1016/j.econedurev.2019.02.003

Autor

D. H.

(2014). Skills, education, and the rise of earnings inequality among the “other 99 percent.” Science, 344(6186), 843–851. https://doi.org/10.1126/science.1251868

Baum

(2014). Higher education earnings premium: Value, variation, and trends. Urban Institute. https://eric.ed.gov/?id=ED544781

Bertrand

Duflo

Mullainathan

(2004). How much should we trust differences-in-differences estimates? The Quarterly Journal of Economics, 119(1), 249–275.

10.

Billmeier

Nannicini

(2013). Assessing economic liberalization episodes: A synthetic control approach. Review of Economics and Statistics, 95(3), 983–1001. https://doi.org/10.1162/rest_a_00324

11.

Booher-Jennings

(2005). Below the bubble: “Educational Triage” and the Texas accountability system. American Educational Research Journal, 42(2), 231–268. https://doi.org/10.3102/00028312042002231

12.

Callaway

Sant’Anna

P. C. H.

(2021). Differencein-differences with multiple time periods. Journal of Econometrics, 225, 200–230.

13.

Carneiro

Heckman

J. J.

Vytlacil

E. J.

(2011). Estimating marginal returns to education. American Economic Review, 101(6), 2754–2781. https://doi.org/10.1257/aer.101.6.2754

14.

Chan

R. Y.

(2016). Understanding the purpose of higher education: An analysis of the economic and social benefits for completing a college degree. Journal of Education Policy, Planning and Administration, 6(5), 1–40.

15.

Chetty

Deming

Friedman

(2023). Diversifying society’s leaders? The determinants and causal effects of admission to highly selective private colleges. National Bureau of Economic Research. https://doi.org/10.3386/w31492

16.

Childs

Carroll

J. M.

Harris

Tracy

Shields

Jabbar

Marsh

Ogden

(2023). From state takeover to the nation’s first all-charter, district-governed school system in New Orleans. Education Research Alliance for New Orleans. https://educationresearchalliancenola.org/publications/back-to-the-future-2

17.

Clark

Shi

(2020). Low-income female students and the reversal of the Black-White gap in high school graduation. AERA Open, 6(2). https://doi.org/10.1177/2332858420915203

18.

Deming

D. J.

Cohodes

Jennings

Jencks

(2016). School accountability, postsecondary attainment, and earnings. The Review of Economics and Statistics, 98(5), 848–862. https://doi.org/10.1162/REST_a_00598

19.

Empower Schools. (2025). Where We Work. https://www.empowerschools.org/where-we-work

20.

Figlio

Loeb

(2011). School accountability. In Hanushek

E. A.

Machin

Woessmann

(Eds.), Handbook of the economics of education (Vol. 3, pp. 383–417). Elsevier.

21.

Giani

M. S.

Attewell

Walling

(2020). The value of an incomplete degree: Heterogeneity in the labor market benefits of college non-completion. Journal of Higher Education, 91(4), 514–539. https://doi.org/10.1080/00221546.2019.1653122

22.

Harris

D. N.

Larsen

M. F.

(2023). Taken by storm: The effects of Hurricane Katrina on medium-term student outcomes in New Orleans. Journal of Human Resources, 58(5), 1608–1643.

23.

Hernández

(2019). Is there no excuse? Education Research Alliance for New Orleans. https://educationresearchalliancenola.org/files/publications/03192019-Hernandez-Is-There-No-Excuse-The-Effects-of-the-New-Orleans-School-Reforms-on-Exclusionary-Discipline-Practices.pdf

24.

Jepsen

Troske

Coomes

(2014). The labor-market returns to community college degrees, diplomas, and certificates. Journal of Labor Economics, 32(1), 95–121. https://doi.org/10.1086/671809

25.

Kim

Tamborini

C. R.

(2019). Are they still worth it? The long-run earnings benefits of an associate degree, vocational diploma or certificate, and some college. The Russell Sage Foundation Journal of the Social Sciences, 5(3), 64–85. https://doi.org/10.7758/RSF.2019.5.3.04

26.

Kolenikov

(2014). How different weighting methods work. Pew Research Center Methods. https://www.pewresearch.org/methods/2018/01/26/how-different-weighting-methods-work/

27.

Lawrence

E. M.

(2017). Why do college graduates behave more healthfully than those who are less educated? Journal of Health and Social Behavior, 58(3), 291–306. https://doi.org/10.1177/0022146517715671

28.

LiCalsi

Citkowicz

Friedman

Brown

(2015). Evaluation of Massachusetts Office of District and School Turnaround Assistance to commissioner’s districts and schools: Impact of school redesign grants. American Institutes for Research. https://files.eric.ed.gov/fulltext/ED583091.pdf

29.

Long

B. T.

(2018). The college completion landscape: Trends, challenges, and why it matters. AEI and Third Way. https://www.thirdway.org/report/the-college-completion-landscape-trends-challenges-and-why-it-matters

30.

McClelland

Gault

(2017). The synthetic control method as a tool to understand state policy. Urban–Brookings Tax Policy Center.

31.

Moore Johnson

. (2017). Investing in teachers: The Lawrence Public Schools respond to state receivership. Harvard Education Press.

32.

Moore Johnson

. (2021). Leaders change, policies evolve. The Lawrence Public Schools respond to state receivership, Act II. Harvard Education Press.

33.

Oreopoulos

Petronijevic

(2013). Making college worth it: A review of the returns to higher education. The Future of Children, 23(1), 41–65. https://www-jstor-org.web.bisu.edu.cn/stable/23409488

34.

Ost

Pan

Webber

(2018). The returns to college persistence for marginal students: Regression discontinuity evidence from university dismissal policies. Journal of Labor Economics, 36(3), 779–805. https://doi.org/10.1086/696204

35.

Papay

Hannon

(2018). The effects of school turnaround strategies in Massachusetts. Brown University. https://www.shankerinstitute.org/sites/default/files/ASI%20Presentation%20-%20School%20Turnaround%20-%20April%202017%20-%20To%20Post.pdf

36.

Papay

Mantil

Murane

Perez

(2021). The impact of COVID on college-going: Equity implications for the classes of 2020 and 2021. Brown University. https://annenberg.brown.edu/sites/default/files/impact_of_covid_on_college_ongoing.pdf

37.

Reber

Smith

(2023). College enrollment disparities: Understanding the role of academic preparation. Center on Children and Families at Brookings Institute. https://www.brookings.edu/wp-content/uploads/2023/02/20230123_CCF_CollegeEnrollment_FINAL2.pdf

38.

Reeves

Kalkat

(2023). Racial disparities in the high school graduation gender gap. Brookings Institute. https://www.brookings.edu/articles/racial-disparities-in-the-high-school-graduation-gender-gap/

39.

Schueler

(2019). A third way: The politics of school district takeover and turnaround in Lawrence, Massachusetts. Educational Administration Quarterly, 55(1), 116–153. https://doi.org/10.1177/0013161X18785873

40.

Schueler

B. E.

(2020). Making the most of school vacation: A field experiment of small group math instruction. Education Finance and Policy, 15(2), 310–331. https://doi.org/10.1162/edfp_a_00269

41.

Schueler

B. E.

(2024). Centralization and long-term system performance: Evidence from State takeovers of school districts. Political Research Quarterly, 78(2), 453–467. https://doi.org/10.1177/10659129241304096

42.

Schueler

B. E.

Asher

C. A.

Larned

K. E.

Mehrotra

Pollard

(2022). Improving low-performing schools: A meta-analysis of impact evaluation studies. American Educational Research Journal, 59(5), 975–1010. https://doi.org/10.3102/00028312211060855

43.

Schueler

B. E.

Bleiberg

(2022). Evaluating education governance: Does state takeover of school districts affect student achievement? Journal of Policy Analysis and Management, 41(1), 162–192.

44.

Schueler

B. E.

Goodman

Demming

(2017). Can states take over and turn around school districts? Evidence from Lawrence, Massachusetts. Education Evaluation and Policy Analysis, 39(2), 175–377. https://doi.org/10.3102/0162373716685824

45.

Schueler

B. E.

Nigro

Wang

(2023). Can states sustain and replicate school district improvement? Evidence from Massachusetts. Annenberg Institute at Brown University. https://doi.org/10.26300/2PSY-NW21

46.

Shores

K. A.

Candelaria

C. A.

Kabourek

S. E.

(2023). Spending more on the poor? Education Finance and Policy, 18(3), 395–422. https://doi.org/10.1162/edfp_a_00360

47.

Tamborini

C. R.

Kim

Sakamoto

(2015). Education and lifetime earnings in the United States. Demography, 52(4), 1383–1407. https://doi.org/10.1007/s13524-015-0407-0

48.

Valletta

R. G.

(2016). Recent flattening in the higher education wage premium: Polarization, skill downgrading, or both? National Bureau of Economic Research. https://doi.org/10.3386/w22935

49.

Zimmerman

S. D.

(2014). The returns to college admission for academically marginal students. Journal of Labor Economics, 32(4), 711–754. https://doi.org/10.1086/676661

50.

Ziol-Guest

K. M.

Lee

K. T. H.

(2016). Parent income–based gaps in schooling: Cross-cohort trends in the NLSYs and the PSID. AERA Open, 2(2). https://doi.org/10.1177/2332858416645834

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.91 MB