Testing the Way Forward: The Impact of Statewide ACT or SAT Testing on Postsecondary Outcomes

Abstract

Twenty-nine states require or allow all 11th graders to take the ACT or SAT in school, for free, eliminating access to testing as a barrier to college entry. I examine whether this affects postsecondary outcomes using state-aggregated panel data and time-varying difference-in-differences methods. I find policy adoption led to 2% increases in selective 4-year enrollments by students from treated states. However, adoption had no effect on enrollments within adopting states’ selective institutions, in part because institutions enrolled fewer students from out-of-state after adoption. I also find null but directionally negative effects on the number of graduates from state institutions. Therefore, impacts are small but positive for students from adopting states, but null or negative for adopting states’ institutions.

Keywords

colleges testing postsecondary education educational policy high schools econometric analysis quasi-experimental analysis secondary data analysis

Get full access to this article

View all access options for this article.

References

Altonji

J. G.

Blom

Meghir

(2012). Heterogeneity in human capital investments: High school curriculum, college major, and careers. Annual Review of Economics, 4, 185–223. https://doi.org/10.1146/annurev-economics-080511-110908

Alvero

Giebel

Gebre-Medhin

Antonio

A. L.

Stevens

M. L.

Domingue

B. W.

(2021). Essay content and style are strongly related to household income and SAT scores: Evidence from 60,000 undergraduate applications. Science Advances, 7(42). https://doi.org/10.1126/sciadv.abi9031

Attewell

Heil

Reisel

(2011). Competing explanations of undergraduate noncompletion. American Educational Research Journal, 48(3), 536–559. https://doi.org/10.3102/0002831210392018

Baker

A. C.

Larcker

D. F.

Wang

C. C. Y.

(2022). How much should we trust staggered difference-in-differences estimates? Journal of Financial Economics, 144(2), 370–395. https://doi.org/10.1016/j.jfineco.2022.01.004

Bell

A. D.

Rowan-Kenyon

H. T.

Perna

L. W.

(2009). College knowledge of 9th and 11th grade students: Variation by school and state context. The Journal of Higher Education, 80(6), 663–685. https://doi.org/10.1353/jhe.0.0074

Bettinger

E. P.

Long

B. T.

Oreopoulos

Sanbonmatsu

(2012). The role of application assistance and information in college decisions: Results from the H&R Block FAFSA experiment. The Quarterly Journal of Economics, 127(3), 1205–1242. https://doi.org/10.1093/qje/qjs017

Bozick

DeLuca

(2011). Not making the transition to college: School, work, and opportunities in the lives of American youth. Social Science Research, 40(4), 1249–1262. https://doi.org/10.1016/j.ssresearch.2011.02.003

Buchmann

Condron

D. J.

Roscigno

V. J.

(2010). Shadow education, American style: Test preparation, the SAT and college enrollment. Social Forces, 89(2), 435–461. https://doi.org/10.1353/sof.2010.0105

Bulman

(2015). The effect of access to college assessments on enrollment and attainment. American Economic Journal: Applied Economics, 7(4), 1–36. https://doi.org/10.1257/app.20140062

10.

Carnevale

A. P.

Rose

S. J.

(2011). The undereducated American. Georgetown Center on Education and the Workforce. https://cew.georgetown.edu/cew-reports/the-undereducated-american/

11.

Carnevale

A. P.

Strohl

Ridley

Gulish

(2018). Three educational pathways to good jobs: High school, middle skills, and bachelor’s degree. Georgetown Center on Education and the Workforce. https://cew.georgetown.edu/cew-reports/the-undereducated-american/

12.

Carrell

Sacerdote

(2017). Why do college-going interventions work? American Economic Journal: Applied Economics, 9(3), 124–151. https://doi.org/10.1257/app.20150530

13.

Castleman

B. L.

Arnold

Wartman

K. L.

(2012). Stemming the tide of summer melt: An experimental study of the effects of post-high school summer intervention on low-income students’ college enrollment. Journal of Research on Educational Effectiveness, 5(1), 1–17. https://doi.org/10.1080/19345747.2011.618214

14.

Castleman

B. L.

Page

L. C.

(2014). A trickle or a torrent? Understanding the extent of summer “melt” among college-intending high school graduates. Social Science Quarterly, 95(1), 202–220. https://doi.org/10.1111/ssqu.12032

15.

Castleman

B. L.

Page

L. C.

(2016). Freshman year financial aid nudges: An experiment to increase FAFSA renewal and college persistence. Journal of Human Resources, 51(2), 389–415. https://doi.org/10.3368/jhr.51.2.0614-6458R

16.

Castleman

B. L.

Page

L. C.

Schooley

(2014). The forgotten summer: Does the offer of college counseling after high school mitigate summer melt among college-intending, low-income high school graduates? Journal of Policy Analysis and Management, 33(2), 320–344. https://doi.org/10.1002/pam.21743

17.

Cengiz

Dube

Lindner

Zipperer

(2019). The effect of minimum wages on low-wage jobs. The Quarterly Journal of Economics, 134(3), 1405–1454. https://doi.org/10.1093/qje/qjz014

18.

Coleman

J. S.

(1988). Social capital in the creation of human capital. American Journal of Sociology, 94, S95–S120. https://www-jstor-org-443.web.bisu.edu.cn/stable/2780243

19.

Cox

R. D.

(2016). Complicating conditions: Obstacles and interruptions to low-income students’ college “choices.” The Journal of Higher Education, 87(1), 1–26. https://doi.org/10.1353/jhe.2016.0005

20.

de Brey

Snyder

T. D.

Zhang

Dillow

S. A

. (2021). Digest of education statistics 2019 (2021–009; NCES). https://nces.ed.gov/programs/digest/

21.

DeLuca

Papageorge

N. W.

Boselovic

Gershenson

Gray

Nerenberg

Sausedo

Young

(2021). “When anything can happen”: Anticipated adversity and postsecondary decision-making (NBER Working Paper No. 29472). http://www.nber.org/papers/w29472

22.

Deming

D. J.

Goldin

Katz

L. F.

(2012). The for-profit postsecondary school sector: Nimble critters or agile predators? Journal of Economic Perspectives, 26(1), 139–164. https://doi.org/10.1257/jep.26.1.139

23.

Dynarski

Libassi

Michelmore

Owen

(2021). Closing the gap: The effect of reducing complexity and uncertainty in college pricing on the choices of low-income students. American Economic Review, 111(6), 1721–1756. https://doi.org/10.1257/aer.20200451

24.

East

C. N.

Miller

Page

Wherry

L. R.

(2023). Multigenerational impacts of childhood access to the safety net: Early life exposure to Medicaid and the next generation’s health. American Economic Review, 113(1), 98–135. https://doi.org/10.1257/aer.20210937

25.

Evans

(2009, August 27). Fewer Wyo. Students are ready for college. Wyoming Tribune-Eagle. https://www.wyomingnews.com/news/fewer-wyo-students-are-ready-for-college/article_283507a7-3661-5664-a22e-106057935372.html

26.

Freeman

Wilson

(2022). College affordability views and college enrollment (NCES 2022-057). https://nces.ed.gov/pubs2022/2022057/index.asp

27.

French

Oreopoulos

(2017). Behavioral barriers transitioning to college. Labour Economics, 47, 48–63. https://doi.org/10.1016/j.labeco.2017.05.005

28.

Gehlbach

Page

L. C.

(2018). Freezing “summer melt” in its tracks: Increasing college enrollment with AI. Brookings Institution. https://www.brookings.edu/blog/brown-center-chalkboard/2018/09/11/freezing-summer-melt-in-its-tracks-increasing-college-enrollment-with-ai/

29.

Ginder

S. A.

Kelly-Reid

J. E.

Mann

F. B.

Brock

T. W.

(2018). 2017-18 integrated postsecondary education data system (IPEDS) methodology report. Institute of Education Sciences, National Center for Education Statistics. https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2018195

30.

Goodman

Gurantz

Smith

(2020). Take two! SAT retaking and college enrollment gaps. American Economic Journal: Economic Policy, 12(2), 115–158. https://doi.org/10.1257/pol.20170503

31.

Goodman

(2016). Learning from the test: Raising selective college enrollment by providing information. Review of Economics and Statistics, 98(4), 671–684. https://doi.org/10.1162/REST_a_00600

32.

Goodman-Bacon

(2021). Difference-in-differences with variation in treatment timing. Journal of Econometrics, 225(2), 254–277. https://doi.org/10.1016/j.jeconom.2021.03.014

33.

Grodsky

Riegle-Crumb

(2010). Those who choose and those who don’t: Social background and college orientation. Annals of the American Academy of Political and Social Science, 627(1), 14–35. https://doi.org/10.1177/0002716209348732

34.

HCM Strategists. (2021). States with higher education attainment goals. https://www.luminafoundation.org/stronger-nation/report/static/States_with_Higher_Education_Attainment_Goals.pdf

35.

Holzman

Klasik

Baker

(2020). Gaps in the college application gauntlet. Research in Higher Education, 61(7), 795–822. https://doi.org/10.1007/s11162-019-09566-8

36.

Hoxby

C. M.

Avery

(2013). The missing “one-offs”: The hidden supply of high-achieving, low-income students. Brookings Institution. https://www.brookings.edu/articles/the-missing-one-offs-the-hidden-supply-of-high-achieving-low-income-students/

37.

Hoxby

C. M.

Turner

(2015). What high-achieving low-income students know about college. American Economic Review, 105(5), 514–517. https://doi.org/10.1257/aer.p20151027

38.

Hurwitz

Smith

Niu

Howell

(2015). The Maine question: How is 4-year college enrollment affected by mandatory college entrance exams? Educational Evaluation and Policy Analysis, 37(1), 138–159. https://doi.org/10.3102/0162373714521866

39.

Hyman

(2017). ACT for all: The effect of mandatory college entrance exams on postsecondary attainment and choice. Education Finance and Policy, 12(3), 281–311. https://doi.org/10.1162/EDFP_a_00206

40.

Karabel

(2005). The chosen: The hidden history of admission and exclusion at Harvard, Yale, and Princeton. Houghton Mifflin Company.

41.

Klasik

(2012). The college application gauntlet: A systematic analysis of the steps to four-year college enrollment. Research in Higher Education, 53(5), 506–549. https://doi.org/10.1007/s11162-011-9242-3

42.

Klasik

(2013). The ACT of enrollment: The college enrollment effects of state-required college entrance exam testing. Educational Researcher, 42(3), 151–160. https://doi.org/10.3102/0013189X12474065

43.

Klein

(2018, October 15). How does science testing work under ESSA? Education Week. https://www.edweek.org/education/how-does-science-testing-work-under-essa/2018/10

44.

Lareau

(2015). Cultural knowledge and social inequality. American Sociological Review, 80(1), 1–27. https://doi.org/10.1177/0003122414565814

45.

Lauff

Ingels

S. J.

(2014). Education longitudinal study of 2002: A first look at 2002 high school sophomores 10 years later (NCES). National Center for Education Statistics. https://nces.ed.gov/pubs2014/2014363.pdf

46.

Lavecchia

A. M.

Liu

Oreopoulos

(2016). Behavioral economics of education: Progress and possibilities. In Hanushek

E. A.

Machin

Woessmann

(Eds.), Handbook of the economics of education (Vol. 5, pp. 1–74). Elsevier B.V.

47.

Mullen

A. L.

(2010). Degrees of inequality: Culture, class, and gender in American higher education. The Johns Hopkins University Press.

48.

Odle

T. K.

Delaney

J. A.

(2022). You are admitted! Early evidence on enrollment from Idaho’s direct admissions system. Research in Higher Education, 63(6), 899–932. https://doi.org/10.1007/s11162-022-09675-x

49.

Oreopoulos

Ford

(2019). Keeping college options open: A field experiment to help all high school seniors through the college application process. Journal of Policy Analysis and Management, 38(2), 426–454. https://doi.org/10.1002/pam.22115

50.

Park

J. J.

Kim

B. H.

Wong

Zheng

Breen

Baker

D. J.

Rosinger

K. O.

Ngyuyen

M. H.

Poon

(2023). Inequality beyond standardized tests: Trends in extracurricular activity reporting in college applications across race and class. EdWorkingPapers. https://edworkingpapers.com/ai23-749

51.

Smith

C. M.

Hirschl

(2022). Mixed signals? Economically (dis)advantaged students’ college attendance under mandatory college and career readiness assessments. Educational Researcher, 52(3), 131–143. https://doi.org/10.3102/0013189X221137899

52.

Syverson

S. T.

Franks

V. W.

Hiss

W. C.

(2018). Defining access: How test-optional works. National Association for College Admission Counseling. https://www.nacacnet.org/defining-access-how-test-optional-works/

53.

Urban Institute. (n.d.). Education data portal (v0.17.0). https://educationdata.urban.org

54.

Woods

J. R.

(2019). State information request: High school assessments. Education Commission of the States. https://www.ecs.org/high-school-assessments/

55.

Zinth

J. D.

Rowland Woods

(2018). State information request: Use of ACT, SAT, and PSAT for high school testing, as required by ESSA. Education Commission of the States. https://www.ecs.org/state-information-request-use-of-act-sat-and-psat-for-high-school-testing-as-required-by-essa/

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.64 MB