Disaggregating the Effects of STEM Education and Apprenticeships on Economic Mobility: Evidence From the LaunchCode Program

Abstract

We conduct an impact analysis on a unique technology certificate and apprenticeship program offered by LaunchCode. We merge administrative data containing entrance exam scores with survey data for individuals that were (a) not accepted, (b) accepted but did not complete the course, (c) completed the course but not the apprenticeship, and (d) completed the course and the apprenticeship. By using entrance exam scores as an instrumental variable, we conduct an intent-to-treat model, finding that program acceptance was significantly associated with increased earnings and probabilities of working in a science, technology, engineering, and math (STEM) profession. Then, by using machine learning-generated multinomial propensity score weights, we conduct a treatment-on-treated analysis, finding that these increases appear to be primarily driven by the apprenticeship component.

Keywords

certificate programs apprenticeships coding bootcamps sectoral training programs STEM

Get full access to this article

View all access options for this article.

References

Angrist

J. D.

Pischke

J.-S.

(2009). Mostly harmless econometrics: An empiricist’s companion. Princeton University Press.

Aramburu

Goicoechea

Mobarak

A. M.

(2021). Coding bootcamps for female digital employment. https://doi.org/10.1596/1813-9450-9721

Bettinger

Soliz

(2016). Returns to vocational credentials: Evidence from Ohio’s community and technical colleges. A CAPSEE Working Paper. Center for Analysis of Postsecondary Education and Employment.

Board of Governors of the Federal Reserve System. (2018). Report on the economic well-being of U.S. households in 2017. https://www.federalreserve.gov/publications/files/2017-report-economic-well-being-us-households-201805.pdf

Card

(1999). The causal effect of education on earnings. Handbook of Labor Economics, 3, 1801–1863.

Chetty

Grusky

Hell

Hendren

Manduca

Narang

(2017). The fading American dream: Trends in absolute income mobility since 1940. Science, 356(6336), 398–406.

Code.org. (2022). Promote computer science. https://code.org/promote

Credential Engine. (2021). Counting US postsecondary and secondary credentials.

Duke-Benfield

A. E.

Wilson

Kaleba

Leventoff

(2019). Expanding opportunities: Defining quality non-degree credentials for states. National Skills Coalition.

10.

Eggelston

(2018). 2018 coding bootcamp market size study. Course Report. https://www.coursereport.com/reports/2018-coding-bootcamp-market-size-research

11.

Eggelston

(2020). Racial diversity in coding bootcamps: 7 takeaways. Course Report. https://www.coursereport.com/blog/racial-diversity-in-coding-bootcamps-7-takeaways

12.

Eggelston

(2022). Are coding bootcamps worth it? Course Report. https://www.coursereport.com/blog/are-coding-bootcamps-worth-it-2022

13.

ECMC Group. (2022). Question the quo: Gen Z teens want shorter, more affordable, career-connected education pathways. https://www.questionthequo.org/media/3954/qtq-survey-5-digital-report.pdf

14.

Exec. Order No. 13801, 82 Fed. Reg. 28229 (June, 20, 2017).

15.

Federal Reserve Bank of New York. (2021). The labor market for recent college graduates. https://www.newyorkfed.org/research/college-labor-market/index.html#/overview

16.

FINRA Investor Education Foundation. (2018). 2018 National Financial Capability Study. https://www.usfinancialcapability.org/downloads/2018ResponseStats.pdf

17.

Gurchiek

(2020, November 30). Biden seeks to str-engthen registered apprenticeship program, moder-nize workforce training. Society for Human Resou-rce Management. https://www.shrm.org/resourcesa-ndtools/hr-topics/organizational-and-employee-development/pages/biden-seeks-to-strengthen-registered-apprenticeship-program-modernize-workforce-training.aspx

18.

HackerRank. (n.d.). Technical skills testing. https://info.hackerrank.com/rs/487-WAY-049/images/HackerRank_Technical-Skills-Testing.pdf

19.

Jabbari

Despard

Kondratjeva

Gupta

Grinstein-Weiss

(2023). Nothing to show for it: Financial distress and re-enrollment aspirations for those with non-degreed debt. Research in Higher Education, 64(1), 1–32.

20.

Jabbari

Huang

Johnson

Jr. (2023). Broadening participation in STEM through alternative preparation programs: An exploration of race, gender, and admissions policies in a coding and apprenticeship program. Journal of Women and Minorities in Science and Engineering, 29, 1–47.

21.

Jabbari

Zheng

Roll

Auguste

Heller

(2023). How did reskilling during the COVID-19 pandemic relate to entrepreneurship and optimism? Barriers, opportunities, and implications for equity. Journal of Family and Economic Issues. Advance online publication. https://doi.org/10.1007/s10834-023-09906-y

22.

Jepsen

Troske

Coomes

(2014). The labor-market returns to community college degrees, diplomas, and certificates. Journal of Labor Economics, 32(1), 95–121.

23.

Kuehn

Jones

D. A.

(2018). Sub-baccalaureate STEM education and apprenticeship. Urban Institute.

24.

LaunchCode. (2022). 2021 impact report. https://www.launchcode.org/impact

25.

Lyon

L. A.

Green

(2020). Women in coding boot camps: An alternative pathway to computing jobs. Computer Science Education, 30(1), 102–123.

26.

Maguire

Freely

Clymer

Conway

Schwartz

(2010). Tuning in to local labor markets: Findings from the sectoral employment impact study. Public/Private Ventures.

27.

McCaffrey

D. F.

Griffin

B. A.

Almirall

Slaughter

M. E.

Ramchand

Burgette

L. F.

(2013). A tutorial on propensity score estimation for multiple treatments using generalized boosted models. Statistics in Medicine, 32(19), 3388–3414.

28.

Moore

J. C.

Stinson

L. L.

Welniak

E. J.

(2000). Income measurement error in surveys: A review. Journal of Official Statistics-Stockholm, 16(4), 331–362.

29.

National Center for Education Statistics. (2021). The condition of education 2021 (NCES 2021-144). https://nces.ed.gov/pubs2021/2021144.pdf

30.

National Student Clearinghouse Research Center. (2015). High school benchmarks. https://nscresearchcenter.org/hsbenchmarks2015/

31.

Pantic

Clarke-Midura

(2019). Factors that influence retention of women in the computer science major: A systematic literature review. Journal of Women and Minorities in Science and Engineering, 25(2), 119–145.

32.

Pew Research Center. (2018). Diversity in the STEM workforce varies widely across jobs. https://www.pewresearch.org/social-trends/2018/01/09/diversity-in-the-stem-workforce-varies-widely-across-jobs/

33.

Ridgeway

McCaffrey

Morral

Burgette

Griffin

B. A.

(2013). Toolkit for weighting and analysis of nonequivalent groups: A tutorial for the R twang package. R Vignette. RAND. https://www.rand.org/pubs/tools/TLA570-5.html

34.

Schaberg

(2017). Can sector strategies promote longer-term effects? Three-Year impacts from the workadvance demonstration. MDRC.

35.

Seibel

Veilleux

(2019). Factors influencing women entering the software development field through coding bootcamps vs. computer science bachelor’s degrees. Journal of Computing Sciences in Colleges, 34(6), 84–96.

36.

Smith

Taylor-Smith

Fabian

Zarb

Paterson

Barr

Berg

(2021). A multi-institutional exploration of the social mobility potential of degree apprenticeships. Journal of Education and Work, 34(4), 488–503.

37.

StataCorp. (2019). Stata statistical software: Release 16.

38.

U.S. Bureau of Labor Statistics. (2020). Employment in STEM occupations. Employment projections. https://www.bls.gov/emp/tables/stem-employment.htm

39.

U.S. Department of Labor. (n.d.) Industry-Recognized Apprenticeship Program (IRAP) general fact sheet. https://www.apprenticeship.gov/sites/default/files/IRAP_General_Fact_Sheet.pdf

40.

U.S. Department of Labor. (2021). Registered apprenticeship national results fiscal year 2021. https://www.dol.gov/agencies/eta/apprenticeship/about/statistics/2021

41.

Waguespack

Babb

J. S.

Yates

(2018). Triangulating coding bootcamps in IS education: Bootleg education or disruptive innovation? Information Systems Education Journal, 16(6), 48–58.

42.

Wiggberg

Gobena

Kaulio

Glassey

Bälter

Hussain

Guanciale

Haller

(2022). Effective Reskilling of Foreign-Born People at Universities-The Software Development Academy. IEEE Access, 10, 24556–24565.

43.

Wooldridge

J. M.

(2010). Econometric analysis of cross section and panel data. MIT press.

44.

World Bank. (2017). Coding bootcamps: Building future-proof skills through rapid skills training.

45.

Trimble

(2016). What about certificates? Evidence on the labor market returns to nondegree community college awards in two states. Educational Evaluation and Policy Analysis, 38(2), 272–292.