A Partial Linear Estimator for Small Study Regression Discontinuity Designs

Abstract

Regression discontinuity (RD) designs are a popular approach to estimating a treatment effect of cutoff-based interventions. Two current estimation approaches dominate the literature. One fits separate regressions on either side of the cutoff, and the other performs finite sample inference based on a local randomization assumption. Recent developments of these approaches have often focused on asymptotic properties and large sample sizes. Educational applications often contain relatively small samples or sparsity near the cutoff, making estimation more difficult. As an alternative to the aforementioned approaches, we develop a partial linear estimator for RD designs. We show in simulations that our estimator outperforms certain leading estimators in several realistic, small-sample scenarios. We apply our estimator to school accountability scores in Indiana.

Keywords

regression discontinuity nonparametric semiparametric partial linear small sample

Get full access to this article

View all access options for this article.

References

Abdulkadiroğlu

Angrist

Pathak

(2014). The elite illusion: Achievement effects at Boston and New York exam schools. Econometrica, 82(1), 137–196. https://doi.org/10.3982/ECTA10266

Arai

Ichimura

(2018). Simultaneous selection of optimal bandwidths for the sharp regression discontinuity estimator. Quantitative Economics, 9(1): 441–482. https://doi.org/10.3982/QE590

Armstrong

T. B.

Kolesár

(2020). Simple and honest confidence intervals in nonparametric regression. Quantitative Economics, 11(1), 1–39. https://doi.org/10.3982/QE1199

Calonico

Cattaneo

M. D.

Farrell

M. H.

Titiunik

(2023). rdrobust: Robust Data-Driven Statistical Inference in Regression-Discontinuity Designs. Comprehensive R Archive Network (CRAN), R package version 2.2. https://CRAN.R-project.org/package=rdrobust

Calonico

Cattaneo

M. D.

Titiunik

(2014). Robust nonparametric confidence intervals for regression-discontinuity designs. Econometrica, 82(6), 2295–2326. https://doi.org/10.3982/ECTA11757

Cattaneo

M. D.

Frandsen

B. R.

Titiunik

(2015). Randomization inference in the regression discontinuity design: An application to party advantages in the U.S. senate. Journal of Causal Inference, 3(1), 1–24. https://doi.org/10.1515/jci-2013-0010

Cattaneo

M. D.

Titiunik

Vazquez-Bare

(2022). rdlocrand: Local Randomization Methods for RD Designs. Comprehensive R Archive Network (CRAN), R package version 1.0. https://CRAN.R-project.org/package=rdlocrand

Duong

(2022). ks: Kernel Smoothing. Comprehensive R Archive Network (CRAN), R package version 1.13.5. https://CRAN.R-project.org/package=ks

Fan

Gasser

Gijbels

Brockmann

Engel

(1997). Local polynomial regression: Optimal kernels and asymptotic minimax efficiency. Annals of the Institute of Statistical Mathematics, 49(1), 79–99. https://doi.org/10.1023/A:1003162622169

10.

Fan

Gijbels

(1996). Local polynomial modelling and its applications. Chapman and Hall.

11.

Gelman

Imbens

(2019). Why high-order polynomials should not be used in regression discontinuity designs. Journal of Business & Economic Statistics, 37(3), 447–456. https://doi.org/10.1080/07350015.2017.1366909

12.

Hahn

Todd

Van der Klaauw

(2001). Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica, 69(1), 201–209. https://doi.org/10.1111/1468-0262.00183

13.

Hinkley

D. V.

(1977). Jackknifing in unbalanced situations. Technometrics, 19(3), 285–292. https://doi.org/10.1080/00401706.1977.10489550

14.

Imbens

Kalyanaraman

(2012). Optimal bandwidth choice for the regression discontinuity estimator. The Review of Economic Studies, 79(3), 933–959. https://doi.org/10.1093/restud/rdr043

15.

Indiana Department of Education. (2017). 2017 A-F school grade reports [Data file]. Data report. https://www.in.gov/doe/files/af-2017-school-grade-placement-03192018.xlsx

16.

Indiana Department of Education. (2018). 2018 state school grade reports [Data file]. Data report. https://www.in.gov/doe/files/2018-state-school-grade-results.xlsx

17.

Indiana Department of Education. (2022). Indiana student-centered accountability. Online Documentation. https://www.in.gov/doe/it/accountability-dashboard/indiana-student-centered-accountability/

18.

Jones

M. C.

(1994). On kernel density derivative estimation. Communications in Statistics—Theory and Methods, 23(8), 2133–2139. https://doi.org/10.1080/03610929408831377

19.

Kolesár

(2021). RDHonest: Honest Inference in Regression Discontinuity Designs. Comprehensive R Archive Network (CRAN), R package version 0.3.2. https://CRAN.R-project.org/package=RDHonest

20.

Kolesár

(2024). RDHonest: Honest Inference in Regression Discontinuity Designs. Comprehensive R Archive Network (CRAN), R package version 1.0.0. https://CRAN.R-project.org/package=RDHonest

21.

Lee

D. S.

(2008). Randomized experiments from non-random selection in U.S. house elections. Journal of Econometrics, 142(2), 675–697. https://doi.org/10.1016/j.jeconom.2007.05.004

22.

Lindo

J. M.

Sanders

N. J.

Oreopoulos

(2010). Ability, gender, and performance standards: Evidence from academic probation. American Economic Journal: Applied Economics, 2(2), 95–117. https://doi.org/10.1257/app.2.2.95

23.

Marron

J. S.

(1994). Visual understanding of higher-order kernels. Journal of Computational and Graphical Statistics, 3(4), 447–458. https://doi.org/10.1080/10618600.1994.10474657

24.

Martorell

McFarlin

Jr., I

. (2011). Help or hindrance? the effects of college remediation on academic and labor market outcomes. The Review of Economics and Statistics, 93(2), 436–454. https://doi.org/10.1162/REST_a_00098

25.

Porter

(2003). Estimation in the regression discontinuity model [Unpublished manuscript, Department of Economics, University of Wisconsin at Madison]. http://www.ssc.wisc.edu/∼jrporter/reg_discont_2003.pdf

26.

R Core Team (2024). R: A language and environment for statistical computing. R Foundation for Statistical Computing.

27.

Robinson

P. M.

(1988). Root-N-consistent semiparametric regression. Econometrica, 56(4), 931–954. https://doi.org/10.2307/1912705

28.

Swartzentruber

(2025). rdple: Partial Linear Estimation for Regression Discontinuity Designs. Github Repository, R package version 1.0.0. https://github.com/DSwartzy/rdple

29.

Swartzentruber

Kaizar

(2024). Small study regression discontinuity designs: Density inclusive study size metric and performance. arXiv Preprint 2024, arXiv: 2209.01396.

30.

Thistlethwaite

D. L.

Campbell

D. T.

(1960). Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology, 51(6), 309–317. https://doi.org/10.1037/h0044319

31.

Van Der Klaauw

. (2008). Regression–discontinuity analysis: A survey of recent developments in economics. Labour, 22(2), 219–245. https://doi.org/10.1111/j.1467-9914.2008.00419.x

32.

Wand

M. P.

Jones

(1994). Multivariate plug-in bandwidth selection. Computational Statistics, 9(2), 97–116.

33.

C. F. J.

(1986). Jackknife, bootstrap and other resampling methods in regression analysis. The Annals of Statistics, 14(4), 1261–1295. https://doi.org/10.1214/aos/1176350142

34.

You

Chen

(2003). Jackknife estimation for smooth functions of the parametric component in partially linear regression models. Communications in Statistics—Theory and Methods, 32(9), 1817–1833. https://doi.org/10.1081/STA-120022711

35.

(2016). Understanding estimators of treatment effects in regression discontinuity designs. Econometric Reviews, 35(4), 586–637. https://doi.org/10.1080/07474938.2013.833831

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.82 MB