Do Student-Level Incentives Increase Student Achievement? A Review of the Effect of Monetary Incentives on Test Performance

Angrist J. Lang D. , & Oreopoulos P. (2009). Incentives and services for college achievement: Evidence from a randomized trial. American Economic Journal: Applied Economics, 1, 136—163.

Angrist J. D. , & Lavy V. (2009). The effects of high stakes school achievement awards: Evidence from a randomized trial. American Economic Review, 99, 301—331.*

Ash K. (2008, February 13). Promises of money meant to heighten student motivation. Education Week. Retrieved from http://www.edweek.org

Barrera-Osorio F. , & Filmer D. (2016). Incentivizing schooling for learning: Evidence on the impact of alternative targeting approaches. Journal of Human Resources, 51 2, 461—499.*

Barrow L. , & Rouse C. E. (2016). Financial incentives and educational investment: The impact of performance-based scholarships on student time use. Education Finance and Policy. 13 4, 419—448.

Behrman J. R. Parker S. W. Todd P. E. , & Wolpin K. I. (2015). Aligning learning incentives of students and teachers: Results from a social experiment in Mexican high schools. Journal of Political Economy, 123 2, 325—364.*

Bembenutty H. (2008). Academic delay of gratification and expectancy value. Personality and Individual Differences, 44, 193—202.

Berry J. W. (2015). Child control in education decisions. Journal of Human Resources, 50(4), 1051—1080.

Berry J. Kim H. B. , & Son H. (2017). When student incentives don't work: Evidence from a field experiment in Malawi. Newark, DE: University of Delaware.

Bettinger E. P. (2012). Paying to learn: The effect of financial incentives on elementary school test scores. The Review of Economics and Statistics, 94, 686—698.*

Blimpo M. P. (2014). Team incentives for education in developing countries: A randomized field experiment in Benin. American Economic Journal: Applied Economics, 6, 90—109.*

Borenstein M. Hedges L. V. Higgins J. P. T. , & Rothstein H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.

Burgess S. Metcalfe R. , & Sadoff S. (2016). Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments. Bristol, UK: University of Bristol.

Cole J. S. , & Osterlind S. J. (2008). Investigating differences between low- and high-stakes test performance on a general education exam. The Journal of General Education, 57 2, 119—130.

Cooper H. Robinson J. C. , & Patall E. A. (2006). Does homework improve academic achievement? A synthesis of research, 1987–2003. Review of Educational Research, 76, 1—62.

Deci E. L. Koestner R. , & Ryan R. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627—668.

Deci E. L. Koestner R. , & Ryan R. M. (2001). Extrinsic rewards and intrinsic motivation in education: Reconsidered once again. Review of Educational Research, 71, 1—27.

Duflo E. Hanna R. , & Ryan S. P. (2012). Incentives work: Getting teachers to come to school. American Economic Review, 102, 1241—1278.

Duval S. J. , & Tweedie R. L. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56 2, 455—463.

Eccles J. S. (2007). Families, schools, and developing achievement-related motivations and engagement. In Grusec J. E. , & Hastings P. D. (Eds.), Handbook of socialization (pp. 665—691). New York: The Guilford Press.

Eccles J. S. Adler T. F. Futterman R. Goff S. B. Kaczala C. M. Meece J. L. , & Midgley C. (1983). Expectancies, values, and academic behaviors. In Spence J. T. (Ed.), Achievement and achievement motivation (pp. 75—146). San Francisco, CA: W. H. Freeman.

Eccles J. S. , & Wigfield A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53, 109—132.

Fang M. , & Gerhart B. (2012). Does pay for performance diminish intrinsic interest? The International Journal of Human Resource Management, 26 6, 1176—1196.

Frey B. S. , & Goette L. (1999). Does pay motivate volunteers? Zürich, CH: Institute for Empirical Research in Economics, Universität Zürich.

Fryer R. G. (2011). Financial incentives and student achievement: Evidence from randomized trials. The Quarterly Journal of Economics, 126, 1755—1798.*

Fryer R. G. Devi T. , & Holden R. T. (2016). Vertical versus horizontal incentives in education: Evidence from randomized trials. Cambridge, MA: Harvard University.

Gallini S. (2017). Incentives, peer pressure, and behavior persistence. Cambridge, MA: Harvard Business School.

Gneezy U. List A. Livingston J. Sadoff S. Qin X. , & Xu Y. (2017). Measuring success in education: The role of effort on the test itself. National Bureau of Economic Research Working Paper No. w24004. Cambridge, MA: NBER.

Gneezy U. Meier S. , & Rey-Biel P. (2011). When and why incentives (don't) work to modify behavior. The Journal of Economic Perspectives, 25 4, 191—209.

Grek S. (2009). Governing by numbers: the Pisa effect in Europe. Journal of Education Policy, 24, 23—37.

Hedges L. V. Tipton E. , & Johnson M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39—65.

Higgins J. P. T. Thompson S. G. Deeks J. J. , & Altman D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327 7414, 557—560.

Hirshleifer S. R. (2017). Incentives for effort or outputs? A field experiment to improve student performance. Riverside, CA: University of California, Riverside.

IntHout J. Ioannidis J. P. A. Borm G. F. , & Goeman J. J. (2015). Small studies are more heterogeneous than large ones. Journal of Clinical Epidemiology, 68, 860—869.

Jackson C. K. (2010). A little now for a lot later. A look at a Texas Advanced Placement incentive program. The Journal of Human Resources, 45, 591—639.*

Jackson C. K. (2014). Do college-preparatory programs improve long-term outcomes? Economic Inquiry, 52, 72—99.*

Jepsen C. , & Rivkin S. (2002). Class size reduction, teacher quality, and academic achievement in California elementary public schools. San Francisco: Public Policy Institute of California.

Johnston M. , & Sniehotta F. (2010). Financial incentives to change patient behavior. Journal of Health Services Research Policy, 15 3, 131—132.

Kim R. S. (2011). Standardized regression coefficients as indices of effect sizes in meta-analysis. (Unpublished doctoral dissertation). Florida State University, Tallahassee, FL.

Kohn A. (1993). Why incentive plans cannot work. Harvard Business Review, 71, 54—63.

Kraemer H. C. Gardner C. Brooks J. O. , & Yesavage J. A. (1998). Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints. Psychological Methods, 3, 23—31.

Kremer M. Miguel E. , & Thornton R. (2009). Incentives to learn. The Review of Economics and Statistics, 91, 437—456.*

Lepper M. Greene D. , & Nisbett R. (1973). Undermining children's intrinsic interest with extrinsic reward: A test of the “overjustification” hypothesis. Journal of Personality and Social Psychology, 28, 129—137.

Leuven E. Oosterbeek H. , & van der Klaauw B. (2010). The effect of financial rewards on students’ achievement: Evidence from a randomized experiment. Journal of the European Economic Association, 8, 1243—1265.

Levitt S. D. List J. A. Neckermann S. , & Sadoff S. (2016). The behavioralist goes to school: Leveraging behavioral economics to improve educational performance. American Economic Journal: Economic Policy, 8 4, 183—219.*

Levitt S. D. List J. A. , & Sadoff S. (2016). The effect of performance-based incentives on educational achievement: evidence from a randomized experiment. National Bureau of Economic Research Working Paper No. w22107. Cambridge, MA: NBER.*

Li T. Han L. Rozelle S. , & Zhang L. (2014). Encouraging classroom peer interactions: Evidence from Chinese migrant schools. Journal of Public Economics, 111, 29—45.*

List J. A. Livingston J. A. , & Neckermann S. (2012). Harnessing complementarities in the education production function. Chicago, IL: University of Chicago.

McEwan P. J. (2015). Improving learning in primary schools of developing countries: A meta-analysis of randomized experiments. Review of Educational Research, 85 3.

Miller C. Riccio J. Verma N. Nunez S. Dechausay N. , & Yang E. (2015). Testing a conditional cash transfer program in the U.S.: The effects of the Family Rewards program in New York City. Journal of Labor Policy, 4, 1—29.*

National Research Council (2011). Incentives and test-based accountability in education. Washington, DC: Author.

Nieminen P. Lehtiniemi H. Vähäkangas K. Huusko A. , & Rautio A. (2013). Standardised regression coefficient as an effect size index in summarizing findings in epidemiological studies. Epidemiology Biostatistics and Public Health, 10, 1—15.

O'Neil H.F. Abedi J. Miyoshi J. , & Mastergeorge A. (2005). Monetary incentives for low-stakes tests. Educational Assessment, 10, 185—208.

Prothero A. (2017, October 17). Does paying kids to do well in school actually work? Education Week. Retrieved from http://www.edweek.org.

Raymond M. (2008). Paying for A's: An early exploration of student reward and incentive programs in charter schools. Stanford, CA: CREDO.

Ringquist E. J. (2013). Meta-analysis for public management and policy. San Francisco, CA: Jossey-Bass.

Rosenthal R. (1979). The “file-drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638—641.

Rouse C. (1998). Private school vouchers and student achievement: An evaluation of the Milwaukee Parental Choice Program. Quarterly Journal of Economics, 113, 553—602.

Ryan R. M. , & Deci E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 68—78.

Sadoff S. (2014). The role of experimentation in education policy. Oxford Review of Economic Policy, 30, 597—620.

Scammacca N. Roberts G. , & Stuebing K. K (2014). Meta-analysis with complex research designs: Dealing with dependence from multiple measures and multiple group comparisons. Review of Educational Research, 84 3, 328—364.

Scheie E. (2014, August 20). Cities experiment with paying poor students for good grades. World Journalism Institute. Retrieved from https://world.wng.org.

Sharma D. (2010). The impact of financial incentives on academic achievement and household behavior: Evidence from a randomized trial. Columbus, OH: The Ohio State University.

Slavin R. E. (2010). Can financial incentives enhance educational outcomes? Evidence from international experiments. Educational Research Review, 5, 68—80.

Stanley T. D. Jarrell S. B. , & Doucouliagos H. (2010). Could it be better to discard 90% of the data? A statistical paradox. The American Statistician, 64, 70—77.

Stolovitch H. D. Clark R. E. , & Condly S. J. (2002). Incentives, motivation, and workplace performance: Research and best practices. McLean, VA: International Society for Performance Improvement and The Incentive Research Foundation.

Tanner-Smith E. E. , & Tipton E. (2014). Robust variance estimation with dependent effect sizes: Practical considerations including a software tutorial in Stata and SPSS. Research Synthesis Methods, 5 1, 13—30.

Tipton E. (2015). Small sample adjustments for robust variance estimation with meta-regression. Psychological Methods, 20 3, 375—393.

Tipton E. , & Pustejovsky J. (2015). Small-sample adjustments for tests of moderators and model fit using robust variance estimation in meta-regression. Journal of Educational and Behavioral Statistics, 40 6, 604—634.

Turner R. M. Bird S. M. , & Higgins J. P. T. (2013). The impact of study size on meta-analyses: Examination of underpowered studies in Cochrane Reviews. PLoS ONE, 8(3), e59202.

Valentine J. C. Pigott T. D. , & Rothstein H. R. (2010). How many studies do you need? A primer on statistical power for meta-analysis. Journal of Educational and Behavioral Statistics, 35 2, 215—247.

Visaria S. Dehejia R. Chao M. M. , & Mukhopadhyay A. (2016). Unintended consequences of rewards for student attendance: Results from a field experiment in Indian classrooms. Economics of Education Review, 54, 173—184.

von Hippel P. T. (2015). The heterogeneity statistic I2 can be biased in small meta-analyses. BMC Medical Research Methodology, 15 35, 1—8.

Wallace B. D. (2009). Do economic rewards work? District Administration, 45, 24—27.

White R. (2012). The effectiveness of an incentivized program to increase daily fruit and vegetable dietary intake by low-income, middle-aged women. Unpublished thesis. Mankato, MN: Minnesota State University, Mankato.

Wigfield A. , & Cambria J. (2000). Expectancy-value theory: Retrospective and prospective. In Urdan T. , & Karabenck S. A. (Eds.), The decade ahead: Theoretical perspectives on motivation and achievement advances in motivation and achievement (pp. 35—70). Bingley, UK: Emerald Group Publishing Limited.

Willingham D. T. (2008). Should learning be its own reward? American Educator, 31, 29—35.

Wilson S. J. Tanner-Smith E. E. Lipsey M. W. Steinka-Fry K. , & Morrison J. (2011). Dropout prevention and intervention programs: Effects on school completion and dropout among school-aged children and youth. Campbell Systematic Reviews, 8.

Yeh S. (2010). The cost effectiveness of 22 approaches for raising student achievement. Journal of Education Finance, 36 1, 38—75.

Zamarro G. Hitt C. , & Mendez I. (2016). Reexamining international differences in achievement and non-cognitive skills: When students don't care. Little Rock, AR: University of Arkansas.