Using program evaluation to inform and improve the education of young English language learners in US schools

Abstract

The purpose of this paper is to discuss how program evaluation can be conducted and communicated in ways that meaningfully affect the education of English language learners (ELLs) in US schools. First, the paper describes the Waterford Early Reading Program Evaluation, a large-scale evaluation of a reading intervention implemented in schools with substantial populations of ELLs in a large urban school district in California. Second, using the Waterford evaluation as an example, this paper discusses the conditions necessary for conducting an evaluation that yields useful information about a program's implementation and effectiveness. The paper also highlights the importance of communicating those findings in a clear way so as to be meaningful to stakeholders and decision-makers in order to facilitate the goal of improving the education of young ELLs.

Get full access to this article

View all access options for this article.

References

Hansen, E.E. , Llosa, L. , & Slayton, J. (2004). Evaluation of the Waterford Early Reading Program as a supplementary program in the Los Angeles Unified School District 2002-2003. Planning, Assessment and Research Division Publication No. 177. Program Evaluation and Research Branch, Los Angeles Unified School District.

Hasselbring, T.S. , & Tulbert, B. (1991). Improving education through technology: Barriers and recommendations. Preventing School Failure, 35(3), 33-37.

Kiely, R. , & Rea-Dickins, P. (2005). Program evaluation in language education. Hampshire and New York : Palgrave Macmillan.

Kinzer, C. , & Leu, D.J. (1997). Focus on research - The challenge of change: Exploring literacy and learning in electronic environments. Language Arts, 74(2), 126-136.

Los Angeles Unified School District (2005- 2006). R30 Language Census Report 2005-2006. Planning, Assessment and Research Publication No. 313. Retrieved on May 18, 2007 from http://search.lausd.k12.ca.us/cgi-bin/fccgi.exe

Maxwell, J.A. (2004). Causal explanation, qualitative research, and scientific inquiry in education. Educational Researcher, 33(2), 3-11.

Merriam, S. (1998). Qualitative research and case study applications in education. Revised and expanded from Case study research in education. San Francisco, CA: Jossey-Bass.

Newton, X.A. , & Llosa, L. (2008, April). Towards a more accurate and nuanced approach to program effectiveness assessment: Hierarchical linear models (HLM) in K-12 program evaluation. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Norris, J.M. (2006). The why (and how) of assessing student learning outcomes in college foreign language programs. Modern Language Journal, 90(4), 576-583.

10.

North Central Regional Educational Laboratory ( 1999). Critical Issue: Using Technology to Improve Student Achievement . Retrieved on May 18, 2007 from http://www.ncrel.org/sdrs/areas/issues/methods/technlgy/te800.htm

11.

Oppenheimer, T. (2007). Selling Software: How vendors manipulate research and cheat students. Education Next (2), pp. 22-29. Retrieved on May 24, 2007 from http://www.hoover.org/publications/ednext/6017486.html

12.

Raudenbush, S.W. , & Bryk, A.S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd edn). Thousand Oaks, CA: SAGE Publications.

13.

Slayton, J. , & Llosa, L. (2005). The use of qualitative methods in large-scale evaluation: Improving the quality of the evaluation and the meaningfulness of the findings. Teachers College Record, 107(12), 2543-2565.

14.

Slayton, J. , & Llosa, L. (2002). Evaluation of the Waterford Early Reading Program 2001-2002: Implementation and student achievement. Planning, Assessment and Research Division Publication No. 144. Program Evaluation and Research Branch , Los Angeles Unified School District .

15.

Van den Branden, K. (2006). Training teachers: Task-based as well? In K. Van den Branden (Ed.), Task-based language education: From theory to practice (pp. 217-248). Cambridge: Cambridge University Press

16.

Woodcock, R.W. (1987). Woodcock Reading Mastery Tests - Revised. Circle Pines, MN: American Guidance Service.