Educational Evaluation and Policy Analysis

The impact of high school graduation exams on student achievement and dropout rates is examined. Using data from the National Educational Longitudinal Survey (NELS), this analysis is able to control for prior student achievement and a variety of other student, school, and state characteristics. It was found that graduation tests have no significant impact on 12th-grade math or reading achievement. These results are robust with a variety of specification checks. Although graduation tests have no appreciable effect on the probability of dropping out for the average student, they increase the probability of dropping out among the lowest ability students. These results suggest that policymakers would be well advised to rethink current graduation test policies.

Despite more than 600,000 teacher aides in American schools today, research provides little information about their classroom activities, their qualifications for carrying out their duties, or their impact on student achievement and behavior. This investigation asked whether the presence of a teacher aide in the classroom has any noticeable impact on pupils’ learning. Three primary questions were addressed: (1) In Grades K through 3, does the presence of a full-time teacher aide in the classroom affect students’ academic achievement? (2) If teacher aides have a positive effect on students’ performance, does the effect depend on the number of years the student attends classes with a teacher aide? (3) Do some functions of aides (i.e., clerical tasks, instructional tasks, noninstructional tasks) have a greater impact on student achievement than others? This investigation showed that the teacher aide movement in the United States has created a state of affairs that requires many aides to perform tasks for which they are ill-prepared. In addition, teacher aide data were analyzed from Tennessee’s Project STAR, a longitudinal experiment in which students were assigned at random to small classes, regular-size classes without an aide, or regular-size classes with a full-time teacher aide. The analyses reported here extend previous investigations, examining the functions and effects of teacher aides in depth. The results showed that teacher aides have little, if any, positive effect on students’ academic achievement. The only positive effect was an improvement in reading scores for students who attended a class with a teacher aide for 2 or 3 years. These results were the only exceptions to a plethora of negative findings. The study also showed that the types of duties aides performed had no bearing on student achievement. Because teacher aides are called upon increasingly to provide instruction to pupils, policies and research must help us select and prepare aides to perform effectively.

Recent research on the relationship between instructional policy and classroom practice suggests that teachers interpret, adapt, and even transform policies as they put them into place. This paper extends this line of research, using an in-depth case study of one California elementary school to examine the processes by which teachers construct and reconstruct multiple policy messages about reading instruction in the context of their professional communities. Drawing primarily on institutional and sensemaking theory, this paper puts forth a model of collective sensemaking that focuses on the ways teachers co-construct understandings of policy messages, make decisions about which messages to pursue in their classrooms, and negotiate the technical and practical details of implementation in conversations with their colleagues. It also argues that the nature and structure of formal networks and informal alliances among teachers shape the process, with implications for ways in which messages from the policy environment influence classroom practice. Finally, the paper explores the role school leaders play in shaping the sensemaking process.

Are there socioeconomic differences in the seasonality of children’s learning over the school year and summer months? The achievement gap across social lines increases during the primary grades, as much research indicates, but descriptive analyses and HLM within-person growth models for a representative panel of Baltimore school children demonstrate that the increase can be traced mainly to the out-of-school environment (i.e., influences situated in home and community). School-year verbal and quantitative achievement gains are comparable for upper socioeconomic status (SES) and lower SES children, but summer gains, when children are out of school, evidence large disparities. During the summer, upper SES children’s skills continue to advance (albeit at a slower rate than during the school year), but lower SES children’s gains, on average, are flat. This seasonal pattern of achievement gains implies that schooling plays an important compensatory role, one that is obscured when achievement is compared on an annual basis, as is typical. Policy implications of the seasonality of learning are discussed, including support for preventive measures over the preschool years and for programs, possibly including calendar reforms and summer school, to support disadvantaged children’s learning year-round.