Evaluation Review

In contrast to the prevailing image of monitoring systems as technical systems, it is proposed that they should rather be conceived of as social endeavors at exchanging information. Drawing on the monitoring and evaluation framework of Cornford, Doukidis, and Forster, the concept of information agreement is suggested as a way of assessing the quality of monitoring systems in context. Preliminary implications are discussed with regard to the quality of information, the information agreement being conceptualized as a tacit, and/or explicit agreement between and among participating government partners about the quality of information.

This study examines prevention practices and perceptions in U.S. schools since passage of federal No Child Left Behind (NCLB) legislation, using survey data from state education agencies (SEA) and a population-based sample of school districts. Only one third of U.S. public school districts rely on evidence-based prevention curriculum in middle schools. Funding from other sources and large size were positively associated with using evidence-based curricula. States and districts differed on their perceptions of high-priority activities, and neither supported the federal priority on student drug testing. The findings suggest that there is a disconnect between what NCLB says and what is funded.

Web-based surveys have become more prevalent in areas such as evaluation, research, and marketing research to name a few. The proliferation of these online surveys raises the question, how do response rates compare with traditional surveys and at what cost? This research explored response rates and costs for Web-based surveys, paper surveys, and mixed-mode surveys. The participants included evaluators from the American Evaluation Association (AEA). Results included that mixed-mode, while more expensive, had higher response rates.

The consent process is an integral piece of research and evaluation studies, especially when conducted within a school setting. The challenge of reaching parents of students to obtain consent is an issue with which those conducting school-based studies grapple. The literature suggests that the success of the consent process can affect the representativeness of the sample. This study describes one consent approach and examines the demographic differences between the eligible population, the consenters and the refusers. Demographic differences were found between consenters and refusers and suggestions are offered for further research and for other researchers who conduct school-based projects.

This article reports results from a feasibility study of a community effort to reduce the availability of legal products that youth can use to get high. The study evaluated the potential of youth purchase attempts to detect actual changes in retail availability of harmful legal products. These results were triangulated with self-reports from retailers about their own policies and practices. Before the intervention, less than half of retailers reported using any of six possible strategies identified as ways to reduce youth access to harmful products, and less than 8% of baseline youth attempts to purchase potentially harmful legal products were refused or questioned. After the low-dosage intervention, retailers reported increased use of three strategies and a statistically significant increase in the percentage of purchase attempts that were either questioned or refused by retail clerks. These findings (a) demonstrate the potential feasibility of retailer-focused environmental strategies and (b) support continued use of youth purchase attempts as a measure of actual retailer behavior.