A methodology for a process evaluation system as applied to the Pawtucket Heart Health
Program is described. The rationale, goals, and design of this system, which are suited to the
documentation of community demonstration programs or other interventions, are discussed.
Examples of data from the system are provided, including those from linked, computer-based
files for the systematic tracking of program activities and the characteristics of program
participants. Also discussed are approaches to maintaining such a system in a context of limited
resources.
Get full access to this article
View all access options for this article.
References
1.
Abrams, D.B., J.P. Elder, R.A. Carleton, T.M. Lasater, and L. Artz (1986) "Social learning principles for organizational health promotion: an integrated approach," pp. 29-49 in M. Cataldo and T. Coates (eds.) Behavioral Medicine in Industry. New York: John Wiley.
2.
Adelman, H.S. (1986) "Intervention theory and evaluating efficacy." Evaluation Rev.10 (1): 65-83.
3.
Assaf, A.R., S.W. Banspach, T.M. Lasater, S.M. McKinlay, and R.A. Carleton (1987) "The Pawtucket Heart Health Program: evaluation strategies." Rhode Island Medical J.70: 541-546.
4.
Carleton, R.A., T.M. Lasater, A.R. Assaf, R.C. Lefebvre, and S.M. McKinlay (1987) "Pawtucket Heart Health Program: an experiment in population-based disease prevention." Rhode Island Medical J.70: 533-538.
5.
Elder, J.P., D.B. Abrams, P. Beaudin, R.A. Carleton, T.M. Lasater, M. Lazieh, G.S. Peterson, and R. Schwertfeger (1988) "Behavioral community psychology and the prevention of heart disease: community level applications of the Pawtucket Heart Health Program," pp. 61-86 in A. Baum and A. Herd (eds.) Perspectives in Behavioral Medicine, Vol. 3. New York: Academic Press.
6.
Elder, J.P., S.A. McGraw, D.B. Abrams, A. Ferreira, T.M. Lasater, H. Longpre, G.S. Peterson, R. Schwertfeger, and R.A. Carleton (1986) "Organizational and community approaches to community-wide prevention of heart disease: the first two years of the Pawtucket Heart Health Program." Preventive Medicine15: 107-117.
7.
Elder, J.P., S.A. McGraw, A. Rodriques, T.M. Lasater, A. Ferreira, L. Kendall, G.S. Peterson, and R.A. Carleton (1987) "Evaluation of two community-wide smoking contests ." Preventive Medicine16: 221-234.
8.
Elder, J.P., C. McKenna, M. Lazieh, A. Ferreira, T.M. Lasater, and R.A. Carleton (1986) "The use of volunteers in mass screening for high blood pressure." Amer. J. of Preventive Medicine2 (5): 268-272.
9.
Finnegan, J.R., D.M. Murray, C. Kurth, and P. McCarthy (1988) "Measuring and tracking education program implementation: The Minnesota Heart Health Program." Health Education Q.16 (1): 77-90.
10.
Flay, B.R. (1986) "Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs." Preventive Medicine15: 451-474.
11.
Flay, B.R. and T. Cook (1981) "Eval uation of mass media prevention campaigns ," pp. 239-264 in R. E. Rice and W. Paisley (eds.) Public Communication Campaigns. Beverly Hills, CA: Sage.
12.
Flora, J., L.T. Goode, and J.W. Farquhar (1987) "Process evaluation in public communications campaigns: a model from the Stanford Heart Disease Prevention Program." Stanford University. (unpublished)
13.
Freeman, H.E. (1977) "The present status of evaluation research." Evaluation Studies Rev. Annual2: 17-51.
14.
Freeman, H.E. and P.H. Rossi (1981) "Social experiments." Milbank Memorial Fund Q., Health and Society59 (3): 340-373.
15.
Hixson, M.L., R.C. Lefebvre, S.W. Banspach, A.R. Assaf, and M.K. Hunt (1988, April) "Evaluation of a grocery store point-of-purchase nutrition intervention program." Presented at the Society of Behavioral Medicine meeting, Boston.
16.
Howe, H.L. and M.B. Hoff (1981) "Sequential analysis: A tool for monitoring program delivery." Evaluation & the Health Professions4 (2): 129-143.
17.
Jacobs, D.R., Jr., R.W. Jeffery, J.L. Forster, and C.L. Perry (1988) "Methodological issues in worksite health intervention research: generalizability, evaluation framework, and unit of analysis." Presented at NHLBI conference on Methodological Issues in Worksite Research, Airlie House, Virginia, April.
18.
Judd, C.M. and D.A. Kenny (1981) "Process analysis: estimating mediation in treatment evaluations." Evaluation Rev.5 (5): 602-619.
19.
Lasater, T.M., D.B. Abrams, L. Artz, P. Beaudin, L. Cabrera, J.P. Elder, A. Ferreira, P. Knisley, G.S. Peterson, A. Rodriques, P. Rosenberg, R. Snow, and R.A. Carleton (1984) "Lay volunteer delivery of community-based cardiovascular risk factor modification programs: the Pawtucket experiment," pp. 1166-1170 in Matarazzo et al. (eds.) Behavioral Health: A Handbook of Health Enhancement and Disease Prevention. New York: John Wiley.
20.
Lasater, T.M., R.A. Carleton, and R.C. Lefebvre (1988) "The Pawtucket Heart Health Program: utilizing community resources for primary prevention." Rhode Island Medical Journal71: 63-67.
21.
Lasater, T.M., R.C. Lefebvre, and R.A. Carleton (1988) "The Pawtucket Heart Health Program: community level programming for heart health." Rhode Island Medical Journal71: 31-34.
22.
Lefebvre, R.C., E.A. Harden, and B. Zompa (1988) "The Pawtucket Heart Health Program: social marketing to promote heart health." Rhode Island Medical J.71: 27-30.
23.
Lefebvre, R.C., E.A. Harden, W. Rakowski, T.M. Lasater, and R.A. Carleton (1987) "Characteristics of participants in community health promotion programs: four-year results." Amer. J. of Public Health77: 1342-1344.
24.
Lefebvre, R.C., T.M. Lasater, R.A. Carleton, and G.S. Peterson (1987) "Theory and delivery of health programming in the community: the Pawtucket Heart Health Program." Preventive Medicine16: 80-95.
25.
Lefebvre, R.C., G.S. Peterson, S.A. McGraw, T.M. Lasater, L. Sennett, L. Kendall, and R.A. Carleton (1986) "Community intervention to lower your blood cholesterol: the 'Know Your Cholesterol' campaign." Health Education Q.13: 117-129.
26.
Leithwood, K. and D.J. Montgomery (1980) "Evaluating program implementations ." Evaluation Rev.4 (2): 193-214.
27.
Majchrzak, A. (1982) "Organizational context of program evaluation in community mental health centers." Evaluation & the Health Professions5 (3): 303-333.
28.
Makover, H.B. (1951) "The quality of medical care: methodology of survey of the medical groups associated with health insurance plan of New York." Amer. J. of Public Health41: 824-827.
29.
McKinlay, S.M., R.A. Carleton, J.L. McKenney, and A. Assaf (1989) "A new approach to surveillance for acute myocardial infarction: reproducibility and cost efficiency." Int. J. of Epidemiology18: 1-9.
30.
McKinlay, S.M., D. Kipp, P. Johnson, K. Downey, and R.A. Carleton (1984) "A field approach for obtaining physiologic measures in surveys of general populations: response rates, reliability and costs," in C. Channel (ed.) Health Survey Research Methods, Fourth Conference, Research Proceedings Series. DHHS Publication No. PHS 84-3346. Rockville, MD: National Center for Health Services Research.
31.
McKinlay, S.M., S.A. McGraw, A.R. Assaf, D.M. Kipp, and R.A. Carleton (1988) "An innovative approach to the evaluation of a large community program," pp. 89-104 in A. Baum and A. Herd (eds.) Perspectives in Behavioral Medicine, Vol. 3. New York: Academic Press.
32.
Peterson, G.S., D.B. Abrams, and J.P. Elder (1985) "Professional versus self-help weight loss at the worksite: the challenge of making a public health impact." Behavior Therapy16: 213-222.
33.
Reichardt, C.S. and T.D. Cook (1979) "Beyond qualitative versus quantitative methods ," pp. 7-33 in T. D. Cook and C. S. Reichardt (eds.) Qualitative and Quantitative Methods in Evaluation Research. Beverly Hills, CA: Sage.
34.
Rossi, P. and H. Freeman (1985) Evaluation: A Systematic Approach (3rd ed.). Beverly Hills, CA: Sage.
35.
Windsor, R.A., T. Baranowski, N. Clark, and G. Cutter (1984) Evaluation of Health Programs and Education Programs . Palo Alto, CA: Mayfield.
36.
Winkelstein, W. and M. Marmot (1981) "Primary prevention of ischemic heart disease: evaluation of community interventions." Annual Rev. of Public Health2: 253-276.
