A methodologn for evaluating program implementation is described. Requirements for
such a methodology are derived from an analysis of the functions to be performed by
implementation evaluation, the nature of the program being implemented, and character
istics of the implementation process. Central features of the methodology involve
procedures for the development of a multidimensional profile of the program as it evolves
in practice from non- to full implementation. The profile then serves as the basis for
instrument development, data collected through the instruments locate program user
behavior in relation to the dimensions and levels of use described by the profile. Uses of
resulting data to serve program management goals are outlined.
Get full access to this article
View all access options for this article.
References
1.
Alkin, M.C. (1967) Towards an Evaluation Model: A Systems Approach . Berkeley: Center for the Study of Evaluation of Instructional Programs, University of California.
2.
Ben-Peretz, M. (1975) "The concept of curriculum potential." Curriculum Theory Network5, 2: 151-159.
3.
Berman, A. and M.W. McLaughlin (1976) "Implementation of educational innovations." Educ. Forum (March): 345-370.
4.
Berman, P. and E.W. Pauley (1975) Federal Programs Supporting Educational Change, Vol. II: Factors Affecting Change Agent Projects. Santa Monica, CA: Rand.
5.
Brugelman, H. (n.d.) "Evaluation—a service to curriculum implementation." (unpublished)
6.
Charters, W.W., Jr. and J.E. Jones (1973) "On the risk of appraising non-events in program evaluation." Educ. Researcher2, 11: 57.
7.
Clark, C.M. and R.J. Yinger (1978) Research on Teacher Thinking. Institute for Research on Teacher Thinking, College of Education, Michigan State University.
8.
Evans, W.J. and J.W. Sheffler (1974) "Degree of implementation: a first approximation ." Presented at the American Education Research Association annual meeting, Chicago.
9.
Freemen, H.E. (1977) "The present status of evaluation research," pp. 17-51 in M. Guttentag (ed.) Evaluation Studies Review AnnualII. Beverly Hills, CA: Sage.
10.
Fullan, M. and A. Pomfret (1977) "Research on curriculum instruction and implementation ." Rev. of Educ. Research47, 2: 335-397.
11.
Gephart, W.J. (1976) "Problems in measuring the degree of implementation of an innovation." Presented at the American Education Research Association annual meeting, San Francisco.
12.
Goodlad, J.I. and M.F. Klein (1970) Behind the Classroom Door. Belmont, CA: Wadsworth.
13.
Greenwood, P.W., D. Marn, and M.W. McLaughlin (1975) Federal Programs Supporting Educational Change, Vol. III: The Process of Change. Santa Monica, CA: Rand.
14.
Hall, G.E., A.A. George, and W.C. Rutherford (1977) Measuring Stages of Concern About the Innovation: A Manual for Use of the SoC Questionnaire. Austin: Research and Development Center for Teacher Education, University of Texas.
15.
Hall, G.E. and S.F. Loucks (1978) "Innovation configurations: analyzing the adaptation of innovations." Presented at the American Education Research Association annual meeting, Toronto, Ontario.
16.
——— (1977) "A developmental model for determining whether the treatment is actually implemented." Amer. Educ. Research J.14,3: 268-276.
17.
Leinhardt, G. (1977) "Program evaluation: an empirical study of individualized instruction." Amer. Educ. Research J.14, 3: 277-293.
18.
——— (1975) "Observation as a tool for evaluation of implementation ." Studies in Educ. Evaluation1, 2: 77-94.
19.
Leithwood, K.A. (forthcoming) "Dimensions of curriculum innovation." J. of Curriculum Studies.
20.
——— H.H. Russell, J.S. Clipsham, and F.G. Robinson (1974) "School change: stages, constructs and research methodology." Interchange5, 4: 33-48.
21.
Leithwood, K.A., J.A. Ross, and D.J. Montgomery (1978) "An empirical investigation of teachers' curriculum in decision-making processes." Presented at the Canadian Society for Study in Education Conference, London, Ontario, June.
22.
Leithwood, K.A., R.J. Wilson, and A.R. Marshall (1978) Program Evaluation for Ontario School Systems. Research project funded under contract by the Ministry of Education, Ontario.
23.
Lewy, A. [ed.] (1977) Handbook of Curriculum Evaluation, UNESCO. New York: Longman.
24.
Loucks, S.F., B.W. Newlove, and G.E. Hall (1975) Measuring Levels of Use of the Innovation: A Manual for Trainers, Interviewers and Raters. Austin: Research and Development Center for Teacher Education, University of Texas .
25.
Marshall, A.M. and K.A. Leithwood (1978) "Evaluation and decision-making: toward more influential evaluation." Presented at the Canadian Society for Studies in Education Conference, London, Ontario, June.
26.
McKinney, L.W. and I. Westbury (1975) "Stability and change: the public schools of Indiana, 1940-1970," pp. 1-53 in W. A. Reed and D. F. Walker (eds.) Case Studies in Curriculum Change. London: Routledge & Kegan Paul.
27.
Patton, M.Q. (1978) Utilization—Focused Evaluation. Beverly Hills, CA: Sage.
28.
Provus, M. (1971) Discrepancy Evaluation for Educational Program Improvement and Assessment. Berkeley, CA: McCutchan.
29.
Rippey, R. M. [ed.] (1973) Studies in Transactional Evaluation. Berkley, CA: McCutchan.
30.
Sanders, J.R. and D.J. Cunningham (1973) "A structure for formative evaluation in product development." Rev. of Educ. Research43, 2: 217-236.
31.
Schmeidtlein, F.A. (1974) "Decision process paradigms in education." Educ. Researcher (May): 4-11.
32.
Scriven, M. (1976) "The methodology of evaluation," pp. 39-83 in R. W. Tyler et al. (eds.) Perspectives of Curriculum Evaluation . Skokie, IL: Rand McNally.
33.
Stake, R.E. (1970) "Objectives, priorities and other judgment data ." Rev. of Educ. Research40, 2181-212.
34.
Stufflebeam, D.L., W.J. Foley, W.J. Gephart, E.G. Guba, R.L. Hammond, H.O. Merriman, and M.M. Provus (1971) Educational Evaluation and Decision-Making in Education . Itasca, IL: Peacock.
35.
Weiss, J., J. Edwards, and O. Dimitri (n.d.) Formative Curriculum Evaluation. Toronto : Ontario Institute for Studies in Education.
36.
Williams, W. (1975) "Implementation analysis and assessment." Policy Analysis1: 531-566.
37.
Zahorick, J.A. (1975) "Teachers' planning models." Educ. Leadership33, 2: 134-139.
