A Developmental Stage Approach To Program Planning and Evaluation

Abstract

Human service programs can be seen as proceeding through a number of stages in the course of their development. Each stage can be characterized by a major issue or question to be answered. Evaluation research, if appropriately matched to a program's stage of development, can help inform the decision making that goes on at each step and resolve the questions that need to be answered before proceeding to subsequent stages. This article presents a brief overview of what these stages are, the questions to be answered at each stage, and the kinds of research activity that can assist in answering those questions.

Get full access to this article

View all access options for this article.

References

Baker, B.N. and R.L. Eris (1964) An Introduction to PERT-CPM Homewood, IL: Richard D. Irwin.

Bardach, E. (1977) The Implementation Game Cambridge : MIT Press.

Bell, R.A. , T.D. Nguyen , G.J. Warheit , and J.M. Buhl (1978) "Service utilization, social indicator, and citizen survey approaches to human service need assessment,"in C. C. Attkisson, W. A. Hargreaves, M. J. Horowitz, and J. E. Sorensen (eds.) Evaluation of Human Service Programs. New York: Academic Press.

Bell, R.A. , M. Sundel , J.F. Aponte , S.A. Murrell , and E. Lin (1983) Assessing Health and Human Service Needs: Concept, Methods and Applications New York: Human Sciences.

Bennett, E.M. and B. Trute (1983) Mental Health Information Systems: Problems and Prospects Lewiston, NY: Edwin Mellen .

Bickman, L. (1985) "Improving established statewide programs: a component theory of evaluation." Evaluation Rev. 9: 189-208.

Bickman, L. (1987) "The functions of program theory" in L. Bickman (ed.) Using Program Theory in Evaluation. San Francisco: Jossey-Bass.

Bielawski, B. and I. Epstein (1984) "Assessing program stabilization. An extension of the 'differential evaluation' model." Administration in Social Work 8 (4): 13-23.

Bowles, R.T. (1981) Social Impact Assessment in Small Communities Toronto: Butterworths.

10.

Boyle, M.H. , D.R. Offord , H.G. Hoffman , G.P. Catlin , J.A. Byles , D.T. Cadman , J.W. Crawford , P.S. Links , N.I. Rae-Grant , and P. Szatmari (1987) "Ontario Child Health Study: I. methodology." Archives of General Psychiatry 44: 826-831.

11.

Brager, G. and S. Holloway (1978) Changing Human Service Organizations New York: Free Press.

12.

Briar, S. and B.J. Blythe (1985) "Agency support for evaluating the outcomes of social work services." Administration in Social Work 9 (2): 25-36.

13.

Caputo, R.K. (1986) "The role of information systems in evaluation research." Administration in Social Work 10 (1): 67-77.

14.

Clifton, D.S. and D.E. Fyffe (1977) Project Feasibility Analysis New York: John Wiley.

15.

Coplin, W.D. and M.K. O'Leary (1972) Everyman's PRINCE North Scituate, MA: Duxbury.

16.

Crocker, P. (1983) "An evaluation of the quality of service at a volunteer-run telephone distress centre." Master's thesis, Wilfrid Laurier University, Waterloo, Ontario.

17.

Dalkey, N.C. (1969) The Delphi Method: An Experimental Study of Group Opinion Santa Monica, CA: Rand .

18.

Edwards, W. , M. Guttentag , and K. Snapper (1975) "A decision-theoretic approach to evaluation research," in E. L. Struening and M. Guttentag (eds.) Handbook of Evaluation Research, Vol. 1. Beverly Hills, CA: Sage.

19.

FINTERBUSCH, K. and C. P. WOLF [eds.] (1977) Methodology of Social Impact Assessment. Stroudsburg, PA: Dowden, Hutchison & Ross.

20.

Frankel, M. and C. Sinclair (1982) "Quality assurance: an approach to accountability in a mental health center." Professional Psychology 13: 79-84.

21.

Fulton, M.J. (1987) "Fundamental methodologies in identifying values in the evaluation of health programs." Canadian J. of Program Evaluation 2: 17-24.

22.

Gardiner, P.C. and W. Edwards (1975) "Public values: multi-attribute-utility measurement for social decision making," in M. F. Kaplan and S. Schwartz (eds.) Human Judgment and Decision Processes. New York : Academic Press.

23.

Goodman, L.J. and R.N. Love (1980) Project Planning and Management New York: Pergamon.

24.

Gustafson, D.H. , R. Shukla , A. Delbecq , and G. Wallester (1973) "A comparative study in subjective likelihood estimates made by individuals, interacting groups, Delphi groups, and nominal groups." Organizational Behavior and Human Performance 9: 280-291.

25.

Hanbery, G.W. , J.E. Sorensen , and A.R. Kucic (1981) "Management information systems and human resource management." Administration in Social Work 5 (3-4): 27-41.

26.

Harrison, F.L. (1985) Advanced Project Management New York: John Wiley.

27.

Helmer, O. (1966) Social Technology New York: Basic Books.

28.

Holloway, S. and G. Brager (1985) "Implicit negotiations and organizational practice." Administration in Social Work 9 (2): 15-24.

29.

Hudson, J. (1977) "Problems of measurement in criminal justice," in L. Rutman (ed.) Evaluation Research Methods: A Basic Guide. Beverly Hills, CA: Sage .

30.

Jayarante, S. (1978) "Analytic procedures for single-subject designs." Social Work Research and Abstracts 14 (4): 30-40.

31.

Kahn, A.J. (1969) Theory and Practice of Social Planning New York: Russell Sage.

32.

Kahn, A.J. (1979) Social Policy and Social Services (2nd ed.). New York: Random House.

33.

Katz, D. and R.L. Kahn (1978) The Social Psychology of Organizations (2nd ed.). New York: John Wiley.

34.

Kerlinger, F.N. (1973) Foundations of Behavioral Research (2nd ed.). New York: Holt, Rinehart & Winston.

35.

Kerzner, H. (1979) Project Management: A Systems Approach to Planning, Scheduling and Controlling New York: Van Nostrand Reinhold.

36.

Krathwol, D.R. (1973) "The taxonomy of educational objectives: use of cognitive and affective domains," pp. 246-268 in B. R. Worthen and J. R. Sanders (eds.) Educational Evaluation: Theory and Practice. Worthington, OH: Charles A. Jones.

37.

La Mendola, W. (1981) "Feasibility as a consideration in small computer selection." Administration in Social Work 5 (3-4): 43-56.

38.

Lauffer, A. (1982) Assessment Tools for Practitioners, Managers, and Trainers Beverly Hills: Sage.

39.

Lee, L. ( 1981) The Grants Game San Francisco: Harbor.

40.

Lewin, K. (1951) Field Theory in Social Science New York: Harper & Row.

41.

Lindblom, C.E. (1959) "The science of muddling through." Public Administration Rev. 19 (2): 79-99.

42.

Lipsey, M.W. , S. Crosse , D. Dunkle , J. Pollard , and G. Stobart (1985) "Evaluation: the state of the art and the sorry state of the science," in D. S. Cordray (ed.) Utilizing Prior Research in Evaluation Planning. New Directions for Program Evaluation, No. 27. San Francisco: Jossey-Bass.

43.

March, J.G. and J.P. Olsen (1976) "Organizational choice under ambiguity," in J. G. March and J. P. Olsen (eds.) Ambiguity and Choice in Organizations. Bergen, Norway: Universitetsforlaget.

44.

March, J.G. and H.A. Simon (1958) Organizations New York: John Wiley.

45.

Mayer, R.R. (1985) Policy and Program Planning Englewood Cliffs, NJ: Prentice-Hall.

46.

Mayer, R.R. and E. Greenwood (1980) The Design of Social Policy Research Englewood Cliffs, NJ: Prentice-Hall.

47.

McClintock, C. (1987) "Conceptual and action heuristics: tools for the evaluator," in L. Bickman (ed.) Using Program Theory in Evaluation. San Francisco: Jossey-Bass.

48.

Meyer, J.W. and B. Rowan (1977) "Institutionalized organizations: formal structure as myth and ceremony." American J. of Sociology 83: 340-63.

49.

Meyerson, J. and E.C. Banfield (1955) Politics, Planning and the Public Interest New York: Free Press.

50.

Milord, J.T. (1976) "Human service needs assessment: three non-epidemiological approaches." Canadian Psychologist 17: 260-269.

51.

Mutscheler, E. (1979) "Using single-case evaluation procedures in a family and children's service agency." J. of Social Service Research 3 (1): 115-133.

52.

Nadler, G. (1970) Work Systems Design New York : Irwin.

53.

Neuber, K.A. (1980) Needs Assessment: A Model for Community Planning Beverly Hills, CA: Sage.

54.

Nutt, P.C. (1984) "A strategic planning network for non-profit organizations." Strategic Management J. 5: 57-75.

55.

Offord, D.R. , P. Szatmari , N.I. Rae-Grant , P.S. Links , D.T. Cadman , J.A. Byles , J.W. Crawford , E.M. Blum , and C. Byrne (1987) "Ontario Child Health Study: II. six-month prevalence of disorder and rates of service utilization." Archives of General Psychiatry 44: 832-836.

56.

Orshansky, M. (1969) "Perspectives on poverty: how poverty is measured." Monthly Labor Rev. 92: 37-41.

57.

Pancer, S.M. (1987) "The development of affective skills in school-aged children." J. of Applied Developmental Psychology 8: 165-181.

58.

Patti, R. (1978) "Toward effective interdisciplinary education for social welfare management." Administration in Social Work 2: 135-136.

59.

Patton, M.Q. (1986) Utilization-Focused Evaluation (2nd ed.). Beverly Hills, CA: Sage.

60.

Perlman, R. and A. Gurin (1972) Community Organization and Social Planning New York: John Wiley.

61.

Pfeffer, J. and G.R. Salanick (1978) "Organizational decision making as a political process: the case of a university budget." Admin. Sci. Q. 19 (6): 135-151.

62.

Pierce, D. (1984) Policy for the Social Work Practitioner New York: Longmans.

63.

Posavac, E.J. and R.G. Carey (1985) Program Evaluation: Methods and Case Studies (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.

64.

Pressman, J.L. and A. Wildavsky (1973) Implementation Berkeley: Univ. of California Press.

65.

RATHE, A. W. [ed.] (1961) Gantt on Management. New York: American Management Association.

66.

ROSSI, P. H. [ed.] (1982) Standards for Evaluation Practice. San Francisco: Jossey-Bass.

67.

Rossi, P.H. and H.E. Freeman (1986) Evaluation: A Systematic Approach (3rd ed.). Beverly Hills, CA: Sage.

68.

Rutman, L. (1977) "Planning an evaluation study," in L. Rutman (ed.) Evaluation Research Methods: A Basic Guide. Beverly Hills, CA: Sage.

69.

Rutman, L. (1980) Planning Useful Evaluations: Evaluability Assessment Beverly Hills, CA: Sage.

70.

Scheirer, M.A. (1987) "Program theory and implementation theory: implications for evaluators," in L. Bickman (ed.) Using Program Theory in Evaluation. San Francisco: Jossey-Bass.

71.

Scotch, C.B. and U.B. Haskett (1978) "Preparing social workers for an age of accountability: understanding cost analysis." J. of Education for Social Work 14: 107-113.

72.

Scott, W.R. (1981) Organizations: Rational, Natural and Open Systems Englewood Cliffs, NJ: Prentice-Hall .

73.

Scriven, M. (1967) "The methodology of evaluation," pp. 39-83 in R. Tyler, R. Gagne, and M. Scriven (eds.) Perspectives of Curriculum Evaluation (AERA Monograph 1). Chicago: Rand McNally.

74.

Shortell, S.M. and W.C. Richardson (1978) Health Program Evaluation St. Louis: C. V. Mosby.

75.

Siegel, L.M. , C.C. Attkisson , and L.G. Carson (1978) "Need identification and program planning in the community context," in C. C. Attkisson, W. A. Hargreaves, M. J. Horowitz, and J. E. Sorensen (eds.) Evaluation of Human Service Programs. New York: Academic Press.

76.

Sinclair, C. and M. Frankel (1984) "The effect of quality assurance activities on the quality of mental health services." J. of Quality Assurance 8: 7-15.

77.

Stake, R.E. (1970) "Objectives, priorities, and other judgment data." Rev. of Ed. Research 40: 181-212.

78.

Stevens, R.E. and D.K. Sherwood (1982) How to Prepare a Feasibility Study Englewood Cliffs, NJ: Prentice-Hall.

79.

Stokey, E. and R. Zeckhauser (1978) A Primer for Policy Analysis New York: Norton.

80.

Stufflebeam, D.L. , W.J. Foley , W.J. Gephart , E.G. Guba , R. Hammond , H.O. Merriman , and M.M. Provus (1971) Educational Evaluation and Decision-Making in Education Itasca, IL: Peacock.

81.

TESTER, F. J. and W. MYKES [eds.] (1981) Social Impact Assessment: Theory, Method and Practice. Calgary, Alberta: Detsellig.

82.

Thomas, E.J. (1978) "Research and service in single case experimentation: conflicts and choices." Social Work Research and Abstracts 14 (4): 20-31.

83.

Thompson, J.D. (1967) Organizations in Action New York: McGraw-Hill.

84.

Weinbach, R.W. (1984) "Implementing change: insights and strategies for the supervisor." Social Work 29 (3): 282-286.

85.

Weiss, C.H. (1972) Evaluation Research: Methods of Assessing Program Effectiveness Englewood Cliffs, NJ: Prentice-Hall.

86.

Westhues, A. (1980) "Stages in social planning." Social Service Rev., 59, 331-343.

87.

Wholey, J.S. (1977) "Evaluability assessment," in L. Rutman (ed.) Evaluation Research Methods: A Basic Guide. Beverly Hills, CA: Sage.

88.

Wholey, J.S. (1979) Evaluation: Promise and Performance Washington, DC: Urban Institute.

89.

Wholey, J.S. (1983) Evaluation and Effective Public Management Boston: Little, Brown.

90.

Wholey, J.S. (1987) "Evaluability assessment: developing program theory," in L. Bickman (ed.) Using Program Theory in Evaluation. San Francisco: Jossey-Bass.

91.

Wholey, J.S. , J.W. Scanlon , H.G. Duffy , J.S. Fukumoto , and L.M. Vogt (1970) Federal Evaluation Policy: Analyzing the Effects of Public Programs Washington, DC: Urban Institute.

92.

Williams, W. (1975) "Implementation analysis and assessment." Policy Analysis 1 (3): 531-566.

93.

Witkin, B.R. (1984) Assessing Needs in Educational and Social Programs San Francisco: Jossey-Bass.

94.

Yates, B.T. (1985) "Cost-effectiveness analysis and cost-benefit analysis: an introduction." Behaviour Assessment 2 (3): 271-282.

95.

York, R.O. (1982) Human Service Planning: Concepts, Tools and Methods Chapel Hill: Univ. of North Carolina Press.

96.

Young, D.W. and B. Allen (1977) "Benefit-cost analysis in the social services: the example of adoption reimbursement." Social Service Rev. 51: 249-264.