This article presents a comprehensive taxonomy of essential competencies for program evaluators. First, the authors provide a rationale for developing evaluator competencies, along with a brief history of the initial development and validation of the taxonomy of essential evaluator competencies in King, Stevahn, Ghere, and Minnema (2001). Second, they present a revised version of that taxonomy and describe the revision process. Third, a crosswalk accompanying the taxonomy indicates which competencies address standards, principles, and skills endorsed by major evaluation associations in North America. Finally, the authors identify future needs related to the taxonomy, including the need for validation research, a shared understanding of terms, and the construction of descriptive rubrics for assessing competence.
Alkin, M. C. (1969). Evaluation theory development. Evaluation Comment, 2(1), 2-7.
2.
Alkin, M. C. (2004). Comparing evaluation points of view. In M. C. Alkin (Ed.), Evaluation roots: Tracing theorists’ views and influences (pp. 3-11). Thousand Oaks, CA: Sage.
3.
Altschuld, J. W. (1995). Developing an evaluation program: Challenges in the teaching of evaluation. Evaluation and Program Planning, 18, 259-265.
4.
Altschuld, J. W. (1999). The certification of evaluators: Highlights from a report submitted to the Board of Directors of the American Evaluation Association. American Journal of Evaluation, 20, 481-493.
5.
Altschuld, J. W., & Bickman, L. (1998, November). Be it resolved that evaluators should be certified (credentialed): The pro side of the issue. Paper presented at the annual meeting of the American Evaluation Association, Chicago.
6.
Altschuld, J. W., Engle, M., Cullen, C., Kim, I., & Macce, B. R. (1994). The 1994 directory of evaluation training programs. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives, and programs (New directions for program evaluation, No. 62, pp. 71-94). San Francisco: Jossey-Bass.
7.
American Evaluation Association, Task Force on Guiding Principles for Evaluators. (1995). Guiding principles for evaluators. In W. R. Shadish, D. L. Newman, M. A. Scheirer, & C. Wye (Eds.), Guiding principles for evaluators (New directions for program evaluation, No. 66, pp. 19-16). San Francisco: Jossey-Bass.
8.
Blanton, L. P. (1992). Preservice education: Essential knowledge of the effective special education teacher. Teacher Education and Special Education, 15, 87-96.
9.
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
10.
Canadian Evaluation Society. (1999). Essential skills series. Retrieved January 15, 2004, from http://www.evaluationcanada.ca
11.
Christie, C. A. (2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. In C. A. Christie (Ed.), The practice-theory relationship in evaluation (New directions for evaluation, No. 97, pp. 7-35). San Francisco: Jossey-Bass.
12.
Council on Linkages Between Academia and Public Health Practice. (n.d.). Competencies project. Retrieved July 31, 2004, from http://www.trainingfinder.org/competencies/background.htm
13.
Covert, R. W. (1992, November). Successful competencies in preparing professional evaluators. Paper presented at the annual meeting of the American Evaluation Association, Seattle, WA.
14.
Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2004). Program evaluation: Alternative approaches and practical guidelines (3rd ed.). Boston: Pearson.
15.
Gettinger, M., Stoiber, K., Goetz, D., & Caspe, E. (1999). Competencies and training needs for early childhood inclusion specialists. Teacher Education and Special Education, 22, 41-54.
16.
Green, P. (1999). Building robust competencies: Linking human resource systems to organizational strategies. San Francisco: Jossey-Bass.
17.
Guba, E. G. (1978). Toward a methodology of naturalistic inquiry in educational evaluation (CSE Monograph Series in Evaluation, No. 8). Los Angeles: University of California, Center for the Study of Evaluation.
18.
International Board of Standards for Training, Performance, and Instruction. (2003). Competencies. Retrieved July 13, 2004, from http://www.ibstpi.org/main.htm
19.
Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards (2nd ed.). Thousand Oaks, CA: Sage.
20.
King, J. A., Minnema, J., Ghere, G., & Stevahn, L. (1998, November). Evaluator competencies. Paper presented at the annual meeting of the American Evaluation Association, Chicago.
21.
King, J. A., Stevahn, L., Ghere, G., Minnema, J. (1999, November). “And the verdict is....” An exploratory study of perceived evaluator competencies. Paper presented at the annual meeting of the American Evaluation Association, Orlando, FL.
22.
King, J. A., Stevahn, L., Ghere, G., & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22, 229-247.
23.
McAllister, M. (1998). Competency standards: Clarifying the issues. Contemporary Nursing, 7, 131-137.
24.
Mertens, D. M. (1994). Training evaluators: Unique skills and knowledge. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives, and programs (New directions for program evaluation, No. 62, pp. 17-27). San Francisco: Jossey-Bass.
25.
Nagao, M. (2003). Japan Evaluation Society’s experiment with an accreditation scheme for evaluation training programs. Manuscript in preparation.
26.
National Commission for Health Education Credentialing. (1996). Responsibilities and competencies. Retrieved January 15, 2004, from http://www.nchec.org
27.
National Council for Accreditation of Teacher Education. (2002). Professional standards for the accreditation of schools, colleges, and departments of education. Retrieved January 15, 2004, from http://www.ncate.org
28.
Patton, M. Q. (1978). Utilization-focused evaluation. Newbury Park, CA: Sage Publications.
29.
Patton, M. Q. (2001). The CEFP as a model for integrating evaluation within organizations. Cancer Practice, 9(Suppl. 1), 11-16.
30.
Provus, M. M. (1969). Evaluation of ongoing programs in the public school system. In R. W. Tyler (Ed.), Educational evaluation: New roles, new means (pp. 242-283). The 68th Yearbook of the National Society for the Study of Education, Part 2. Chicago: National Society for the Study of Education.
31.
Qualitative Research Consultants Association. (2003). Professional competencies of qualitative research consultants. Retrieved January 15, 2004, from http://www.qrca.org
32.
Rychen, D. S. (2001). Introduction. In D. S. Rychen & L. H. Salganik (Eds.), Defining and selecting key competencies (pp. 1-15). Seattle, WA: Hogrefe and Huber.
33.
Scriven, M. (1967). The methodology of evaluation. In R. E. Stake (Ed.), Curriculum evaluation (American Educational Research Association monograph series on evaluation, No. 1, pp. 39-83). Chicago: Rand McNally.
34.
Smith, M. F. (1998, November). Should AEA begin a process for restricting membership into the profession of evaluation? Paper presented at the annual meeting of the American Evaluation Association, Chicago.
35.
Smith, M. F. (1999). Should AEA begin a process for restricting membership in the profession of evaluation?American Journal of Evaluation, 20, 521-531.
36.
Stake, R. E. (1980). Program evaluation, particularly responsive evaluation. In W. B. Dockrell & D. Hamilton (Eds.), Rethinking educational research (pp. 72-87). London: Hodder and Stoughton.
37.
Stufflebeam, D. L. (1973). An introduction to the PDK book Educational Evaluation and Decision-making. In B.R. Worthen & J. R. Sanders (Eds.), Educational evaluation: Theory and practice (pp. 128-142). Worthington, OH: Charles A. Jones.
38.
Stufflebeam, D. L. (2001, November). Evaluation theory from the perspective of the CIPP model. Paper presented at the annual meeting of the American Evaluation Association, St. Louis, MO.
39.
Treasury Board of Canada. (2001). Evaluation policy. Retrieved January 15, 2004, from http://www.tbs-sct.gc.ca
40.
Weinert, F. (2001). Concept of competence: A conceptual clarification. In D. S. Rychen & L. H. Salganik (Eds.), Defining and selecting key competencies (pp. 45-65). Seattle, WA: Hogrefe and Huber.
