Teaching Evaluation through Modeling: Using the Delphi Technique to Assess Problems in Academic Programs

Abstract

The Delphi technique permits the collection of rich evaluation data. Benefits of using the Delphi include the collection of data that is generated by participants with minimal leading by researchers, an iterative process that demonstrates to participants how their ideas and opinions are being utilized in the research process, and a planned interaction to share results with participants, which usually creates good will between the participants and research team. This paper describes two cases in which the Delphi technique was implemented in order to teach students how to use the method. In both cases, students identified problems in their particular programs as the focus of the data collection activity.

Get full access to this article

View all access options for this article.

References

Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall, Inc.

Clayton, M. J. (1997). Delphi: A technique to harness expert opinion for critical decision-making tasks in education. Educational Psychology, 17, 373-386.

Dalkey, N. , & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9, 458-467.

Delbecq, A. , Van de Ven, A. , & Gustafson, D. (1975). Group techniques for program planning. Glenview, IL: Scott, Foresman.

Gredler, M. (1996). Program evaluation. Englewood Cliffs, NJ: Merrill.

Gredler, M. , & Johnson, R. (2001). Lessons learned from the directed evaluation experience. American Journal of Evaluation, 22, 97-104.

Helmer, O. (1967). Analysis of the future: The Delphi method. The Rand Corporation.

Klutschkowski, F. , & Troth, W. A. (1995). Components of a substance abuse counselor education curriculum: A Delphi study. Journal of Addictions and Offender Counseling, 15, 34-41.

Linstone, H. A. , & Turoff, M. T. (1975). The Delphi method: Techniques and applications. London: Addison-Wesley.

10.

Moore, C. (1987). Group techniques for idea building. Newbury Park: Sage.

11.

Smith, C. L. (1992). National issues and concerns in marketing teacher education. Marketing Educators’ Journal, 30, 75-89.

12.

Smith, K. S. , & Simpson, R. D. (1995). Validating teacher competencies for faculty members in higher education: A national study using the Delphi method. Innovative Higher Education, 19, 223-234.

13.

Thach, E. C. , & Murphy, K. L. (1995). Competencies for distance education professionals. Educational Technology Research and Development, 43, 57-79.

14.

Trevisan, M. S. (2002). Enhancing practical evaluation training through long-term evaluation projects. American Journal of Evaluation, 23, 81-92.