Establishing Reliability for Coding Implementation Concerns of School-Based Teams from Audiotapes

Abstract

A useful methodology for coding themes directly from audiotape is described, and issues and methods by which reliability can be established are presented. Attention is given to both the importance of audiotape use in qualitative research and the ways in which audiotape use can be expanded. Comparison is made between reliability estimates from coding themes directly from audiotape and coding themes from transcripts. A study is presented in which the reliability of direct coding from audiotapes, to develop conceptual categories and code concerns of professionals being trained on school-based support teams, was evaluated The results of this study suggest that the direct coding of audiotapes provides the qualitative researcher with another reliable option in the collection and analysis of data. Research implications are discussed

Get full access to this article

View all access options for this article.

References

Abrahams, R. , J.N. Greenberg , L. Greenberg , and S. Lamb. 1988. Reliable assessment of data in multisite programs: The social/HMO example. Evaluation Review 12:153-69.

Cohen, J. 1960. A coefficient of agreement for nominal scales. Education and Psychological Measurement 20:37-46.

Corsaro, W. 1981. Entering the child's world: Research strategies for field entry and data collection in a preschool setting. In Ethnography and language in educational settings, edited by J. Green and C. Wallat. Norwood, NJ: Ablex.

Evertson, C.M. , and J.L. Green. 1986. Observation as inquiry and method. In Handbook of research on teaching, edited by M. C. Wittrock. New York: Macmillan .

Fullan, M. 1982. The meaning of educational change. New York: Teachers College Press.

Goodwin, L.D. , and J.P. Goodwin. 1984. Are validity and reliability "relevant" in qualitative research? Evaluation & the Health Professions 7:413-26.

Gravois, T. , S. Rosenfield , and B. Greenberg. 1991. An analysis of implementation concerns of school support teams. Manuscript.

Green, J. , and C. Wallat , eds. 1981. Ethnography and language in educational settings. Norwood, NJ: Ablex.

Hartmann, D.P. 1977. Considerations in the choice of interobserver reliability estimates. Journal of Applied Behavioral Analysis 10:103-16.

10.

Holsti, O.R. 1969. Content analysis for the social sciences and humanities . Reading, MA: Addison-Wesley.

11.

Hall, G.E. , and S.M. Hord. 1987. Change in schools: Facilitating the process. Albany: State University of New York Press.

12.

Jacob, E. 1987. Qualitative research traditions: A review. Review of Educational Research 57:1-50.

13.

Kang, Namjun. 1987. Alternative methods for calculating intercoder reliability in content analysis: Kappa, weighted kappa and agreement charts procedure . Paper presented at the annual meeting of the Association for Education in Journalism and Mass Communication, San Antonio, TX, August.

14.

Kratochwill, T.R. , K.R. VanSomeren , and S.M. Sheridin. 1989. Training behavioral consultants : A competency-based model to teach interview skills. Professional School Psychology 4:41-58.

15.

Miles, M.B. 1987. Innovative methods for collecting and analyzing qualitative data: Vignettes and pre-structured cases. Paper presented at symposium on examining new professional roles, American Educational Research Association, Washington, DC, April.

16.

Miles, M.B. , and A.M. Huberman. 1984. Qualitative data analysis: A sourcebook of new methods. Beverly Hills, CA: Sage.

17.

Pickering, M. 1984. Interpersonal communication in speech-language pathology supervising conferences: A qualitative study. Journal of Speech and Hearing Disorders 49:189-95.

18.

Rosenfield, S. 1987. Instructional consultation. Hillsdale, NJ: Lawrence Erlbaum.

19.

Rosenfield, S. , and M. Feuerberg. 1987. Supporting child study team change to alternative delivery systems. Paper presented at the annual meeting of the American Psychological Association, New York, August.

20.

Stainback, S. , and W. Stainback. 1988. Understanding and conducting qualitative research. Dubuque, IA: Kendall/Hunt .

21.

Towstopiat, O. 1984. A review of reliability procedures for measuring observer agreement. Contemporary Educational Psychology 9:333-52.