Analysis Reliability Reports: Replication Unit Number 3

This report summarizes the results of the third study of analysis re liability based on current file production at the Human Relations Area Files. A total of 1229 pages from 147 sources was replicated for this reliability test. The average level of absolute coding agreement for this replication unit is 60 percent. Major category agreement is 88 percent when absolute agreement is measured and 90 percent when mutual cross- references and adjacent categories are taken into consideration. We find certain Outline of Cultural Materials (OCM) categories to be especially difficult to apply consistently. We identify these categories and discuss the problems involved in their use.