Relationships Between Clinician Variability and Radiographic Guidelines

Abstract

This study evaluated the replicability of clinical measurements under careful calibration of multiple dentists and how the replicability can relate to their use as selection criteria in guidelines for prescribing dental radiographs. For 48 consenting patients, three dentists clinically examined each patient and recorded the presence of all clinical findings using standardized selection criteria. The examinations were performed independently of each other, but with periodic conferences of the dentists to clarify general measurement criteria. The degree of agreement among the dentists is described by the interrater agreement kappa for several standard clinical indications such as rating of caries, periodontal disease, and tooth mobility. Almost perfect agreement was obtained for tooth status, restoration size, and restoration material. Moderate agreement resulted for measures of caries, defective restoration presence, and gingival recession presence. Only fair agreement was obtained for other periodontal disease measures. The relationship between extent of agreement and guidelines' results was examined for the FDA Guidelines. The differences among the dentists' clinical measurements resulted in considerable differences among the radiographs that were selected by the FDA Guidelines' criteria. Even so, the missed disease rates for 490 patients in a larger study of the FDA Guidelines' efficacy were very low and did not vary greatly among the three dentists. We conclude that guidelines' criteria can be quite robust to variation from dentists' clinical measurement differences, as seen from the FDA Guidelines applied under the idealized setting where the dentists are periodically recalibrated through group discussions of the clinical measurements' definitions and interpretations.

Keywords

Radiography (dental)guidelines,statistics Received December 1,1994 Accepted November 16,1995

Get full access to this article

View all access options for this article.

References

Abbas F. , Hart AA , Oosting J. , van der Velden U. (1982). Effect of training and probing force on the reproducibility of pocket depth measurements. J Periodont Res 17:226-234.

Atchison KA , White SC , Flack VF , Hewlett ER , Kinder SA (1995a). Efficacy of selection criteria for radiographs to assess the periodontium. J Dent Res 74:1424-1432. Atchison KA , White SC , Flack VF , Hewlett ER (1995b). Assessing the FDA guidelines for ordering dental radiographs. J Am Dent Assoc 126:1372-1383.

Badersten A. , Nilveus R. , Egelberg J. (1984). Reproducibility of probing attachment level measurements . J Clin Periodontol 11:474-485.

Fleiss JL (1981). Statistical methods for rates and proportions . 2nd ed. New York: John Wiley & Sons, Inc., Ch. 13. Hewlett ER , Atchison KA , White SC , Flack VF (1993). Radiographic secondary caries prevalence in teeth with clinically defective restorations. J Dent Res 72:1604-1608. Landis JL , Koch GG (1977). The measurement of observer agreement for categorical data. Biometrics 33:159-174. Merrett Mcw , Elderton RJ (1984). An in vitro study of restorative dental treatment decisions and dental caries . Br Dent J 157:128-133.

Pippin DJ , Feil P. ( 1992). Interrater agreement on

subgingival calculus detection following scaling. J Dent Educ 56:322-326.

Valachovic RW , Douglass CW , Berkey CS , McNeil BJ , Chauncey HH (1986). Examiner reliability in dental radiography. J Dent Res 65:432-436.

Walsh TF , Saxby MS (1989). Inter- and intra-examiner variability using standard and constant force periodontal probes. J Clin Periodontol 16:140-143.

White SC , Atchison KA , Hewlett ER , Flack VF (1994). Efficacy of FDA guidelines for ordering radiographs for caries detection. Oral Surg Oral Med Oral Pathol 77:531-540. White SC , Atchison KA , Hewlett ER , Flack VF (1995). Clinical predictors of dental caries. Dentomaxillofac Radiol 24:121-127.