Use of Clinical Judgment Analysis to Explain Regional Variations in Physicians' Accuracies in Diagnosing Pneumonia

Abstract

The authors sought to explain regional differences in physicians' accuracies in diagnosing pneumonia by prospectively studying emergency department patients at three sites and analyzing differences in physicians' diagnostic strategies and patient characteristics. They enrolled 1,119 Illinois patients, 150 Nebraska patients, and 142 Virginia patients presenting with fever or respiratory symptoms for whom physicians ordered a chest radiograph because of suspicion of pneumonia. Emergency department physicians recorded patients' clinical findings and estimated the probability that a chest radiograph would show pneumonia. A measure of accuracy, the correlation between physicians' probability estimates and actual outcomes, was 0.41 (95% Cl 0.36-0.46) at Illinois, 0.66 (95% Cl 0.54-0.75) at Nebraska, and 0.55 (95% Cl 0.42-0.65) at Virginia. Physicians' strategies at the three sites differed markedly in their weightings of asthma, signs of consolidation, cough, tachypnea, age, and gender. These differences in weighting paralleled differences in the optimal clinical strategies derived from patient data at the three sites. Differences in diagnostic accuracy were best explained by differences in the difficulties of diagnosing pneumonia in the populations. Phy sicians at each site used clinical findings in a way that was close to optimal for their location. This type of analysis provides a new tool for understanding the sources of regional variations in clinical practice. Key words: judgment analysis; variation research; pneumonia. (Med Decis Making 1991 ;11 :189-197)

Get full access to this article

View all access options for this article.

References

Eisenberg JM Doctors' decisions and the cost of medical care. Ann Arbor, MI: Health Administration Press Perspectives, 1986.

Merrick NJ , Brook RH , Fink A. , Solomon DH Use of carotid endarterectomy in five California Veterans Administration medical centers. JAMA. 1986;256:2531-5.

Vayda E. A comparison of surgical rates in Canada and in England and Wales. N Engl J Med. 1973;289:1224-9.

Lewis CE Variations in the incidence of surgery. N Engl J Med. 1969;281:880-4.

Wennberg JE , Mulley AG Jr, Hanley D. , et al. An assessment of prostatectomy for benign urinary tract obstruction . JAMA. 1988;259:3027-30.

Kuder JM , Vilmain JA , Delmo LK Exploring physician responses to patients' extramedical characteristics: the decision to hospitalize. Med Care. 1987;25:882-93.

Siu AL , Sonnenberg FA , Manning WG , et al. Inappropriate use of hospitals in a randomized trial of health insurance plans. N Engl J Med. 1986;315:1259-66.

Wilkin D. , Smith AG Variation in general practitioners' referral rates to consultants. J R. Coll Gen Pract. 1987;37:350-3.

Epstein AR , McNeil BJ Physician characteristics and organizational factors influencing use of ambulatory tests. Med Decis Making. 1985;5:401-15.

10.

Chassin MR , Kosecoff J. , Park RE , et al. Does inappropriate use explain geographic variations in the use of health care services? A study of three procedures. JAMA. 1987;258:2533-7.

11.

Deber RB The determinants of treatment choice in end-stage renal disease: can we generalize about decision making from specific studies? Med Decis Making. 1986;6:231-8.

12.

Von Korff MR , Howard JA , Truelove EL , Sommers E. , Wagner EH , Dworkin S. Temporomandibular disorders: variation in clinical practice. Med Care. 1988;26:307-14.

13.

Heckerling PS , Tape TG , Wigton RS , et al. Clinical prediction rule for pulmonary infiltrates. Ann Intern Med. 1990;113:664-70.

14.

Harrell FE Jr, Lee KL , Califf RM , Pryor DB , Rosata RA Regression modelling strategies for improved prognostic prediction. Stat Med. 1984;3:143-52.

15.

SAS user's guide: statistics, version 5 edition. Cary, NC: SAS Institute, Inc.; 1985:801-16.

16.

SAS user's guide: statistics, version 5 edition. Cary, NC: SAS Institute, Inc.; 1985:735-42.

17.

Brunswik E. Perception and the representative design of psychological experiments. Berkeley, CA: University of California Press, 1956.

18.

Hammond KR , Hursch CJ , Todd FJ Analyzing the components of clinical inference. Psychol Rev. 1964;71:528-30.

19.

Tucker LR A suggested alternative formulation in the developments by Hursch, Hammond, and Hursch, and by Hammond, Hursch, and Todd. Psychol Rev. 1964;71:528-30.

20.

Castellan NJ Jr. Comments on the "lens model" equation and the analysis of multiple-cue judgment tasks. Psychometrika. 1973;38:87-100.

21.

Wigton RS Use of linear models to analyze physicians' decisions. Med Decis Making. 1988;8:241-52.

22.

Murphy EA Biostatistics in medicine. Baltimore, MD: Johns Hopkins University Press, 1982.

23.

Balzer WK , Doherty ME , O'Connor R. Jr. Effects of cognitive feedback on performance. Psychol Bull. 1989;106:410-33.

24.

Hammond KR Probabilistic functioning and the clinical method. Psychol Rev. 1955;62:255-62.

25.

Slovic P. , Rorer LG , Hoffman PJ Analyzing the use of diagnostic signs. Invest Radiol. 1971;6:18-26.

26.

Fisch H-U. , Hammond KR , Joyce Crb , et al. An experimental study of the clinical judgment of general physicians in evaluating and prescribing for depression. Br J Psychiat. 1981;138: 100-9.

27.

Wigton RS , Hoellerich VL , Patil KD How physicians use clinical information in diagnosing pulmonary embolism: an application of conjoint analysis. Med Decis Making. 1986;6:2-11.

28.

Wigton RS , Patil KD , Hoellerich VL The effect of feedback in learning clinical diagnosis. J Med Educ. 1986;61:816-22.

29.

Wennberg J. Which rate is right? N Engl J Med. 1986;314: 310-1.

30.

Christensen-Szalanski Jjj , Bushyhead JB Physicians' use of probabilistic information in a real clinical setting. J Exp Psychol Hum Percep Perform. 1981;4:928-35.