What Difference Do Two Days Make? The Inertia of Physicians' Sequential Prognostic Judgments for Critically III Patients

Abstract

Medical authorities have asserted the importance of observing a patient's clinical course over time. Distinguished committees have suggested that changes over time in physicians' prognostic estimates should influence decisions to transfer patients out of intensive care units (ICUs). This study evaluated how the opportunity to observe patients over time affected physicians' prognostic estimates for a cohort of 269 critically ill patients sequentially admitted to a medical-surgical ICU in a teaching hospital. As soon as possible after admission and again 48 hours later, the authors obtained a quantitative estimate of the probability of survival through hospital discharge from each patient's house officer and primary attending physician, and the critical care attending physician on duty. They independently determined each patient's survival. From this population they analyzed 181 pairs of judgments made by the same house officers, 211 pairs by the same primary attendings, and 172 pairs by the same critical care attendings. The physicians' 48-hour estimates were little changed from their previous estimates for the same patients. The correlation coefficient for the house officers' paired estimates was 0.84 (p <0.0001 ); for the critical care attendings' estimates 0.84 (p <0.0001), and for the primary attendings' estimates, 0.90 (p <0.0001). Forty-eight hours did not substantially reduce the disagreements present between estimates made by different physicians for the same patient. No group of physicians substantially improved the reliability or the discriminating power of its later estimates. The physicians in the study could not take advantage of sequential clinical information over time. These results point out the need to teach physicians how to better integrate and process sequential clinical data. Key words: sequential data; prediction; survival rate; prognosis; intensive care unit. (Med Decis Making 1990;10:6-14)

Get full access to this article

View all access options for this article.

References

Braunwald E , Isselbacher KJ , Petersdorf RG , Wilson JD , Martin JB , Fauci AS , eds. The practice of medicine. In Harrison's Principles of Internal Medicine. Eleventh edition. New York: McGraw-Hill, 1987; 1.

Politser PE Heuristics, normative models, and the value of serial test patterns. Behav Sci. 1986;31:260-77.

NIH Consensus Conference. Critical care medicine. JAMA. 1983;250:798-804.

Task Force on Guidelines, Society for Critical Care Medicine. Recommendations for intensive care unit admission and discharge criteria. Crit Care Med. 1988 ;16:807-8.

Poses RM , Bekes C. , Copare FJ , Scott WE The answer to "what are my chances, doctor?" depends on whom you ask: prognostic optimism, pessimism, and disagreement for critically ill patients. Crit Care Med. 1989; 17:827-33.

Knaus WA , Draper EA , Wagner DP , Zimmerman JE APACHE II: a severity of disease classification system. Crit Care Med. 1985; 13:818-29.

Poses RM , Cebul RD , Center RM Evaluating physicians' probabilistic judgments. Med Decis Making. 1988; 8:233-40.

Poses RM , Cebul RD , Collins M. , Fager SS The accuracy of experienced physicians' probability estimates for patients with sore throats. JAMA. 1985;254:925-9.

Lichtenstein S. , Fischoff B. , Phillips LD Calibration of probabilities : the state of the art in 1980. In Judgment under uncertainty: heuristics and biases. D Kahneman , P Slovic , A Tversky , eds. Cambridge: Cambridge University Press, 1982;306-34.

10.

Spiegelhalter DJ Statistical methods for evaluating gastrointestinal symptoms. Clin Gastroenterol. 1985;14:489-515.

11.

Ingelfinger JA , Mosteller F , Thibodeau LA , Ware JH , eds. Bio-statistics in clinical medicine . New York: Macmillan, 1983;160-76.

12.

Yates JF , Ying Z. , Ronis DL , Deng-feng W. , Shinotsuka H. , Toda M. Probability judgment accuracy: China, Japan, and the United States. Org Behav Human Decis Proc. 1989; 43:145-71.

13.

Winkler RL , Murphy AH "Good" probability assessors. J Appl Meteor. 1968;7:751-8.

14.

Harrell FE The LOGIST procedure. In SAS supplementary guide. Cary, NC: SAS Institute, 1979.

15.

Levi K. A signal detection framework for the evaluation of probabilistic forecasts . Org Behav Hum Decis Proc. 1985;36:143-66.

16.

Berwick DM , Thibodeau LA Reviewer operating characteristic analysis of diagnostic skill. Med Care. 1983;21:876-85.

17.

Lee KL , Pryor DB , Harrell FE , et al. Predicting outcome in coronary artery disease: statistical models versus expert clinicians. Am J Med. 1986;80:553-60.

18.

Centor RM , Schwartz JS Use of an electronic spreadsheet (Visicalc) to estimate the area under the ROC curve. Med Decis Making. 1983;3:380.

19.

Hanley JA , McNeil BJ The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29-36.

20.

Hanley JA , McNeil BJ A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983 ;148:839-43.

21.

Jacobs S. , Chang Rws , Lee B. One year's experience with the APACHE II severity of disease classification system in a general intensive care unit. Anesthesia. 1987;42:738-44.

22.

Chang Rws , Jacobs S. , Lee B. , Pace N. Predicting deaths among intensive care unit patients. Crit Care Med. 1988;16:34-42.

23.

Lemeshow S. , Teres D. , Avrunin JS , Gage GW Refining intensive care unit outcome prediction by using changing probabilities of mortality. Crit Care Med. 1988; 16:470-77.

24.

Tversky A. , Kahneman D. Judgment under uncertainty: heuristics and biases. In Kahneman D , Slovic P , Tversky A , eds. Judgment under uncertainty: heuristics and biases. Cambridge: Cambridge University Press, 1982;3-23.

25.

Bushyhead JB , Christensen-Szalanski Jjj. Feedback and the illusion of validity in a medical clinic. Med Decis Making. 1981;1:115-23.

26.

Argote L. , Seabright MA , Dyer L. Individual versus group use of base-rate and individuating information. Org Behav Hum Decis Proc. 1986;38:65-75.

27.

Harvey AM , Bordley J. , Barondess JA Differential diagnosis: the interpretation of clinical evidence. Philadelphia: W.B. Saunders. 1979 ;13.