Neural Network Assessment of Perioperative Cardiac Risk in Vascular Surgery Patients

Abstract

Neural networks were developed to predict perioperative cardiac complications with data from 567 vascular surgery patients. Neural network scores were based on cardiac risk factors and dipyridamole thallium results. These scores were converted into like lihood ratios that predicted cardiac risk. The prognostic accuracy of the neural networks was similar to that of logistic regression models (ROC areas 76.0% vs 75.8%), but their calibration was better. Logistic regression overestimated event rates in a group of high-risk patients (predicted event rate, 64%; observed rate 30%; n = 50, p < 0.001). On a validation set of 514 patients, the neural networks still had ROC similar areas to those of logistic regression (68.3% vs 67.5%), but logistic regression again overesti mated event rates for a group of high-risk patients. The calibration difference was reflected in the Hosmer-Lemeshow chi-square statistic (18.6 for the neural networks, 45.0 for logistic regression). The neural networks successfully estimated perioperative cardiac risk with better calibration than comparable logistic regression models. Key words. neural networks; logistic regression; likelihood ratio; Bayes' theorem; cardiac risk. (Med Decis Making 1998;18:70-75)

Get full access to this article

View all access options for this article.

References

McPhail NV , Ruddy TD , Calvin JE , et al A comparison of dipyridamole-thallium imaging and exercise testing in the prediction of postoperative cardiac complications in patients requiring arterial reconstruction J Vasc Surg 1989,10.51-5

Pasternack PF , Grossi EA , Baumann FG , et al The value of silent myocardial ischemia monitoring in the prediction of perioperative myocardial infarction in patients undergoing peripheral vascular surgery J Vasc Surg 1989,10 617-25.

Eagle KA , Singer DE , Brewster DC , et al Dipyridamole-thallium scanning in patients undergoing vascular surgery. Optimizing preoperative evaluation of cardiac risk JAMA 1987; 2572185-9

Eagle KA , Coley CM , Newell JB , et al Combining clinical and thallium data optimizes preoperative assessment of cardiac risk before major vascular surgery Ann Intern Med 1989; 110 859-66

L'Italien GJ , Paul SD , Hendel RC , et al Development and validation of a Bayesian model for perioperative cardiac risk assessment in a cohort of 1,081 vascular surgical candidates. J Am Coll Cardiol 1996,27 779-86

Cross S.

Introduction to neural networks

Lancet 1995 ,346 1075-9

Baxt WG

Application of artificial neural networks to clinical medicine

Lancet 1995,346.1135-8

Dybowski R. , Gant V. Artificial neural networks in pathology and medical laboratories, Lancet. 1995,346.1203-7.

Baxt WG

Use of an artificial neural network for the diagnosis of myocardial infarction

Ann Intern Med 1991,115 843-8

10.

Tu JV , Guerriere Mrj

Use of a neural network as a predictive instrument for length of stay in the intensive care unit following cardiac surgery

Comput Biomed Res 1993,26 220-9

11.

Hendel RC , Chen MH , L'Italien GJ , et al. Sex differences in perioperative and long-term cardiac event-free survival in vascular surgery patients. An analysis of clinical and scintigraphic variables Circulation 1995,91:1044-51

12.

Lachenbruch PA , Mickey MR

Estimation of error rates in discriminant analysis

Technometrics 1968,10 1-11

13.

Mosteller F. , Tukey JW Data analysis, including statistics . In: Lindzey G , Aronson G , Aronson E (eds) The Handbook of Social Psychology Vol 2 Reading MA Addison-Wesley, 1968

14.

Patil S. , Henry JW , Rubenfire M. , Stein PD

Neural network in the clinical diagnosis of acute pulmonary embolism

Chest 1993,104 1685-9.

15.

Ebell MH Artificial neural networks for predicting failure to survive following in-hospital cardiopulmonary resuscitation. J Fam Pract. 1993,36 297-303

16.

Albert A. On the use and computation of likelihood ratios in clinical chemistry . Clin Chem 1982;28 1113-9.

17.

Neural computing A Technical Handbook for Professional II/Plus and NeuralWorks Explorer Pittsburgh, PA. Neural-Ware, Inc, 1993

18.

Rumelhart DE , Hinton GE , Williams EJ Learning internal representation by error propagation In Rumelhart DE , McClelland JL , The PDP Research Group (eds) Parallel Distributed Processing. Vol 1 Cambridge, MA. MIT Press, 1986 318-62

19.

Masters T. Probabilistic neural networks In Practical Neural Network Recipes in C + + San Diego, CA Academic Press, 1993 202-22

20.

Hanley JA , McNeil BJ The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982,143 29-36

21.

Hanley JA , McNeil BJ

A method of comparing the areas under receiver operating characteristic curves derived from the same cases

Radiology 1983 ,148 839-43

22.

Hosmer DW , Lemeshow S.

Goodness-of-fit tests for the multiple logistic regression model

Commun Statist—Part A Theor Meth 1980, A9(10) 1043-69

23.

Rutledge R.

Injury severity and probability of survival assessment in trauma patients using a predictive hierarchical network model derived from ICD-9 codes

Trauma 1995,38: 590-601

24.

Hecht-Nielsen R. Neurocomputing In Neural Engineering . Reading, MA, Addison-Wesley , 1990

25.

Lette J. , Colletti BW , Cerino M. , et al Artificial intelligence versus logistic regression statistical modeling to predict cardiac complications after noncardiac surgery Clin Cardiol. 1994,17.609-14.