Safety of training and assessment in operating theatres – a systematic review and meta-analysis

Abstract

Objective:

Procedural outcomes can be used to assess the performance of specialists and trainees. This article establishes a systematic evidence base for the safety of training in the operating theatre. It also explores the possibility of using early, intermediate and late procedural outcomes of cardiac surgical operations to evaluate the performance of the clinicians and the healthcare system.

Methods:

Medline, EMBASE and PsycINFO databases were searched. Comparative studies evaluating quality indicators of cardiac surgical procedures (coronary artery bypass grafting (CABG) and valve surgery) were included. Guidelines from the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) were used.

Results:

Fourteen studies met the inclusion criteria. For CABG, meta-analysis of outcomes did not show any significant differences between the technical and non-technical skills of trainees versus specialists apart from bypass time (less for specialists) and intensive care unit (ICU) length of stay (less for trainees). Studies reporting outcomes on valve surgery also did not report any statistically significant differences amongst the outcomes.

Conclusion:

This systematic review did not discern any significant differences between the procedural outcomes of trainees and specialists, which indicates that trainees are safe to operate under senior supervision. In addition, this article recommends that various procedural outcomes can be used to evaluate the performance of clinicians and healthcare systems. Prospective studies need to be performed, taking into account the specific contribution of trainees and specialists during the procedure. This will give a clearer indication of safety and performance of trainees and specialists in the operating theatre.

Keywords

training assessment surgery cardiac surgery outcome performance

Get full access to this article

View all access options for this article.

References

Donabedian

. The effectiveness of quality assurance. Int J Qual Health Care 1996; 8: 401–407.

Taylor

Bridgewater

. Using outcomes in the recertification process. Ann R Coll Surg Engl 2008; 90: 188–189.

Buyske

. For the protection of the public and the good of the specialty: maintenance of certification. Arch Surg 2009; 144: 101–103.

Youngson

Knight

Hamilton

. The UK proposals for revalidation of physicians: implications for the recertification of surgeons. Arch Surg 2010; 145: 92–95.

Epstein

Hundert

. Defining and assessing professional competence. JAMA 2002; 287: 226–235.

Bourne

Paterson-Brown

. Calman and the new deal – compromising doctor training and patient care. Scott Med J 1999; 44: 147–148.

Vincent

Neale

Woloshynowych

. Adverse events in British hospitals: preliminary retrospective record review. BMJ 2001; 322: 517–519.

McCannon

Schall

Calkins

. Saving 100,000 lives in US hospitals. BMJ 2006; 332: 1328–1330.

Peterson

Coombs

DeLong

. Procedural volume as a marker of quality for CABG surgery. JAMA 2004; 291: 195–201.

10.

Shahian

Edwards

Ferraris

. Quality measurement in adult cardiac surgery: part 1--Conceptual framework and measure selection. Ann Thorac Surg 2007; 83: S3–S12.

11.

Roberts

Bocanegra

. Comparison of the first 100 coronary bypass patients of a supervised resident with his first 100 as an attending surgeon at the same institution. Am J Surg 1999; 178: 348–350.

12.

Ascione

Reeves

Pano

. Trainees operating on high-risk patients without cardiopulmonary bypass: a high-risk strategy? Ann Thorac Surg 2004; 78: 26–33.

13.

Bakaeen

Dhaliwal

Chu

. Does the level of experience of residents affect outcomes of coronary artery bypass surgery? Ann Thorac Surg 2009; 87: 1127–1133; discussion 1133–1134.

14.

Baskett

Buth

Legare

. Is it safe to train residents to perform cardiac surgery? Ann Thorac Surg 2002; 74: 1043–1048; discussion 1048–1049.

15.

Caputo

Chamberlain

Ozalp

. Off-pump coronary operations can be safely taught to cardiothoracic trainees. Ann Thorac Surg 2001; 71: 1215–1219.

16.

Goodwin

Birdi

Ramesh

. Effect of surgical training on outcome and hospital costs in coronary surgery. Heart 2001; 85: 454–457.

17.

Gulbins

Pritisanac

Ennker

. Safety of a cardiac surgical training program over a twelve-year period. Thorac Cardiovasc Surg 2007; 55: 494–499.

18.

Guo

Chu

Tong

. Does the trainee’s level of experience impact on patient safety and clinical outcomes in coronary artery bypass surgery? J Card Surg 2008; 23: 1–5.

19.

Karagounis

Asimakopoulos

Niranjan

. Complex off-pump coronary artery bypass surgery can be safely taught to cardiothoracic trainees. Interact Cardiovasc Thorac Surg 2006; 5: 222–226.

20.

Stoica

Kalavrouziotis

Martin

. Long-term results of heart operations performed by surgeons-in-training. Circulation 2008; 118: S1–S6.

21.

Yap

Andrianopoulos

Dinh

. Short- and midterm outcomes of coronary artery bypass surgery performed by surgeons in training. J Thorac Cardiovasc Surg 2009; 137: 1088–1092.

22.

Grayson

Rashid

. Effect of training on outcomes following coronary artery bypass graft surgery. Eur J Cardiothorac Surg 2004; 25: 591–596.

23.

Alexiou

Doukas

. Effect of training in mitral valve repair surgery on the early and late outcome. Ann Thorac Surg 2005; 80: 183–188.

24.

Baskett

Kalavrouziotis

Buth

. Training residents in mitral valve surgery. Ann Thorac Surg 2004; 78: 1236–1240.

25.

Sethi

Oprian

Miller

. Operative mortality in patients undergoing single valve replacement in teaching institutions--early mortality as a function of resident versus staff surgeon. Surgery 1988; 104: 301–310.

26.

Ahmed

Ashrafian

Hanna

. Assessment of specialists in cardiovascular practice. Nat Rev Cardiol 2009; 6: 659–667.

27.

Moher

Liberati

Tetzlaff

Altman

. PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009; 339: b2535.

28.

Guru

Anderson

Fremes

O’Connor

Grover

. Canadian CABG Surgery Quality Indicator Consensus Panel. The identification and development of Canadian coronary artery bypass graft surgery quality indicators. J Thorac Cardiovasc Surg 2005; 130: 1257.

29.

O’Brien

Shahian

DeLong

. Quality measurement in adult cardiac surgery: part 2--Statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg 2007; 83: S13–S26.

30.

Scrivens

. Assessing the value of accreditation systems. Eur J Public Health 1997; 7: 4–8.

31.

Shahian

Normand

Torchiana

. Cardiac surgery report cards: comprehensive review and statistical critique. Ann Thorac Surg 2001; 72: 2155–2168.

32.

Clarke

Oxman

. Cochrane reviewer’s handbook 4.1.3 [updated June 2001]. In: The Cochrane Library, Issue 3: Oxford: Update Software, 2001.

33.

Moher

Cook

Eastwood

. Improving the Quality of Reports of Meta-Analyses of Randomised Controlled Trials: The QUOROM Statement. Onkologie 2000; 23: 597–602.

34.

Parsonnet

Dean

Bernstein

. A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 1989; 79: I3–I12.

35.

Nashef

Roques

Michel

. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg 1999; 16: 9–13.

36.

de Leval

Carthey

Wright

. Human factors and cardiac surgery: a multicenter study. J Thorac Cardiovasc Surg 2000; 119: 661–672.

37.

Blackstone

. Monitoring surgical performance. J Thorac Cardiovasc Surg 2004; 128: 807–810.

38.

Evans

Adam

Murie

. Training in abdominal aortic aneurysm (AAA) repair: 1987–1997. Eur J Vasc Endovasc Surg 1999; 18: 430–433.

39.

Lim

O’Boyle

Royston

. Day case laparoscopic herniorraphy. A NICE procedure with a long learning curve. Surg Endosc 2006; 20: 1453–1459.

40.

Borowski

Ratcliffe

Bharathan

. Involvement of surgical trainees in surgery for colorectal cancer and their effect on outcome. Colorectal Dis 2008; 10: 837–845.

41.

Renwick

Bokey

Chapuis

. Effect of supervised surgical training on outcomes after resection of colorectal cancer. Br J Surg 2005; 92: 631–636.

42.

Paisley

Madhavan

Paterson-Brown

. Role of the surgical trainee in upper gastrointestinal resectional surgery. Ann R Coll Surg Engl 1999; 81: 40–45.

43.

Wan

Thung

Hsin

Underwood

Yim

. Video-assisted thoracic surgery major lung resection can be safely taught to trainees. Ann Thorac Surg 2008; 85: 416–419.

44.

Haan

Milford-Beland

O’Brien

. Impact of residency status on perfusion times and outcomes for coronary artery bypass graft surgery. Ann Thorac Surg 2007; 83: 2103–2110.