Face,Content,and Construct Validity Evaluation of Simulation Models in General Surgery Laparoscopic Training and Education: A Systematic Review.

Abstract

Background

Laparoscopic technical surgical skills (LTS) are considered a fundamental competence for General Surgery residents. Several simulation tools (ST) have been explored to develop LTS. Although a plethora of systematic reviews evaluate the translation of LTS developed in simulation to real surgery, there is a lack of evidence that clarifies effectiveness of different validated ST in acquisition of LTS in surgical residents. The aim of this systematic review (SR) is to summarize published evidence on ST validation used for surgery education and training.

Methods

A protocol was published in PROSPERO. A SR was carried out following PRISMA guidelines. Complete published articles in English or Spanish that validate either content or construct, plus another form of validation of ST to acquire LTS in general surgery were included. Articles that used only one validation or did not validate an ST were excluded.

Results

1052 publications were initially identified across all searched databases. Title review identified 204 studies eligible for full text screening. 10 studies were included for final review. Two studies assessed both face and content, 4 face and construct, and 4 face, content and construct validity. None of the studies presented comparable outcomes due to metrics variation and scores used for the validation strategies.

Conclusions

This study assessed validated laparoscopic simulation models, particularly in content and construct validity. Articles reported an increased use of simulation models in laparoscopic training with positive feedback from trainees, but few studies reported validation of training model. Validation strategies are not standardized, limiting comparability between them.

Keywords

validation face content and construct validity laparoscopic training education training virtual reality augmented reality

Get full access to this article

View all access options for this article.

References

ACGME Accreditation Council for graduate medical education, Program Requirements for graduate Medical Education in General Surgery. https://www.acgme.org/

Forgione

Guraya

. The cutting-edge training modalities and educational platforms for accredited surgical training: A systematic review. J Res Med Sci. 2017;22(1):51. https://pubmed.ncbi.nlm.nih.gov/28567070/

Shichinohe

Kobayashi

. Cadaver surgical training in Japan: Its past, present, and ideal future perspectives. Surg Today]. 2021;52(2):354-358. https://link-springer-com-443.web.bisu.edu.cn/article/10.1007/s00595-021-02330-5

Shetty

Zevin

Grantcharov

Roberts

Duffy

. Perceptions, training experiences, and preferences of surgical residents toward laparoscopic simulation training: A resident survey. J Surg Educ. 2014;71(5):727–733. https://pubmed.ncbi.nlm.nih.gov/24794063/

Light

Bawa

Gallagher

Horgan

. Outcomes of an innovative training course in laparoscopic hernia repair. Ann R Coll Surg Engl. 2017;99(8):614–616. https://pubmed.ncbi.nlm.nih.gov/28682133/

Nickel

Hendrie

Bruckner

, et al. Successful learning of surgical liver anatomy in a computer-based teaching module. Int J Comput Assist Radiol Surg. 2016;11(12):2295-2301. https://pubmed.ncbi.nlm.nih.gov/26872808/

Nickel

Jede

Minassian

, et al. One or two trainees per workplace in a structured multimodality training curriculum for laparoscopic surgery? Study protocol for a randomized controlled trial - DRKS00004675. Trials. 2014;15(1):137. https://pubmed.ncbi.nlm.nih.gov/24754961/

Dawe

Windsor

Broeders

JAJL

Cregan

Hewett

Maddern

. A systematic review of surgical skills transfer after simulation-based training: laparoscopic cholecystectomy and endoscopy. Ann Surg. 2014;259(2):236-248. https://pubmed.ncbi.nlm.nih.gov/24100339/

Andrade

Rueda

Lopez-McCormick

. Existing models for minimally Invasive surgery simulation training in post-grad education; 2019. https://www.crd.york.ac.uk/PROSPEROFILES/205397_STRATEGY_20200820.pdf

10.

Gorman

Meier

Krummel

. Simulation and virtual reality in surgical education: Real or unreal? Arch Surg. 1999;134(11):1203-1208. https://pubmed.ncbi.nlm.nih.gov/10555634/

11.

Prasad

MSR

Manivannan

Manoharan

Chandramohan

. Objective assessment of laparoscopic force and pychomotor skills in a novel virtual reality-based haptic simulator. J Surg Educ. 2016;73(5):858-869. https://pubmed.ncbi.nlm.nih.gov/27267563/

12.

Nickel

Kowalewski

K-F

Rehberger

, et al. Face validity of the pulsatile organ perfusion trainer for laparoscopic cholecystectomy. Surg Endosc. 2017;31(2):714-722. https://pubmed.ncbi.nlm.nih.gov/27317031/

13.

Alaker

Wynn

Arulampalam

. Virtual reality training in laparoscopic surgery: A systematic review & meta-analysis. Int J Surg. 2016;29:85-94. https://pubmed-ncbi-nlm-nih-gov.ezproxy.uniandes.edu.co:8443/26992652/

14.

Robinson

Piekut

Hasman

Knight

. Cadaveric simulation training in cardiothoracic surgery: A systematic review. Anat Sci Educ. 2020;13(3):413–425. https://pubmed-ncbi-nlm-nih-gov.ezproxy.uniandes.edu.co:8443/31232510/

15.

Gallagher

Ritter

Satava

. Fundamental principles of validation, and reliability: Rigorous science for the assessment of surgical education and training. Surg Endosc. 2003;17(10):1525–1529. https://pubmed.ncbi.nlm.nih.gov/14502403/

16.

Chawla

Devi

Calvachi

Gormley

Rueda-Esteban

. Evaluation of simulation models in neurosurgical training according to face, content, and construct validity: A systematic review. Acta Neurochirurgica. 2022;164:947–966. https://link-springer-com-443.web.bisu.edu.cn/article/10.1007/s00701-021-05003-x

17.

van Renterghem

van Nieuwenhove

. Training models in laparoscopy: A systematic review comparing their effectiveness in learning surgical skills. Acta Chir Belg. 2014;113(2):77-95. https://www.researchgate.net/publication/237068276

18.

Page

McKenzie

Bossuyt

, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. https://www.bmj.com/content/372/bmj.n71

19.

Rayyan – Intelligent Systematic Review; 2021. https://www.rayyan.ai/

20.

Fink

. Construct validity - An overview | ScienceDirect topics. In: McGaw

Baker

, eds. International Encyclopedia of Education. Amsterdam, The Netherlands: Elsevier; 2010. https://www-sciencedirect-com-443.web.bisu.edu.cn/topics/social-sciences/construct-validity.

21.

van Empel

van Rijssen

Commandeur

, et al. Validation of a new box trainer-related tracking device: The TrEndo. Surg Endosc. 2012;26(8):2346-2352. https://link-springer-com-443.web.bisu.edu.cn/article/10.1007/s00464-012-2187-6

22.

Face validity - Oxford Reference; 2021. https://www.oxfordreference.com/view/10.1093/oi/authority.20110803095807498

23.

Risk of Bias 2 (RoB 2) tool | Cochrane Methods; 2021. https://methods.cochrane.org/risk-bias-2

24.

Smith

Learman

. A plea for MERSQI: The medical education research study quality instrument. Obstet Gynecol. 2017;130(4):686-690. https://pubmed.ncbi.nlm.nih.gov/28885409/

25.

Bahsoun

Malik

Ahmed

El-Hage

Jaye

Dasgupta

. Tablet based simulation provides a new solution to accessing laparoscopic skills training. J Surg Educ. 2013;70(1):161-163. https://pubmed.ncbi.nlm.nih.gov/23337687/

26.

Achurra

Lagos

Avila

, et al. Allowing new opportunities in advanced laparoscopy training using a full high-definition training box. Surg Innov. 2017;24(1):66-71. https://pubmed.ncbi.nlm.nih.gov/27729567/

27.

de Moura Júnior

de Vasconcelos

PRL

Fechine

, et al. Endosuture trainer box simulator as a tool for training and teaching in bariatric laparoscopic surgery. BMC Surg. 2018;18(1):83. https://pubmed.ncbi.nlm.nih.gov/30301475/

28.

Sánchez-Peralta

Sánchez-Margallo

Moyano-Cuevas

, et al. Construct and face validity of SINERGIA laparoscopic virtual reality simulator. Int J Comput Assist Radiol Surg. 2010;5(4):307-315. https://pubmed.ncbi.nlm.nih.gov/20422300/

29.

Lahanas

Loukas

Smailis

Georgiou

. A novel augmented reality simulator for skills assessment in minimal invasive surgery. Surg Endosc. 2015;29(8):2224-2234. https://pubmed.ncbi.nlm.nih.gov/25303925/

30.

Sankaranarayanan

Manser

, et al. Face and construct validation of a next generation virtual reality (Gen2-VR) surgical simulator. Surg Endosc. 2016;30(3):979-985. https://pubmed.ncbi.nlm.nih.gov/26092010/

31.

van Empel

van Rijssen

Commandeur

, et al. Validation of a new box trainer-related tracking device: The TrEndo. Surg Endosc. 2012;26(8):2346-2352. https://pubmed.ncbi.nlm.nih.gov/22350239/

32.

Escamirosa

Flores

RMO

García

Vidal

CRZ

Martínez

. Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons. Surg Endosc. 2015;29(11):3392-3403. https://pubmed.ncbi.nlm.nih.gov/25515985/

33.

Kawaguchi

Egi

Hattori

Sawada

Suzuki

Ohdan

. Validation of a novel basic virtual reality simulator, the LAP-X, for training basic laparoscopic skills. Minim Invasive Ther Allied Technol. 2014;23(5):287-293. https://pubmed.ncbi.nlm.nih.gov/24773373/

34.

Arts

EEA

Leijte

Witteman

BPL

Jakimowicz

Verhoeven

Botden

SMBI

. Face, content, and construct validity of the take-home eosim augmented reality laparoscopy simulator for basic laparoscopic tasks. J Laparoendosc Adv Surg Tech. 2019;29(11):1419-1426. https://pubmed.ncbi.nlm.nih.gov/31613679/

35.

Arora

Sevdalis

Nestel

Woloshynowych

Darzi

Kneebone

. The impact of stress on surgical performance: A systematic review of the literature. Surgery. 2010;147(3):318-3306.e6.

36.

Hau

Weitz

Bork

. Impact of the COVID-19 pandemic on student and resident teaching and training in surgical oncology. J Clin Med. 2020;9(11):1-15. https://pubmed.ncbi.nlm.nih.gov/33114552/

37.

Bohl

McBryan

Spear

, et al.

Evaluation of a novel surgical skills training course: are cadavers still the gold standard for surgical skills training?

World Neurosurg. 2019;127:63-71. https://pubmed.ncbi.nlm.nih.gov/30930320/

38.

Bongers

van Hove

Stassen

LPS

Dankelman

Schreuder

HWR

. A new virtual-reality training module for laparoscopic surgical skills and equipment handling: can multitasking be trained? A randomized controlled trial. J Surg Educ. 2015;72(2):184-191. https://pubmed.ncbi.nlm.nih.gov/25439179/

39.

Shah

Aydin

Fisher

Ahmed

Froghi

Dasgupta

. Current status of simulation-based training tools in general surgery: A systematic review. Intern J Surg Open. 2021;38:100427. https://reader.elsevier.com/reader/sd/pii/S2405857221001182?token=8984AEE918EC73DBF413A2A922DAD8BFFBDF9B65CDC50C927637501B578C69C6D4C8FBF3D69994133F6C813D8AA44CD9&originRegion=us-east-1&originCreation=20211126160705