Abstract
Background:
YouTube® (YouTube, San Bruno, CA) is the most popular, public domain, free access video source. The educational value of the videos is difficult to determine. This study aimed to determine the evaluation of video-assisted thoracoscopic surgery (VATS) lobectomy videos as an educational source on the YouTube platform.
Materials and Methods:
VATS lobectomy, as a keyword, was searched on YouTube and sorted by the number of visualizations. The top 25 most viewed VATS lobectomy videos uploaded to YouTube were analyzed. The videos were evaluated for critical view of safety (CVS) and LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS).
Results:
There were ∼1670 videos for the search term “VATS lobectomy.” There were 16 primary surgeons from 8 different countries. Most of the videos (n = 19) were affiliated to an academic institution. There was a positive significant correlation between author's h-index and number of likes. Videos showed conformity to CVS assessment with a rate of 56.5%. LAP-VEGaS conformity to educational content (e.g., audio or written commentary) and case presentation was very low.
Conclusions:
Using videos of VATS lobectomy in training may have great potential to improve surgical opinion. YouTube is user driven and these videos are not peer reviewed. This article showed issues concerning safety violations. We believe that professional societies should focus on promoting and disseminating valuable educational videos.
Introduction
Lung cancer still leads, at first place, in cancer-related deaths. 1 Curative anatomic resection is the standard treatment approach in operable lung cancer. 2 Anatomic lung resections, which started with pneumonectomy ∼100 years ago, have been replaced by lobectomy and segmentectomy over time and also thoracotomies were replaced by video thoracoscopic surgical approaches. With the acceptance of minimally invasive techniques in the surgical field, the number of video-assisted thoracoscopic surgery (VATS) pulmonary lobectomies has also increased and it has been the preferred method especially in early-stage cases. 3
Along with technological advances, classical education methods are also changing. Nowadays, online magazines, e-books, various mobile applications, simulations, and online videos are starting to be useful for educational purposes. 4 Use of technological tools such as the VATS lobectomy assessment tool (VATSAT) 5 is also an example and it has demonstrated how VATS lobectomy practice evaluation should be conducted.
YouTube® (YouTube, San Bruno, CA) is a popular video-sharing website that enables watching online videos since 2005. Current trainee and medical faculty students are the first generation to use the Internet for educational purposes. 6 Although there are many surgical video-sharing websites, YouTube access is much more common among trainees and assistants. 7 In addition, the interest of the publishers to YouTube has increased as it has several advantages such as easy accessibility, sharing of videos on social media, and allowing comment, like, and dislike options. 8 Unfortunately, the popularity of YouTube videos is not based on the quality and educational value of the video, but based on the view rate, number of comments, and likes.
The international multispecialty joint trainers and trainees expert committee prepared the LAP-VEGaS (LAParoscopic surgery Video Educational GuidelineS) consensus statement to evaluate the educational value of laparoscopic surgery videos 9 (Table 1). It clearly stated how to publish surgical training videos using 37 items. The evolution of VATS lobectomy correlates with laparoscopic cholecystectomy. 10 In our study, we aimed to evaluate the educational value of the 25 most watched VATS lobectomy videos on the YouTube platform.
International Multispecialty Joint Trainers and Trainees Expert Committee Laparoscopic Surgery Video Educational Guidelines Consensus Report
Materials and Methods
Study design
A search for “VATS lobectomy” was performed on February 12, 2020, through the website of YouTube. The top 25 videos were evaluated, as sorted by view count. Thoracoscopic lobectomy is described as the anatomic resection of an entire lobe of the lung, using a videoscope and an access incision, without the use of a mechanical retractor and without rib spreading. 11 Accordingly, in our study, videos of anatomic lung resection of an entire lobe without using rib spreading and recorded with thoracoscopic cameras by professional surgeons in English are included. It is to be mentioned that uniportal videothoracoscopic lobectomies are still evolving, although (since no techniques were specified in the description mentioned above) all surgical approaches (uni-, bi-, and triportal) are included in this study. Videos that were cartoon–animation, illustrations, and in languages other than English were excluded.
Data were recorded in terms of title and link, type of lobectomy, number of views, number of days online, video length, image quality, and like and dislike numbers (Table 2). The h-index is a number that represents productivity and the impact of a scientist. The surgeons performing the operations in the videos were investigated in terms of h-index through Scopus. In addition, the nationality and hospital of the authors were determined by a general Internet search.
Characteristics of the 25 Selected Videos on VATS Lobectomy (Ordered by Number of Visualizations on February 12, 2020)
CVS, critical view of safety; LAP-VEGaS, LAParoscopic surgery Video Educational GuidelineS; LLL, left lower lobectomies; LUL, left upper lobectomies; RLL, right lower lobectomies; RML, right middle lobectomy; RUL, right upper lobectomies.
Current guidelines recommend the application of critical view of safety (CVS) for surgical safety. There is no current CVS consensus for VATS lobectomy. We designed the VATS lobectomy CVS evaluation stages, in accordance with the stages suggested by Li et al., 10 the process mentioned in VATSAT evaluation by Jensen et al., 5 and based on our clinical experiences.
Ethics committee approval was not taken as the study was an evaluation of public domain surgical videos.
Evaluation of surgical and educational quality
The videos were evaluated for their conformity to VATS lobectomy CVS and LAP-VEGaS. Eight stages were set up for CVS evaluation such as palpation of the tumor and exploration for other pathologies, visualization of all veins before transection, identification of key branches of the pulmonary artery, dissection of the bronchus, ventilation test before transection of the bronchus, retrieval of lobe in bag, air leak test after transection of the bronchus, and dissection of lymph nodes. With LAP-VEGaS, the conformity assessment of the videos was 0 for those that are not eligible and 1 for those that are eligible.
Statistical analysis
Statistical analysis was performed using SPSS 22 (version 22; Statistical Package for the Social Sciences). Kolmogorov–Smirnov and Shapiro–Wilk tests were used for assessing assumption of normality. Parametric values are reported as the mean ± standard deviation, and nonparametric values are reported as median (25–75 percentiles). Spearman correlation was used to determine possible relationships between nonparametric values. Values of P < .05 were accepted as statistically significant.
Results
Video selection process and video characteristics
A total of 1670 uploaded videos were found after the search with the keyword “VATS lobectomy.” After exclusion of cartoons, illustrations, academic information, and robotic operations, the top 25 videos, sorted by view count, were evaluated.
A primary surgeon has been detected in 24 videos (96%). There were 16 different primary surgeons from 8 different countries, especially Spain (n = 8), the United States (n = 5), Italy (n = 3), and Germany (n = 3) (Table 3). Eleven (68.75%) videos were from an academic institute, 4 (25%) videos were from a secondary hospital, and one video was from a professional cardiothoracic surgery website that allows publishing of educational videos on the web (Table 4).
Surgeon Characteristics
Video Features
Parametric values are reported as the mean – standard deviation.
Nonparametric values are reported as median (25–75 percentiles).
STD, standard deviation.
According to the type of lobectomy, the rates were as follows: right upper lobectomies 40% (n = 10), left upper lobectomies 20% (n = 5), right lower lobectomies 20% (n = 5), left lower lobectomies 16% (n = 4), and the right middle lobectomy (RML) 4% (n = 1) (Table 2).
Twenty-five videos have been watched 463,274 times totally for an average period of 6.1 years. The mean number of days online for 25 videos was 2196.12 (STD = 938.71) and ranged from 430 to 3949. The mean number of visualizations was 18530.96 (STD: 13522.60, range: 51,625–6191). The median length was 11 minutes (percentiles: 7.5–24, range: 3–33). The videos received a median of 2 comments (percentiles: 0–6, range: 0–25) and the number of likes (median: 41, percentiles: 17.5–63.5, range 6–311) was higher than dislikes (median: 4, percentiles: 1.5–7.5, range: 0–19) (Table 4). A significant correlation was detected in the correlation analysis between video length and number of likes (P = .002, ρ = 0.583). No statistically significant correlation was found between other values.
h-Index
Eight (50%) of the 16 different surgeons had an h-index more than 10 (range = 0–53) (Table 3). There was a statistically significant correlation between the h-index of surgeons and number of likes (P = .013, ρ = 0.502). No statistically significant correlation was found among other values.
CVS assessment
Eight stages of CVS were evaluated individually for each of the 25 videos. Conformity was determined as an average of 4.52 (56.5%). The highest conformity was in the left upper lobectomy video, which was ranked 5th by the number of visualizations (video #5 from Table 2) (n = 7, 87.5%) (Table 3). The most applied points were identification of key branches of the pulmonary artery (n = 24, 96%) and retrieval of lobe in bag (n = 24, 96%). The less applied points were determined as palpation of the tumor and exploration for other pathologies (n = 4, 16%) and visualization of all veins before transection (n = 4, 16%) (Table 5).
Critical View of Safety Assessment
CVS, critical view of safety.
There was a statistically significant correlation between CVS conformity and the number of visualizations (P = .021, ρ = 0.459) and number of dislikes (P = .043, ρ = 0.407). There was no significant correlation between CVS and h-index (P = .96).
LAP-VEGaS conformity
Numbers of views and comments (LAP-VEGaS item 37) were available for all videos. The surgical procedure was presented step by step (LAP-VEGaS item 17) in 80% of 25 videos. The site for specimen extraction was demonstrated in 76% of all videos. The position of trocars was detailed in 72% (LAP-VEGaS item 16) of videos. However, the wide majority of LAP-VEGaS items (n = 15, 40.54%) (Table 6) were not detected in the videos. The most compatible video was no. 25 (51.3%) (Table 3). There was no statistically significant correlation between LAP-VEGaS conformity and other values.
Laparoscopic Surgery Video Educational Guidelines Conformity
Discussion
After the first VATS lobectomies were performed in the 1990s, many articles have been published, comparing VATS lobectomy and lobectomy through thoracotomy. The advantages of VATS lobectomy have been demonstrated. It has been suggested that the current trainee training should include VATS lobectomy and robotic lobectomy. 12 The training videos are available on many platforms on the World Wide Web and they have benefits in surgical and technical guidance. It is obvious that the development of virtual reality platforms such as VATSAT 5 will have educational benefits. It has been stated that the new-generation VATS surgeons can easily adapt to VATS lobectomies, but they have a higher risk of conversion to open procedure and higher rates of complications compared with experienced surgeons. 13 Likewise, due to the economic and patient safety-based difficulties of operating room education, learning by watching videos is popular among new learners. 14 Thus, the educational value of the published videos is very important. YouTube is a popular, free access video-sharing platform. Videos shared may be scientifically incompetent and without peer review process.
After LAP-VEGaS conformity evaluation, it was revealed that patient consent (item 6) and conflicts of interest disclosure (item 7) were not specified in the videos. In addition, additional educational content and outcomes of the procedure such as operation time, bleeding amount, length of hospital stay, and postoperative complications were not provided in most of the videos. We stated that YouTube videos do not undergo a standardized peer review process and, accordingly, their educational evaluation cannot be revealed properly. It has been detected that case presentation (items 8, 9, 10, and 11) is not mentioned in many videos. This has a high effect on surgical planning and considering postoperative complications.
The associated educational content section of LAP-VEGaS requires videos to be structured with diagrams, photos, tables, and audio/written English commentary. One of the reasons decreasing the educational value of the included videos might be the nonstructured design. In our study, 8% of the videos were structured and 52% of the videos had audio/written commentary in English. The presence of these elements leads to anatomical landmarks and unexpected findings. Structured videos have the advantage of preventing confusion of anatomical structures and allow the audience to have more clear visuality. In addition, according to LAP-VEGaS practice guidelines, structured evaluation emphasizes a learner-centered approach with specialty- and procedure-specific assessment tools of operative performance that are also applicable to video-based learning. Thus, we believe that the structured videos might help the audience to have more cooperation with the surgical procedure while watching the videos.
In CVS evaluation, it was detected that palpation of the tumor and exploration for other pathologies were performed in 16% of the videos. We believe that palpation of the tumor and exploration for other pathologies will prevent unsuitable operation in conditions such as pleuritis carcinomatosa even if preoperative radiological planning is performed. Visualization of all veins before transection is crucial in evaluating vein variations and preventing vascular injuries. In a study about how to apply VATS lobectomy training, Zwischenberger et al. stated that proper visualization of the hilar region and dissection of all veins may provide safe artery dissection, which is in the next stage. 12 In our study, it was determined that all veins were visualized in 16% of the videos. This is insufficient to reduce the unexpected situations that trainees may encounter. Identification of pulmonary arteries was claimed by Jensen et al. 5 to be the most important part of the surgery since pulmonary arteries are the cause of intraoperative bleeding in majority of the cases. As our results showed, in 96% of the videos, pulmonary arteries were identified, which supports the idea that surgeons are aware of the importance. The ventilation test before transection of the bronchus is an important step in preventing transection of the wrong bronchus. This process was applied only in 24% of the videos in our study. Application of an air leak test after transection of the bronchus prevents unexpected bronchus fistulas. This step was applied in 52% of the videos. We believe that trainees who decided to apply a VATS lobectomy after watching these videos would be misled. Although there is no standardized lymph node dissection technique, it is very important in surgical staging of lung cancer, and a proper lymph node dissection method is mentioned to facilitate dissection of hilar structures. 15 Lymph node dissection has been performed in only 56% of the videos. We believe that this may complicate the safe dissection of existing hilar structures and mislead the trainees who will perform the tumor surgery.
De'Angelis et al. 16 detected that trainees found YouTube videos more educationally useful than senior surgeons. This has been attributed to their inadequate experience and low capacity in surgical technical evaluation. In the same study, a statistically positive correlation was determined between the percentage of conformity to LAP-VEGaS and number of likes and dislikes. In a recent study, there was no statistically significant correlation between the percentage of conformity to LAP-VEGaS and any other parameter. Rodriguez et al. 17 emphasized that the videos presented suboptimal technique with frequent potentially dangerous safety violations in a study evaluating top 10 laparoscopic cholecystectomy videos.
Chen et al. 6 have evaluated the most viewed pulmonary lobectomy videos on YouTube and determined a significant correlation between author's h-index and number of visualizations. In our study, we determined a significant correlation between the h-index and number of likes.
There are some limitations to this study. We analyzed VATS lobectomy videos on YouTube only. It is unknown how many members of the audience were thoracic surgery trainees or seniors. Second, the popularity of the video is associated with items such as the number of views, like–dislike, and comments; however, the author's uploading reason may not be for educational purposes, but for promotional videos for the surgeon or hospital. Third, the live surgery time for videothoracoscopic lobectomy is known to be around 2–3 hours. However, the mean time of the videos in our study is 11 minutes. Since the long procedures are edited and condensed into 10–20-minute videos, a major part of the surgery can be accepted as missing. This might be one of the reasons that the educational value of the videos appears to be low when measured with our assessment methods. We evaluated the videos according to their conformity to LAP-VEGaS and CVS and those methods of measurement should be improved.
Conclusions
Videos of VATS lobectomy may have a great potential to improve surgical opinion. There are various video-sharing websites. As the most popular resource of free public domain videos, YouTube is user driven and these videos are not peer reviewed. Adherence to the CVS and conformity to LAP-VEGaS were low and this article showed issues concerning safety violations. We believe that professional societies should focus on promoting and disseminating valuable educational videos.
Ethical Statement
The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Footnotes
Disclosure Statement
No competing financial interests exist.
Funding Information
No funding was received for this article.
