Abstract
Whereas reproducibility of studies is a prerequisite for trustworthy deep learning (DL) in veterinary histopathology and microscopy, the actual degree of methodological transparency that exists in the literature remains uncertain. We performed a Preferred Reporting Items for Systematic Reviews and Meta-Analyses-guided systematic review to quantify the degree to which supervised DL and supervised machine learning studies report reproducibility-critical details. Using a veterinary-journal-restricted Boolean search executed in PubMed and Scopus, we screened 180 unique records and included 50 primary research articles for full-text analysis. Based on a recently published guideline for the development of DL models in veterinary pathology, we extracted information for each study across 5 dimensions: (1) study and task characterization, (2) data transparency, (3) experimental design and data-leakage control, (4) model and training details, and (5) performance evaluation and reporting. Among the included studies, private data sets predominated, with 90% of studies relying on private data. Sharing of code was uncommon (3%). Key training details such as augmentation and hyperparameters were often incompletely reported; augmentation was not reported in 56% of studies, and key hyperparameters were absent in 40% of studies. It was often not clear whether patient-level stratification (necessary to avoid data leakage) was performed. In summary, these results highlight major deficits in the reporting of details and experimental design necessary for reproducing DL results in veterinary histopathology. This review provides a practical baseline and reporting roadmap to support more transparent and reproducible research in veterinary computational pathology.
Keywords
Get full access to this article
View all access options for this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
