Abstract
Enteric illness contributes to a significant burden of illness in Canada and globally. Understanding its sources is a critical step in identifying and preventing health risks. Expert elicitation is a powerful tool, used previously, to obtain information about enteric illness source attribution where information is difficult or expensive to obtain. Thirty-one experts estimated transmission of 28 pathogens via major transmission routes (foodborne, waterborne, animal contact, person-to-person, and other) at the point of consumption. The elicitation consisted of a (snowball) recruitment phase; administration of a pre-survey to collect background information, an introductory webinar, an elicitation survey, a 1-day discussion, survey readministration, and a feedback exercise, and surveys were administered online. Experts were prompted to quantify changes in contamination at the point of entry into the kitchen versus point of consumption. Estimates were combined via triangular probability distributions, and medians and 90% credible-interval estimates were produced. Transmission was attributed primarily to food for Bacillus cereus, Clostridium perfringens, Cyclospora cayetanensis, Trichinella spp., all three Vibrio spp. categories explored, and Yersinia enterocolitica. Multisource pathogens (e.g., transmitted commonly through both water and food) such as Campylobacter spp., four Escherichia coli categories, Listeria monocytogenes, Salmonella spp., and Staphylococcus aureus were also estimated as mostly foodborne. Water was the primary pathway for Giardia spp. and Cryptosporidium spp., and person-to-person transmission dominated for six enteric viruses and Shigella spp. Consideration of the point of attribution highlighted the importance of food handling and cross-contamination in the transmission pathway. This study provides source attribution estimates of enteric illness for Canada, considering all possible transmission routes. Further research is necessary to improve our understanding of poorly characterized pathogens such as sapovirus and E. coli subgroups in Canada.
Introduction
E
Because enteric illnesses are not solely foodborne (Pires, 2013), it is important to focus on the whole spectrum of enteric disease transmission to inform prevention. As part of burden of illness and source attribution work of the Public Health Agency of Canada (PHAC), an expert elicitation to attribute enteric diseases to their respective transmission routes in Canada was completed. This study aims to improve the understanding of the relative role of transmission pathways in the burden of enteric illness, focusing on 28 pathogens of public health importance in Canada (Thomas et al., 2013). A secondary objective was to consider the role of cross-contamination in the kitchen, through consideration of attribution at the point of entry into the kitchen versus contamination at the point of consumption. These estimates can be used to guide future research and surveillance efforts.
Materials and Methods
A 6-stage expert elicitation was designed to produce source attribution estimates for 28 enteric pathogens. This included the following: recruitment, pre-survey administration, an introductory webinar, elicitation survey administration, a 1-day discussion, readministration of elicitation survey, and a feedback exercise. The pre-survey and elicitation surveys were modeled after previous expert elicitations of enteric illness (Hoffmann et al., 2006; Ravel et al., 2010; Davidson et al., 2011; Vally et al., 2014), and administered via an online survey platform (FluidSurveys:
The study occurred between January and April 2014. Ethics approval was granted by Health Canada and PHAC's Research Ethics Board on January 13, 2014 (REB 2013-0033).
Recruitment
Snowball recruitment was used to form the expert panel (Garabed et al., 2009). A seed panel of Canadian experts in the areas of food safety, water safety, epidemiology, and surveillance was asked to nominate peers with relevant Canadian expertise. These peers were then asked to nominate additional experts for the panel. Nominated experts were assessed by the study team to ensure representative expertise.
Pre-survey
An online pre-survey was administered from January 20 to February 25, 2014 to collect background information about experts (Supplementary Appendix A1; Supplementary Data are available online at
Webinar
An introductory webinar was presented to experts over 2 weeks in February 2014. Background project information and definitions for transmission routes and point of attribution were provided (Supplementary Appendix A2; Supplementary Tables A1 and A2). The survey tool and a worked example for the survey tool were provided.
Survey tool
For each pathogen, experts were asked to consider, for 100 domestically acquired cases, how many cases are attributed to each transmission route. The survey prompted experts to produce estimates adding up to 100 across the major transmission routes and 5th and 95th percentiles around those estimates, and to rank their confidence from 1 (low) to 5 (high) for each estimate. Experts were asked if and how their estimates would change if they considered contamination at the kitchen door (i.e., as food or pathogens enter the residential or commercial kitchen) versus at the point of consumption (e.g., of contaminated food or water) (Havelaar et al., 2008). Experts were then prompted to estimate the proportion of cases attributed to a number of foodborne, waterborne, and animal contact transmission subcategories (Butler et al., unpublished data). A sample survey page is presented in Supplementary Appendix A3.
The survey was open from February 17 to March 17, 2014.
Discussion
Results from the first round of the survey were shared with participants, who were invited to attend a subsequent 1-day discussion on March 20, 2014. At the meeting, preliminary results were reviewed by pathogen and unexpected/unusual results and clusters were discussed.
Survey readministration
Experts were provided with a summary of the March 20 meeting and points of clarification for issues identified during the discussion, and were asked to consider this new information when revising their estimates. The survey was reopened March 27–April 22, 2014.
Data analysis
Descriptive statistics were performed on the information collected in the pre-survey. Responses were excluded where experts ranked confidence in their estimates at 1/5 (threshold model); sensitivity analysis of the threshold model versus the complete model (all responses) was performed using Kruskal–Wallis (K-W) tests, which are useful for non-normal data and small sample sizes (Meyer and Seaman, 2013). Spearman's rank correlation was used to test for correlation between parameters. Clustering was explored simultaneously across major transmission routes by pathogen using Ward's minimum-variance method (described in Supplementary Appendix A4). Statistical tests were performed using SAS (SAS 9.3; SAS Institute, Inc., Cary, NC).
Triangular probability distributions were built using @Risk software (Version 6.1.2; Palisade Corporation, Newfield, NY) from best estimate (most likely) and 5th and 95th percentile values from individual estimates, and were combined into cumulative distributions, using Monte Carlo simulation with 10,000 iterations. Akaike's Information Criterion was used to test for the best-fit cumulative probability distribution. Median values and 90% CrI were calculated from these cumulative distributions; medians are presented as they are less influenced by outliers.
Results
Recruitment
Thirty-two experts completed the elicitation survey, and 16 participated in the discussion. Responses for one expert were removed because the survey responses were incorrectly entered and they were unavailable for follow-up. Details of recruitment and expert panel composition are presented in Supplementary Appendix A5.
Overview of responses
Two pathogens (Vibrio cholerae and Salmonella Typhi) were initially included but eliminated from the final phase due to inability of experts to estimate relative contributions of the various transmission pathways. The mean number of experts assigned to each pathogen was 10.3 (range: 5 for sapovirus to 15 for Salmonella spp., nontyphoidal). Mean self-reported expertise ranged from 2.0 for adenovirus to 4.8 for Campylobacter spp. (mean=3.4). Experts' average confidence in their estimates ranged from 2.2 for Vibrio spp., other to 4.1 for Trichinella spp. (mean=3.2). Overall, confidence was higher in pathogens for which more responses were provided; however, there was no significant correlation found between experts' ranked confidence or expertise and the number of respondents (|R|<0.8). The threshold model excludes estimates with a confidence of 1/5 (20/286; 7%), and was adopted on the belief that low-confidence estimates are less likely to represent true values or appropriate confidence intervals. K-W tests showed no significant difference in best estimates between the threshold and complete models (p>0.05). Between 4 and 15 major transmission route estimates per pathogen were included in the final analysis. Correlation between CrI widths and estimate confidence ranking was only significant for foodborne transmission of B. cereus (R=–0.86, p=0.03).
For 40/287 (14%) estimates, experts initially provided incorrect CIs; they were asked to adjust their estimates to include their best estimate.
Revision of responses
Following the discussion meeting, 26/31 (84%) experts revised at least 1 of their estimates. After survey readministration, 71/287 (25%) major transmission route estimates were revised with 0–5 revisions per pathogen. No significant difference was observed between round 1 and round 2 best estimates (K-W tests, food: p=0.6; water: p=0.3; animal: p=0.7; person-to-person: p=0.9; other: p=0.8). Uncertainty, measured from 90% CrI of cumulative distributions, decreased slightly (mean: −0.4; range: −2.1 to 1.1).
Clustering
Significant clustering was observed for Clostridium botulinum and V. vulnificus. On the basis of biological plausibility, the larger clusters of C. botulinum (n=8) and V. vulnificus (n=7) are considered the most appropriate estimates (Supplementary Figs. A1 and A2). Evidence of clustering for astrovirus and sapovirus was discarded based on nonsignificant differences between distributions across clusters (Supplementary Figs. A3 and A4). Further detail is available in Supplementary Appendix A4.
Estimates of major transmission route attribution
Cumulative estimates for the attribution of 28 pathogens for the 5 major transmission routes are presented in Table 1. Figures 1 –4 present the median best estimates and 90% CrI of the 4 transmission routes for each pathogen. The 90% CrI widths (Table 1) varied from 0 to 76 cases per 100 domestic cases.

Box-and-whisker plot of median proportion of transmission via major transmission routes attributed to foodborne transmission for each of 28 pathogens, populated from cumulative probability distributions. The box limits represent 2nd and 3rd quartiles, with whiskers to the 5th and 95th percentile values; diamonds (♦) represent mean values. ETEC, enterotoxigenic Escherichia coli; VTEC, verotoxin-producing E. coli.

Box-and-whisker plot of median proportion of transmission via major transmission routes attributed to waterborne transmission for each of 28 pathogens, populated from cumulative probability distributions. The box limits represent 2nd and 3rd quartiles, with whiskers to the 5th and 95th percentile values; diamonds (♦) represent mean values. ETEC, enterotoxigenic Escherichia coli; VTEC, verotoxin-producing E. coli.

Box-and-whisker plot of median proportion of transmission via major transmission routes attributed to animal contact transmission for each of 28 pathogens, populated from cumulative probability distributions. The box limits represent 2nd and 3rd quartiles, with whiskers to the 5th and 95th percentile values; diamonds (♦) represent mean values. ETEC, enterotoxigenic Escherichia coli; VTEC, verotoxin-producing E. coli.

Box-and-whisker plot of median proportion of transmission via major transmission routes attributed to person-to-person transmission for each of 28 pathogens, populated from cumulative probability distributions. The box limits represent 2nd and 3rd quartiles, with whiskers to the 5th and 95th percentile values; diamonds (♦) represent mean values. ETEC, enterotoxigenic Escherichia coli; VTEC, verotoxin-producing E. coli.
For Clostridium botulinum and Vibrio vulnificus, median and credible intervals are reported for the pathogen as a whole and for each cluster.
“Cluster 1,” the larger cluster, is the most appropriate set of estimates to use for both Clostridium botulinum and Vibrio vulnificus, based on biological plausibility of enteric infection. Text presented in gray for pathogen as a whole and for Cluster 2 for C. botulinum and V. vulnificus are presented only for comparison and should be disregarded in interpreting these estimates.
ETEC, enterotoxigenic Escherichia coli (E. coli); VTEC non-O157, verotoxin-producing E. coli (VTEC) non-O157; VTEC O157, verotoxin-producing E. coli (VTEC) O157.
B. cereus, C. perfringens, Cyclospora cayetanensis, Trichinella spp., all 3 Vibrio spp., and Yersinia enterocolitica were mainly attributed to foodborne transmission (>80%). For Campylobacter spp., all 4 Escherichia coli categories, Listeria monocytogenes, Salmonella spp., nontyphoidal and Staphylococcus aureus, foodborne transmission remained the main route, but additional routes were also implicated (e.g., Campylobacter spp.: 62.3% foodborne, 15.9% animal contact), illustrating the complexity of enteric disease transmission. Waterborne transmission was the dominant route estimated for Cryptosporidium spp. and Giardia spp. Animal contact was the dominant route estimated for Brucella spp. and Toxoplasma gondii. Person-to-person transmission was the main route for all six viruses and Shigella spp. Up to 10% of transmission was attributed to “other” routes, suggesting that the four major transmission routes captured (nearly) all enteric transmission.
Experts demonstrated the most uncertainty in producing estimates of Cryptosporidium spp., E. coli (other), enterotoxigenic E. coli (ETEC), hepatitis A, and T. gondii, as measured by CrI width, and higher uncertainty in producing CrI for foodborne transmission versus other routes.
Kitchen-door estimates
For 18/28 pathogens, 1–9 experts indicated that their estimates would change if they were to consider attribution at the point of entry into the kitchen (kitchen door) compared to point of consumption. Median and 90% CrI were calculated from those who provided kitchen-door estimates and were compared against the point of consumption estimates for the same experts. No kitchen-door estimates were provided for adenovirus, B. cereus, C. botulinum, L. monocytogenes, T. gondii, Trichinella spp., all three Vibrio spp. categories, and Yersinia enterocolitica, and only one estimate was provided for astrovirus, Brucella spp., and C. perfringens.
The majority of the shift in attribution from point of consumption to kitchen door occurs between foodborne and person-to-person transmission. Change in attribution ranged from −7.0 to +56.8 cases for foodborne and −55.7 to +6.8 for person-to-person transmission, measured as the increase in median estimates at point of consumption, compared to kitchen door, where more than 1 estimate was provided. The number of cases attributed to the foodborne route was greater at the point of consumption than the kitchen door for S. aureus (+56.8, n=6), hepatitis A (+23.3, n=5), ETEC (+22.3, n=3), C. cayetanensis (+15.7, n=2), Shigella spp. (+15.4, n=9), and sapovirus (+12.8, n=2) with concomitant decreases in person-to-person transmission at point of consumption compared with at the kitchen door. Smaller shifts were observed for waterborne (−4.2 to +7.2) and animal contact (−2.7 to +7.0) transmission between the two points of attribution.
Discussion
This expert elicitation aimed to improve the understanding of source attribution of enteric illness for 28 pathogens of public health importance in Canada (FoodNet Canada, 2013). There is limited information in the literature to attribute illness to sources and transmission routes for many of the explored pathogens in Canada.
There is geographic variation in the relative exposure to risk factors within and between countries for a variety of reasons including landscape, climate, environmental factors such as land use, and demographic differences. Examples include cooler average water temperatures in Canada compared to the United States, or dietary risk factors such as raw milk, which is legal in parts of the United States but not in Canada (Health Canada, 2014). Disease rates also vary across countries (e.g., campylobacteriosis incidence in 2012 was 29.3 per 100,000 in Canada [Public Health Agency of Canada, 2014] compared to 14.2 in the United States [CDC, 2014], 101.5 in Australia [Department of Health and Ageing, 2014] and 158.6 in New Zealand [Institute of Environmental Science and Research Ltd., 2013]). This highlights the importance of undertaking source attribution research specific to Canada.
This study was the first to use expert elicitation to attribute such a wide range of pathogens across several major transmission routes. A review of the literature examining similar pathogens and transmission routes using expert elicitation (Table 2) demonstrates convergence of foodborne estimates, despite study location and year of publication, for many pathogens (Cressey and Lake, 2005; Havelaar et al., 2008; Ravel et al., 2010; Scallan et al., 2011; Vally et al., 2014). For example, the current study attributes 99% of B. cereus to food, compared to 90% in the Netherlands, 100% in the United States, and 97% in New Zealand (Table 2).
Current study.
Ravel et al. (2010).
Vally et al. (2014).
Havelaar et al. (2008).
Scallan et al. (2011).
Cressey and Lake (2005).
Various: reviews, outbreak reports, case–control studies.
Bacillus cereus, Clostridium botulinum, C. perfringens, ETEC, and Staphylococcus aureus described as “foodborne” in Scallan et al. (2011).
Bimodal distributions (clustering) were observed for select pathogens in the previous Canadian elicitation.
EE, expert elicitation; ETEC, enterotoxigenic Escherichia coli; VTEC non-O157, verotoxin-producing E. coli (VTEC) non-O157; VTEC O157, verotoxin-producing E. coli O157.
The previous Canadian expert elicitation produced estimates of foodborne transmission for 9 of the 28 pathogens explored in this study (Ravel et al., 2010). Mean and median estimates between Ravel et al. (2010) and the current study were similar for Cryptosporidium spp. and Campylobacter spp. (Table 2), and for clusters of L. monocytogenes (previous: 84, current: 76.5) and Y. enterocolitica (previous: 80, current: 82.8). Estimates for Vibrio spp. were also similar, but categorization for Vibrio (V. parahaemolyticus, V. vulnificus, and Vibrio spp., other) differed. Categorizations of E. coli species also varied between the two studies.
Clustering occurred for four pathogens, and in all cases, it is clear which cluster of data should be considered appropriate for the final estimates for these pathogens. For both astrovirus and sapovirus, clustering is assumed to be an artifact of the small number of estimates (five and four responses, respectively; see Supplementary Figs. A3 and A4, Appendix A4). For astrovirus, sapovirus, Brucella spp., Trichinella spp., and the Vibrio spp., experts reported difficulty in providing estimates due to low disease incidence in Canada.
Clustering for C. botulinum may have resulted from experts incorrectly considering wound infection (via water) and intravenous drug use. These routes are nonenteric and thus excluded from our analysis. Infant botulism was also mentioned by experts in the smaller cluster. Wound botulism, while an increasingly important transmission pathway in the United States (Sobel, 2005), has never been reported in Canada. Wound infection with V. vulnificus is plausible, but is a nonenteric route (Bross et al., 2007).
Inclusion of the meeting between the initial and second rounds of the survey allowed for the opportunity to explore sources of disagreement and potential misinterpretation of study questions. A discussion session was also employed in the Australian elicitation (Vally et al., 2014). During the meeting and in the survey tool, experts were encouraged to provide comments to substantiate their attribution estimates, which were critical for contextualizing findings. The meeting also provided an opportunity to clarify study definitions. For example, the role of congenital infection in transmission of L. monocytogenes and T. gondii was discussed. In the second survey round, experts were asked to exclude congenital (vertical) transmission from their estimates.
Comparatively few (66 compared to 287; 23%) estimates were provided for kitchen-door attribution. Experts indicated difficulty estimating these values related to question wording, survey fatigue, or a combination of multiple factors. The shifts in attribution from point of consumption to kitchen door illustrate the importance of contamination by food handlers, especially for S. aureus, with the largest increase in foodborne attribution at point of consumption. This shift is biologically plausible; however, the magnitude of these shifts is highly uncertain. The role of cross-contamination and food handling merits further exploration.
The relative contribution of the vehicle versus contamination along the transmission pathway is an important consideration for source attribution. Along the farm-to-fork continuum, there are many factors that influence transmission of pathogens: contaminated irrigation water (Lynch et al., 2009), contamination of carcasses with fecal matter in abattoirs (Nørrung and Buncic, 2008; Rekow et al., 2011), poor adherence to temperature control (Huss et al., 2000; Lynch et al., 2009), and adaptation of pathogens to food processing and antimicrobials (Davidson and Harrison, 2002). Cross-contamination in the kitchen and improper food storage and handling (Papadopoulos et al., 2013) all potentially play a role in human illness (Pires et al., 2009, 2014). Focusing on different points along the continuum will help to inform more specific policy questions and intervention options.
Limitations
This elicitation was designed to include experts from the public sector, the private sector, and academia; however, the experts were largely from Canadian government organizations (local, provincial, and federal). Fewer experts from academia and industry were nominated by peers. It was difficult to find experts who possess an understanding of the broader nature of enteric illness transmission. Despite the inherent difficulty of this approach, 4 to 15 responses per pathogen were elicited.
The results from this study can be used to highlight vulnerabilities to human illness, inform future burden-of-illness studies, and inform food safety policy and research prioritization. Uncertainty in the estimates provided by the expert panel identified key knowledge gaps.
Conclusions
This article presents the results of an expert elicitation of enteric illness to explore the major transmission routes for 28 pathogens. Expert elicitation is a powerful tool for highlighting uncertainty and producing attribution estimates by pathogen, transmission vehicle, or route. Previous source attribution studies in Canada, the United States, the Netherlands, Australia, and New Zealand have used expert elicitation to understand foodborne transmission. This study explored a broader range of transmission routes (food, water, animal contact, person-to-person, and other) to reflect the spectrum of potential exposures, for a wider range of pathogens than any previous study in Canada or internationally. The results from this study reflect previous findings for some pathogens, while highlighting the continued uncertainty in how viruses are transmitted.
Footnotes
Acknowledgments
The authors would like to acknowledge Phillip Schmidt (University of Waterloo) and Eddie Ma (University of Guelph) for their contributions to implementing the pathogen selection algorithm. The researchers would like to thank all experts for their participation and engagement with this elicitation study. This research has been conducted under an Natural Sciences and Engineering Research Council of Canada (NSERC
Disclosure Statement
No competing financial interests exist.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
