Abstract
The objectives of this study were to compare the performance of different diagnostic protocols (rectoanal mucosal swabs and immunomagnetic separation [RAMS-IMS], fecal samples and IMS [fecal-IMS], and direct plating) to determine the prevalence of Escherichia coli O157:H7 and to evaluate the pattern of E. coli O157:H7 shedding and super-shedding (defined as having a direct plating count equal to or >104 colony forming units of E. coli O157:H7 per gram of feces) in a longitudinal study of naturally infected feedlot steers. RAMS and fecal grab samples were obtained at 14-day intervals from 168 Angus-cross beef steers over a period of 22 weeks. Fecal samples were assessed by direct plating and IMS, whereas RAMS were tested only by enrichment followed by IMS to recover E. coli O157:H7. The period prevalence for shedding was high (62%) among feedlot steers and super-shedding was higher (23%) than anticipated. Although direct plating was the least sensitive method to detect E. coli O157:H7-positive samples, over 20% of high bacterial load samples were not detected by RAMS-IMS and/or fecal-IMS. The sensitivity of RAMS-IMS, fecal-IMS, and direct plating protocols was estimated using simple and multilevel mixed-effects logistic regression models, in which the dependent variable was the dichotomous results of each test and gold standard (i.e., parallel interpretation of the three protocols)-positive individuals were included as an independent variable along with other factors such as dietary supplements, time of sampling, and being exposed to a super-shedding pen-mate. The associations between these factors and the sensitivity of the diagnostic protocols were not statistically significant. In conclusion, differences in the reported impact of diet and probiotics on the shedding of E. coli O157:H7 in previous studies using RAMS-IMS or fecal-IMS were unlikely due to their impact on test performance.
Introduction
It has been proposed that fecal shedding may be either transient (Faith et al., 1996; Paiba et al., 2003; Robinson et al., 2004), where cattle shed the pathogen briefly after exposure, or more long term, resulting from colonization of the gastrointestinal tract and, more precisely, the rectoanal mucosal junction (Naylor et al., 2003). Experimental studies have shown that colonization at the rectoanal mucosal junction is related to excretion of high levels of E. coli O157 in feces (Naylor et al., 2003; Low et al., 2005). Those animals that shed E. coli O157 at much higher concentrations than others have been called high-shedders or super-shedders (Low et al., 2005; Matthews et al., 2006a; Cobbold et al., 2007). Recently, Chase-Topping et al. (2008), on the basis of the available evidence, proposed a working definition of an E. coli O157 super-shedder as an animal that excretes >104 colony forming units (CFU) per gram of feces. Super-shedders are purported to have a substantial impact on the on-farm epidemiology of E. coli O157:H7, because while they constitute a small proportion of cattle, it has been estimated that they may be responsible for >80% to 96% of the E. coli O157:H7 bacteria shed by cattle (Omikasin et al., 2003; Matthews et al., 2006b). However, many of the studies that have addressed the super-shedder concept have based their definitions and prevalence estimates on cross-sectional studies and/or simulation models (Omikasin et al., 2003; Fegan et al., 2004; Matthews et al., 2006a).
Culture methods to detect fecal shedding typically involve the use of an immunomagnetic separation (IMS) technique, an isolation procedure that includes an enrichment broth and the use of selective and differential media followed by molecular or biochemical methods for confirmation purposes. Rice and collaborators (2003), drawing on the observation that E. coli O157:H7 specifically colonizes the lymphoid follicle-dense mucosal epithelium at the terminal rectum, developed a rectoanal mucosal swab (RAMS) technique that involves sampling the mucosal surface of the rectoanal junction along with IMS to improve test performance. Different studies have arrived at different conclusions concerning the relative sensitivity of fecal-IMS and RAMS-IMS procedures for detecting the carriage of E. coli O157:H7 in cattle (Rice et al., 2003; Greenquist et al., 2005; Khaitsa et al., 2005; Fox et al., 2008; Niu et al., 2008). Rice et al.'s study (2003) suggested that the culture of swabs from the rectoanal junction mucosa was, in almost all cases, as sensitive as and usually more sensitive than culture of feces at detecting E. coli O157:H7 in cattle. However, fecal cultures were more sensitive than RAMS cultures at detecting E. coli O157:H7 initially after artificial exposure to E. coli O157:H7, which may indicate that RAMS appears to delineate colonized from transiently shedding cattle. Similarly, studies performed by Greenquist et al. (2005) and Fox et al. (2008) concluded that mucosal swab sampling was more sensitive than fecal sampling for determining the prevalence of E. coli O157 in feedlot cattle. Conversely, according to Khaitsa et al. (2005) and Niu et al. (2008) fecal sampling appears to be superior to RAMS for detection of E. coli O157:H7, although labor and animal restraint requirements for fecal collection were higher than those for the RAMS technique. Factors such as the type of study design (longitudinal vs. cross-sectional), the use of artificial versus naturally infected animals, the type of cattle production system targeted, and the existence of multiple different testing procedures pose problems when comparing test results from different studies. Further, previous results indicated that different dietary supplements affect the probability of testing positive to E. coli O157:H7 depending on the testing procedure (i.e., RAMS-IMS vs. fecal-IMS) (Cernicchiaro et al., 2010). However, it was unclear if the differences were due to the impact these factors have on the biology of E. coli O157:H7 in feces and RAMS, or on test performance.
The objectives of our study were the following: (i) to compare the performance of RAMS-IMS, fecal-IMS, and direct plating tests to determine the prevalence of E. coli O157:H7 in feedlot steers; (ii) to compare the level of agreement among RAMS-IMS, fecal-IMS, and direct plating at the animal and sample levels; (iii) to evaluate the impact of diet, time of sampling, and being exposed to a super-shedding pen-mate on the performance of these tests; and (iv) to determine the sensitivity of these procedures to detect super-shedding animals from a longitudinal study of naturally infected feedlot steers.
Materials and Methods
Details on study population, sampling procedures, and laboratory protocols used in this study have been described elsewhere (Cernicchiaro et al., 2010). Briefly, 168 Angus-cross beef steers, initially weighing 250 to 340 kg, were introduced on October 5 and on November 2, 2005, into the beef feedlot facility located at the Ohio Agricultural Research and Development Center in Wooster, Ohio. Approximately 75% of cattle were supplied by stocker farms that usually provide calves to be finished in this research facility. The remaining 25% was provided by an Ohio cattle buyer. After acclimation of the animals to the facility, the trial began on November 21, 2005, and was conducted over a period of 22 weeks until April 25, 2006.
From each animal, one RAMS and at least 10 g of fecal grab samples were collected at 14-day intervals throughout the finishing period. RAMS samples were obtained by swabbing the rectoanal mucosa of each animal with a dry cotton-tipped 15-cm cleaning stick as described elsewhere (Rice et al., 2003; Khaitsa et al., 2005). Immediately after swabbing, rectal fecal grabs were obtained using a new disposable sleeve glove for each animal. Samples were transported within 1 hour after sampling to the Food Animal Health Research Program Laboratory in Wooster, Ohio.
For enumeration of colonies, a technique developed by LeJeune et al. (2006) based on Sorbitol MacConkey agar (SMAC) with nalidixic acid was employed in our study. Briefly, 10 g of fecal grab samples were homogenized in 90 mL of buffered peptone water (BPW) to make a 10−1 dilution. Using 96-well plates containing 1 mL BPW, serial dilutions were made starting with the 10−1 dilution aliquot up to 10−3. A 100-μL sample of each 10−3 dilution was spread-plated onto a 100 × 15 mm sorbitol MacConkey agar plate (CT-SMAC) containing cefixime (50 ng/mL) and potassium tellurite (2.5 μg/mL). Plates were incubated at 37°C for 18 h. The CT-SMAC plates were screened for colorless colony growth and plates were enumerated. A latex agglutination assay was used on up to 10 representative sorbitol-negative suspect colonies to confirm the O157 antigen (Oxoid Ltd., Nepean, Canada). The number of sorbitol-negative colonies was multiplied by the fraction of latex-positive colonies and the fecal dilution to estimate the number of E. coli O157 colonies present in each gram of feces.
The rest of the homogenate from the fecal grab samples and the RAMS suspended in BPW were enriched overnight at 42°C and processed by an IMS technique following the manufacturer's recommendations (Invitrogen Dynal A.S., Oslo, Norway). After automatic IMS, samples were plated onto CT-SMAC plates containing cefiximine (50 μL/mL) and potassium tellurite (2.5 mg/mL), and plates were incubated at 37°C for 24 h. Using sterile toothpicks, up to 5 colonies from IMS CT-SMAC plates were transferred to 96-well plates containing 180-μL of E. coli 4-methylumbelliferyl-β-D-glucuronide (EC Mug; EC media: Neogen-Acumedia Manufacturers Inc., Lansing, MI; MUG: Biosynth AG, Staad, Switzerland) agar. On each plate, one well was inoculated as a positive control and one well was inoculated for a negative control. Plates were incubated at 37°C for 24 h. The EC MUG fluorescence of 96-well plates was screened and colonies were transferred, using a 96-well replicator, to 150 × 15 mm MAC plates. A latex agglutination assay was used to confirm the presence of the O157 antigen of lactose-positive, MUG-negative colonies.
Descriptive statistics
The period prevalence of E. coli O157:H7 at the sample level was estimated as the proportion of samples testing positive by a particular diagnostic protocol (RAMS-IMS, fecal-IMS, or direct plating) divided by the total number of samples tested for that specific protocol. Period prevalence of E. coli O157:H7 at the animal level was determined as the proportion of steers testing positive at least once by a particular diagnostic protocol divided by the total number of cattle tested by that protocol. Further, pen period prevalence of E. coli O157:H7 was estimated as the proportion of samples testing positive in each pen divided by the total number of samples tested per pen throughout the entire study. In addition, these prevalences were also estimated based on a parallel interpretation of the protocols where a positive sample, animal, or pen was based on a positive result from any protocol.
Duration of shedding was estimated by determining the number of sampling dates (bi-weekly intervals) between the first and last consecutive sample visits that yielded E. coli O157-positive samples detected by the different diagnostic protocols.
Comparison of diagnostic protocols
The Cohen's kappa statistic (Cohen, 1960), McNemar's Chi-square test (McNemar, 1947), and prevalence-adjusted bias-adjusted kappa (PABAK) (Byrt et al., 1993; Mak et al., 2004) were estimated to assess the overall agreement beyond chance on the presence or absence of E. coli O157:H7 in fecal samples at the sample and animal levels by pair-wise comparison of the proportion of positives detected by the three diagnostic protocols.
The kappa statistic is biased if the prevalence of the outcome is very low or very high (outside 20% to 80%), or McNemar's indicates that the proportions between two tests are different (Zwick, 1988; Feinstein and Cicchetti, 1990; Dohoo et al., 2009). However, to date, the use of alternatives to kappa is uncommon in the veterinary literature (Petersen et al., 2004; Thomsen and Baadsgaard, 2006). PABAK was developed to adjust the measures of agreement by the potential effect of prevalence and bias; thus, if in fact the prevalence is impacting kappa or there is bias on the measurements, PABAK will reflect a less-biased estimate of agreement than kappa. In addition, relatively large differences between kappa and PABAK estimates indicate that there was in fact evidence of bias in the agreement.
The degree of agreement was interpreted based on the following scale, originally intended for subjective levels of agreement, described by Landis and Koch (1977): ≤0, poor agreement; 0.01–0.20, slight agreement; 0.21–0.40, fair agreement; 0.41–0.60, moderate agreement; 0.61–0.80, substantial agreement; and 0.81–1.00, almost perfect agreement.
To estimate the relative sensitivities of the different diagnostic protocols, we considered being positive to at least one protocol our gold standard, as the interpretation of the three protocols in parallel would increase the sensitivity of detection. Relative sensitivity for each of the three diagnostic protocols was estimated at the sample and animal levels as the proportion of samples, or animals, testing positive for each protocol divided by the number of samples, or animals, testing positive by at least one of these protocols (parallel interpretation of tests). Further, the specificity of all protocols at the sample and animal level was treated as 100%, assuming that no false-positives can arise from fecal culture-based tests.
Direct plating results and E. coli O157:H7 super-shedders
Positive direct plating results were quantified and the amount of bacteria was expressed as the number of CFU/g of feces. Super-shedders were defined as those animals producing counts of 104 CFU of E. coli O157:H7 per gram of feces or higher by direct plating onto CT-SMAC plates, in accordance to the working definition of Chase-Topping et al. (2008). In addition, to determine the ability of the RAMS-IMS and fecal-IMS protocols to detect super-shedding events, as defined by the direct plating method, the results of these two protocols were compared to the direct plating test at the sample and animal levels and the Cohen's kappa statistic, McNemar's Chi-square test, and PABAK were estimated.
Estimation of sensitivity of diagnostic protocols using logistic regression models
To determine if the characteristics of the different diagnostic protocols varied with diet, time of sampling, and exposure to a super-shedding pen-mate, the sensitivities of RAMS-IMS, fecal-IMS, and direct plating protocols were estimated using logistic regression models, as proposed by Coughlin et al. (1992) and applied by different authors (Greiner and Gardner, 2000; Lindberg et al., 2001; Dohoo et al., 2009). Time of sampling, measured as the time since the start of the trial in days (range = 0–154 days), was included as an independent variable and modeled on a continuous scale. In addition, the following treatments included in a concurrent study intended to examine the effects of different dietary supplements on the prevalence of E. coli O157:H7 on the same study units (Cernicchiaro et al., 2010) were included in the analysis: two types of corn (high moisture corn vs. dry-whole shelled corn); two natural feed additives (Aspergillus oryzae [Amaferm] vs. Saccharomyces cerevisiae boulardii [Levucell] vs. no supplementation [control group]); and two levels of vitamin A (2200 IU/kg of feed vs. no supplementation). Experimental details on these interventions were described elsewhere (Cernicchiaro et al., 2010). In addition, exposure to a super-shedding animal in the pen was modeled as a dichotomous variable and it was defined as having a super-shedding pen-mate at the specific time of sampling. The actual super-shedder was coded as unexposed if there was no other super-shedder in the same pen on the same sampling date or exposed if another super-shedding animal was present.
On the basis of Coughlin et al.'s approach (1992), estimates of sensitivity and specificity can be derived by including the dichotomous results of the diagnostic test as the dependent variable and the results of the gold standard (true disease status) as an independent variable after adjusting for different covariates. In our study the variable being positive to E. coli O157:H7 by at least one diagnostic protocol was considered our gold standard. In addition, the hierarchical structure of the data can be taken into account in these models by including random effects for each level of clustering (Lindberg et al., 2001; Dohoo et al., 2009).
Baseline observations (time of sampling = 0) were removed from the dataset to perform this analysis because no baseline measurements were available for the fecal-IMS protocols and only one sample was detected positive by direct plating. The interpretation of the three protocols in parallel, our gold standard test, would have primarily reflected the results of the RAMS-IMS protocol, making this reference test not appropriate to estimate the sensitivity of the fecal-IMS and direct plating protocols and likely overestimating the sensitivity of the RAMS-IMS in that particular time period.
Initially, all predictors were examined in a univariable screen. The linearity assumption between the log odds of the different responses and time of sampling was assessed using graphical methods (i.e., lowess smoothing of the logit of the outcome on the continuous predictor). If the assumption was not met, depending on the shape of these relationships, the predictor variable was categorized unless it was more appropriately transformed (e.g., natural logarithm) or modeled with the addition of a quadratic term (Dohoo et al., 2009).
A multivariable main effects model including all predictors was built manually using a backward elimination procedure. One by one, each nonsignificant variable (p > 0.05) was removed from the model to determine their potential confounding effect. A confounding variable was defined as any nonintervening variable that resulted in a 20% or greater change in the coefficient of a statistically significant variable when it was removed from the model (Dohoo et al., 2009). All possible two- and three-way interaction terms were created between all predictors and tested at a 5% significance level by adding them to the model one at a time. Main effects that were part of significant interaction terms (p < 0.05) were retained in the model regardless of their individual significance. After the models were fitted using simple logistic regression models, random effects were added. Multi-level mixed-effects logistic regression models using adaptive quadrature were fitted in Stata 10 (StataCorp LP, College Station, TX) using the “xtmelogit” procedure (Rabe-Hesketh et al., 2002). The random-effects model had a three-level hierarchical structure of samples nested in cattle and of cattle nested within pens. A manual model building approach was employed to fit the following two types of models: (1) multivariable multi-level logistic regression models with random intercepts for pen and animal, and (2) multivariable multi-level logistic regression models with random intercepts for pen and animal and random slope for time of sampling with an unstructured covariance structure. The different models regressed each response variable independently (RAMS-IMS, fecal-IMS, and direct platting) when the results of the gold standard were set to one, to obtain the modeled estimates of sensitivity (Dohoo et al., 2009). Thus, sensitivity was estimated by restricting our analysis to gold standard-positive individuals. For the random-intercept models, intra-class correlation coefficients were computed at the pen and animal levels using a latent-variable technique (Dohoo et al., 2009). Information criteria (Akaike's Information Criterion [AIC] and the Schwarz's Bayesian Information Criterion [BIC]) were employed to compare the models, and the model with the lowest value of these criteria was deemed to be the best fitting model.
The sensitivities of the different diagnostic methods and their respective 95% confidence intervals (CI) were estimated based on the model predictors according to the formula proposed by Coughlin et al. (1992):
Mixed models provide cluster-specific parameters that correspond to values estimated for a particular cluster (in our case, pen and animal random effects), as opposed to population-averaged or marginal estimates (Dohoo et al., 2009). The latter compares the results of a sample being detected positive or negative by a particular diagnostic protocol from any pen and any animal in the study. Therefore, to compare the results of conditional and marginal models employed in our study, which differ in their ability to model the variance of the data, population-averaged parameters were estimated from cluster-specific parameters using the following formula:
Results
Baseline prevalence
On the basis of the RAMS-IMS method, E. coli O157:H7 was isolated from 4.6% (7/153) of the steers during the baseline sampling during the initial weighing of the cattle. For direct plating, only one animal tested positive for E. coli O157:H7 (0.8%, 1/129); the same sample also tested positive by the RAMS-IMS method and was deemed to belong to a super-shedding animal (>104 CFU/g of feces). Unfortunately, because fecal grab samples were not tested by fecal-IMS on the first date of sampling (day 0), baseline prevalence was not available for this protocol.
Overall prevalence estimates of E. coli O157:H7 at the sample, animal, and pen levels
RAMS-IMS and fecal-IMS showed similar capabilities in detecting samples and animals positive to E. coli O157:H7, whereas direct plating was the least sensitive method. Overall, sample period prevalence was 10.3%, 10.7%, 4.1%, and 13.8% for RAMS-IMS, fecal-IMS, direct plating, and by any protocol, respectively. Animal period prevalence was 54.2%, 48.2%, 35.1%, and 61.9% for RAMS-IMS, fecal-IMS, direct plating, and by any protocol, respectively, whereas period prevalence at the pen level was 87.5% for RAMS-IMS and fecal-IMS, 75.2% for direct plating, and 95.8% for any protocol (Table 1).
Estimated as the number of positive samples divided by the total number of samples tested throughout the study period.
Estimated as the number of animals with at least one positive test result throughout the study divided by the total number of animals tested.
Estimated as the number of pens with at least one positive test result throughout the study divided by the total number of pens tested.
Values in each column followed by different letters were significantly different among the three tests being compared (p < 0.05, as determined by a Chi-square test).
RAMS-IMS, rectoanal mucosal swabs-immunomagnetic separation; Fecal-IMS, fecal grabs-immunomagnetic separation; CI, confidence intervals.
At the animal level, prevalence ranged between 0% and 35.1% on any sampling date with a mean of 8.5% of animals shedding E. coli O157:H7 per sample date based on any test. Moreover, 18 animals (11%) showed positive samples on three or more consecutive sampling dates during the study period. The maximum duration of shedding lasted eight consecutive sampling dates based on fecal-IMS testing (n = 1). On the basis of RAMS-IMS, the maximum number of sampling dates with uninterrupted positive results was seven (n = 1), whereas positive samples for four consecutive dates were the maximum number detected by the direct plating method (n = 1). This last animal also tested positive on three of the four sampling dates to both RAMS-IMS and fecal-IMS tests. In contrast, a total of 42 animals had at least one episode of intermittent shedding (two or more positive samples separated by one or more negative samples) within a specific diagnostic protocol throughout the entire feeding period.
At the pen level, 96% (23/24) of pens were considered positive at least once to any protocol throughout the study period. Sample level prevalence by pen, estimated considering all samples collected in each pen during the entire study period, ranged from 0% to 30.9% by RAMS-IMS, 0% to 34.4% by fecal-IMS, and 0% to 17.3% by direct plating. Pen prevalence ranged from 0% to 41.2% by at least one diagnostic protocol. Throughout the entire study period, pens 5, 6, and 22 remained negative based on RAMS-IMS. Pens 5, 22, and 23 did not produce positive results by fecal-IMS, and pens 6, 13, 19, 20, and 22 tested negative by direct plating. All samples from pen 22 remained negative during the study period based on the three diagnostic protocols.
Comparison of diagnostic protocols
The McNemar's Chi-square tests for the comparison between RAMS-IMS versus direct plating and fecal-IMS versus direct plating at the sample and animal levels were statistically significant (p < 0.05), suggesting a serious disagreement between the protocols and evidence of bias in our kappa statistics (Table 2). PABAK indices showed that there was in fact evidence of bias in the kappa statistic at the sample level, as indicated by the relatively large difference between the kappa and PABAK estimates. PABAK estimates at the sample level were as follows: 0.84, 0.83, and 0.86 for the comparisons between RAMS-IMS versus fecal-IMS, RAMS-IMS versus direct plating and between fecal-IMS and direct plating, respectively. However, at the animal level, the values for kappa and PABAK estimates were almost identical, suggesting that the bias in the kappa estimates was minimal at this level and kappa was also a suitable measure of agreement (Table 2). Estimates of the PABAK statistic at the animal level were 0.68, 0.50, and 0.60 for the comparisons between RAMS-IMS versus fecal-IMS, RAMS-IMS versus direct plating, and between fecal-IMS and direct plating, respectively, indicating moderate to substantial agreement (Landis and Koch, 1977) (Table 2).
Degree of agreement based on the Cohen's kappa statistic as proposed by Landis and Koch (1977): ≤0, poor agreement; 0.01–0.20, slight agreement; 0.21–0.40, fair agreement; 0.41–0.60, moderate agreement; 0.61–0.80, substantial agreement; 0.81–1.00 almost perfect agreement.
Prevalence-adjusted bias-adjusted kappa (Byrt et al., 1993).
Estimation of sensitivity of RAMS-IMS, fecal-IMS, and direct plating protocols
At the sample level, the relative sensitivities were slightly lower than at the animal level, at 72.9% (95% CI: 66.9%–78.3%), 70.2% (95% CI: 64.1%–75.9%), and 29.6% (95% CI: 23.9%–35.7%) for RAMS-IMS, fecal-IMS, and direct plating protocols, respectively. At the animal level, without considering observations from baseline, the sensitivity was 86.6% (95% CI: 78.2%–92.7%) for the RAMS-IMS protocol, 83.5% (95% CI: 74.6%–90.3%) for the fecal-IMS protocol, and 59.8% (95% CI: 49.3%–69.6%) for the direct plating protocol.
Estimation of sensitivity of diagnostic protocols using logistic regression models
Among the random effects models, the AIC and BIC showed lower values for the multi-level logistic regression models with random intercepts for pen and animal compared to the random slope models. Although information measures were often lower for the simple logistic regression models than for the random effects models, we provided the estimates from both models since the latter accounts for clustering derived from animals sharing a common environment (i.e., pen) and repeated measurements within individual animals (Table 3). Clustering was negligible for the estimation of sensitivity for the RAMS-IMS protocol given the small values obtained for the variance components for pen and animal (Table 3). Variance at the animal level was minimal for direct plating and the intra-class correlation coefficient for both levels of clustering was low (2.4%). However, for fecal-IMS, the correlation between samples of different animals in the same pen was 12.4%, whereas the correlation between samples in the same animal was 20.1% (Table 3). Neither the main predictors of interest (time components and exposure to a super-shedding pen-mate) nor the dietary treatments (corn type, feed additives, and vitamin A) were significantly associated with the sensitivity of the diagnostic protocols as estimated from the coefficients of the simple and multi-level logistic regression models (Table 3).
Mixed-effects logistic regression model with random intercepts for pen and animal.
On the basis of Coughlin et al.'s formula (Coughlin et al., 1992).
AIC, Akaike's information criterion; BIC, Schwarz's Bayesian information criterion; na, not applicable; SE, standard error.
On the basis of simple logistic regression models considering no explanatory variables (intercept-only models) and no random effects, the sensitivities for the RAMS-IMS, fecal-IMS, and direct plating protocols were 72.9%, 70.2%, and 29.6%, respectively, which are the same values we obtained by estimating the sensitivity of these methods at the sample level using contingency tables. However, when random effects were added to account for clustering at the pen and animal levels, sample level sensitivities were 72.9%, 71.9%, and 29.1% for RAMS-IMS, fecal-IMS, and direct plating, respectively. In addition, these models yielded slightly different 95% CI for sensitivity compared to the ones produced by simple logistic regression models (Table 3). In addition, the population-averaged sensitivities derived from the random effects models for the RAMS-IMS, fecal-IMS, and direct plating protocols were 72.9%, 68.6%, and 29.9%, respectively. Given the small between-pen and between-animal variation found in these models, differences between cluster-specific and population-averaged estimates were nonexistent or minimal. Observed differences in sensitivity estimates derived from multilevel models, even after conversion to population averaged estimates, can also be affected by varying group sizes, but this was not an issue due to the balanced nature of our study (Dohoo et al., 2009).
Sensitivity of super-shedding detection
Thirty-five percent of steers (59/168; 95% CI: 27.9%–42.3%) had at least one direct positive test result throughout the entire study period (range of counts/sample = 102.0–104.7 CFU/g). Eighty-one percent of these animals had only one positive test, whereas the remainder had more than one positive test based on direct plating with the following positive counts: 2 (n = 8); 3 (n = 2); 4 (n = 1). Counts decreased over time except for one animal where the second sample showed an increase and one where the count remained the same. On the basis of direct plating, ∼1% of animals (1/168; 95% CI: 0.01%–3.3%) showed counts between 102 and <103 CFU of E. coli O157:H7 per gram of feces, 12% (20/168; 95% CI: 7.4%–17.8%) showed at least one count equal or higher than 103 CFU/g but <104 CFU/g, and 22.6% (38/168; 95% CI: 16.5%–29.7%) of the steers experienced at least one super-shedding event throughout the entire feeding period (Table 4). In addition, overall, 2.2% (39/1784; 95% CI: 1.6%–3.0%) of samples showed counts equal or higher than 104 CFU/g of feces. One to five super-shedding steers were identified per pen over the entire feeding period with 71% (95% CI: 48.9%–87.4%) of pens having at least one animal experiencing a super-shedding event. Only 78.9% (95% CI: 62.7%–90.4%) of super-shedding animals were detected positive by RAMS-IMS, whereas 89.5% (95% CI: 78.6%–98.3%) of super-shedders tested positive by fecal-IMS, at any time during the study period.
Super-shedding events according to the Chase-Topping et al.'s definition (Chase-Topping et al., 2008).
Number of samples detected by direct plating at each specified concentration (based on the maximum count).
The percentage of samples at each concentration was estimated by dividing the number of samples detected by direct plating at each concentration by the total number of samples tested by direct plating (n = 1784).
Number of animals with at least one direct plating sample detected by direct plating at each specified concentration (based on the maximum count).
The percentage of animals at each concentration was estimated by dividing the number of animals detected by direct plating at each concentration by the total number of animals tested by direct plating (n = 168).
Sample-level sensitivity was estimated as the number of samples detected positive by either RAMS-IMS or fecal-IMS protocol at each concentration (as detected by direct plating) divided by the total number of samples detected by direct plating at that concentration.
Animal-level sensitivity was estimated as the number of animals detected positive by either RAMS-IMS or fecal-IMS protocol at each concentration (as detected by direct plating) divided by the total number of animals detected by direct plating at that concentration.
The McNemar's Chi-square tests indicated that there were significant differences in the proportion of positives in all comparisons among protocols, which may indicate that the results of the kappa statistics were biased. When PABAK was estimated, it showed that the kappa statistics at the sample level were actually biased and they resulted in much higher estimates of agreement beyond chance after adjusting for the potential effect of extreme prevalence and inter-test bias. PABAK values for comparisons at the sample level were 0.81, 0.83, and 0.75 for RAMS-IMS versus direct plating, fecal-IMS versus direct plating, and any positive test versus direct plating, respectively. At the animal level, however, the estimates of PABAK were almost identical to those of the unadjusted kappa, indicating that there was only a small degree of bias in the kappa statistics. PABAK values were 0.26, 0.39, and 0.21 for RAMS-IMS versus direct plating, fecal-IMS versus direct plating, and any positive versus direct plating, respectively.
Discussion
The results of our study indicate that shedding of E. coli O157:H7 was common and that RAMS-IMS and fecal-IMS protocols showed similar capabilities in detecting positive samples among this population of feedlot steers. In addition, test sensitivities were estimated using simple and multilevel logistic regression models to account for different covariates and for the hierarchical structure of our data. The sensitivity of these diagnostic protocols was not influenced by dietary treatments, time of sampling, or being exposed to a super-shedding pen-mate. Super-shedding in this group of cattle was higher than previously reported (Matthews et al., 2006a), and that although direct plating was the least sensitive method to detect E. coli O157:H7-positive samples, over 20% of high bacterial load samples were not detected by RAMS-IMS and/or fecal-IMS. These results suggest that more analytical studies should be performed to investigate whether the outcomes derived from RAMS versus fecal grabs provide a consistent picture of the epidemiology of E. coli O157:H7 shedding and super-shedding in cattle.
In contrast with previous studies that have favored one method over the other (Rice et al., 2003; Greenquist et al., 2005; Khaitsa et al., 2005; Niu et al., 2008), we found that RAMS-IMS and fecal-IMS tests had similar sensitivities for E. coli O157:H7 detection at both sample and animal levels. Variation among studies most likely results from the effect of potential confounding factors such as size and type of samples, consistency of feces and swabbing technique and laboratory protocols, which might influence the sensitivity of swabs or fecal samples in recovering E. coli O157:H7. Thus, future efforts to standardize sampling and diagnostic procedures are desirable to permit better comparison among studies.
When the capabilities of RAMS-IMS, fecal-IMS, and direct plating tests to detect E. coli O157:H7 shedding were compared based on the Cohen's kappa statistic, only the comparisons between RAMS-IMS and fecal-IMS were valid, based on the McNemar's Chi-square test, and suggested a moderate to substantial agreement at the sample and animal levels, based on the Landis and Koch scale (Landis and Koch, 1977). However, this scale should be interpreted with caution since it was designed for the interpretation of agreement between subjective tests and it may exaggerate the magnitude of agreement for objective tests. Even though there were suggestions that the kappa statistics may not have been valid, significant PABAK estimates supported the existence of statistically significant moderate to substantial agreement beyond chance, especially at the sample level. At the animal level, the kappa estimates were subject to less bias and the estimates of agreement beyond chance were similar for the kappa and PABAK statistics; this was more likely the result of the prevalence estimate being close to 50%. However, it is important to note that both kappa and PABAK lack the ability to account for other covariates (e.g., diet and management factors) or the influence of autocorrelation in the data. In our study, the effect of bias from autocorrelated data in our estimates of the kappa and PABAK statistics were likely small considering the little difference between the random and fixed effects models used for estimating the sensitivity of these tests.
Previous studies indicated that diet does affect E. coli O157:H7 populations in cattle before slaughter; however, the direction and magnitude of the effect of different dietary interventions on E. coli O157:H7 shedding in cattle is still controversial (Buchko et al., 2000; Bach et al., 2005; Fox et al., 2007; Jacob et al., 2008). Further, additional sources of variability, such as the existence of different testing strategies, should be accounted for when explaining the differences among study results. Therefore, the application of methods such as logistic regression models, which evaluate test performance while accounting for management factors or other potential sources of variation (e.g., clustering), could be advantageous. Although mixed models accounting for clustering at the pen and animal levels were performed, in our study there were no epidemiologically significant differences in sensitivity and in the interval estimates between simple and multi-level models. The variance components for the fecal-IMS models were much greater than the negligible values seen when mixed models were applied to the RAMS-IMS and direct plating data. It is uncertain why clustering was much more pronounced for the fecal-IMS protocol than the RAMS-IMS or direct plating protocols. However, the difference in values for the information criteria (AIC and BIC) between models was marginal, suggesting that the results of these three diagnostic protocols can be treated as independent observations. Given that the results from the mixed models were not substantially different from those resulting from single level models, we favored results from the latter for the sake of simplicity and clarity. However, results from both models were presented to demonstrate the similarity between them.
Time of sampling was not an issue in our logistic models employed to evaluate test performance, indicating that test sensitivity seems to be independent of changing prevalence over time. Our previous research indicated that the impact of different dietary supplements on the probability of testing positive to E. coli O157:H7 varied with the diagnostic protocol used (Cernicchiaro et al., 2010). However, it was not clear if the contradictory effect of dietary treatments on the probability of testing positive for E. coli O157:H7 by RAMS-IMS and fecal-IMS was related to the potential effect of diet on the sensitivity of these diagnostic protocols or to the effect of these diets on the bacterial population present in feces and RAMS. In the current study, test sensitivities were not influenced by dietary treatments, time of sampling, or exposure to super-shedding pen-mates. Thus, we can conclude that in this study diet did not affect the sensitivity of the RAMS-IMS, fecal-IMS, and direct plating protocols, and we hypothesize that diet, instead, might impact other bacterial species that affect preferential binding of E. coli O157:H7 at particular gastrointestinal locations. Therefore, efforts should be made to identify the existence of potential biological differences among bacteria present in fecal and RAMS samples that could explain discrepancies in results obtained using the different diagnostic protocols.
In this study, it was uncommon to observe animals shedding E. coli O157 at any level over multiple sampling periods. We recognize, however, that evaluating shedding by bi-weekly intervals may ignore the impact of different phenomena involved in the dynamics of E. coli O157:H7 shedding by cattle, such as intermittent shedding, episodes of transient shedding followed by re-infection or simply shedding at low concentrations that are below the detection limit of these diagnostic protocols.
Although direct plating was the least sensitive method to detect E. coli O157:H7–positive samples, over 20% of high bacterial load samples were not detected by RAMS-IMS and/or fecal-IMS. Similarly, when these protocols were compared to evaluate their ability to detect super-shedding events at the sample level, higher levels of agreement were noted with PABAK. Therefore, adjustment of kappa was appropriate to minimize bias particularly at the sample level for detection of E. coli O157:H7 shedding and super-shedding events. The estimates of sensitivity of the RAMS-IMS and fecal-IMS protocols to detect super-shedding events are probably biased upward given that these estimates were based on direct plating as a gold standard and some super-shedders could still have been missed by this testing procedure. The reasons why super-shedding events do not always test positive by fecal-IMS and RAMS-IMS protocols are unclear. The use of different enrichment times or type of beads employed in the IMS procedure (Verstraete et al., 2010) as well as the antibiotics present in the enrichment broth (Vidovic et al., 2007) may affect the sensitivity of detection of E. coli O157. The role of these and other potential factors such as the frequency and magnitude of shedding on the performance of the protocols should be further investigated.
Our results suggest that the classification of super-shedders might depend on the frequency and duration of sampling. Yet, previous reports were based on simulation models and cross-sectional prevalence data in various cattle production systems (e.g., cow-calf and pastured cattle). Consequently, it is likely that their estimates are underrepresented, as animals should not be classified as nonshedders on the results of a single visit given shedding in cattle is transient and new episodes of carriage or re-infection can take place (Matthews et al., 2006b). More longitudinal studies in different populations of cattle are needed to disentangle the dilemma of being a super-shedder with a long-term, high fecal excretion of E. coli O157:H7 versus a super-shedding animal that sheds high amounts of bacteria transiently. It is crucial to determine the causes of high-level shedding so that control measures targeting these events can be developed. If individual animals are super-shedders, then testing, culling, selective breeding, or isolation may be effective control measures. In contrast, if all or most animals exhibit super-shedding events during the normal course of infection, most of these strategies for control would not be practical or economically viable strategies to control E. coli O157:H7 on the farm. Instead, interventions aimed at reductions of bacterial counts in the environment or from all animals would be more feasible.
Footnotes
Acknowledgments
The original study was funded by the Beef Checkoff. The lead author was supported by funds provided by the U.S. Department of Agriculture through their National Research Initiative (USDA-NRI), Epidemiological Approaches to Food Safety Grant # 2006-01227. The computational infrastructure for this research was obtained with the support of the Canada Foundation for Innovation and the Ontario Ministry of Research and Innovation through a grant to D.L. Pearl.
Disclosure Statement
No competing financial interests exist.
