Abstract
Background:
The practice of rapidly initiating antibiotic therapy for patients with suspected infection has recently been criticized yet remains commonplace. Provider comfort level has been an understudied aspect of this practice.
Hypothesis:
We hypothesized that there would be no significant differences in provider comfort level between the two treatment groups.
Methods:
We prospectively surveyed critical care intensivists who provided care for patients enrolled in the Trial of Antibiotic Restraint in Presumed Pneumonia (TARPP), which was a multicenter cluster-randomized crossover trial that evaluated an immediate antibiotic initiation protocol compared with a protocol of specimen-initiated antibiotic initiation in ventilated patients with suspected new-onset pneumonia. At the end of each enrollment arm, physicians at each center were surveyed regarding their overall comfort level with the recently completed treatment arm, and perception of adherence. Both a paired and unpaired analysis was performed.
Results:
We collected 51 survey responses from 31 unique participants. Providers perceived a higher rate of adherence to the immediate initiation arm than the specimen-initiated arm (Always Adherent: 37.5% vs. 11.1%; p = 0.045). Providers were less comfortable waiting for objective evidence of infection in the specimen-initiated arm than with starting antibiotic agents immediately (Very Comfortable: 83.3% vs. 40.7%; p = 0.004). For the smaller paired analysis, there was no longer a difference in comfort level.
Conclusions:
There may be differences in provider comfort levels and perceptions of adherence when considering two different antibiotic initiation strategies for suspected pneumonia in ventilated patients. These findings should be considered when planning future studies.
Intensive care unit (ICU)-acquired pneumonia is a widely prevalent problem that is associated with increased risk of in-hospital mortality. 1 The diagnosis of pneumonia can be difficult to identify in the ICU population given the broad differential to consider in trauma and surgical patients with leukocytosis or increasing oxygen requirements.2,3 The overuse of antibiotic agents can result in costly bacterial resistance, adverse drug effects, and opportunistic infections, which has triggered support for increased antibiotic stewardship,4,5 Therein lies the balance to promptly treat suspected pneumonia while limiting unnecessary antimicrobial use.
Given this diagnostic and treatment dilemma, multiple societies have offered clinical and culture-based guidelines for antibiotic initiation.6,7 The Surviving Sepsis Campaign (SSC) has softened its stance regarding rapid initiation of antibiotic agents in its most recent guidelines for patients with possible sepsis without shock, allowing a time-limited course for investigation.8,9 Although efforts have been made to better define which patients would and would not benefit from early initiation of antibiotic agents, provider perceptions of antibiotic use are understudied and underreported in the literature. Multiple studies have expressed concern with antibiotic overuse without concomitant evidence for decreased mortality, but none have asked providers specifically their comfort in withholding antibiotics.10–13 Our study aims to address this gap by describing both provider adherence and comfort level with two protocols for antibiotic initiation in an ICU setting.
Methods
The Trial of Antibiotic Restraint in Presumed Pneumonia (TARPP) was a prospective cluster-randomized crossover study of antibiotic initiation strategies in intubated patients with suspected pneumonia. 14 Each participating site underwent independent full Institutional Review Board (IRB) review and obtained approval at their respective institutions before the study began; ethics committee review was not required. Each site participated in two antibiotic initiation protocols: immediate and specimen-initiated. In the immediate protocol, patients suspected of having hospital-acquired pneumonia had their antibiotic agents started immediately after collection of a culture specimen regardless of their clinical status. In the specimen-initiated protocol, patients who were not on vasopressors had antibiotic agents withheld until there was objective evidence of an infection (usually in the form of a gram stain). Patients on vasopressors were started on antibiotics immediately regardless of protocol. Full results of the study are published elsewhere. 14
Two rounds of surveys were distributed electronically to participating intensivists at each institution. The list of intensivists was provided by each of the primary site investigators. The first round of surveys was distributed after completion of the first arm of the study and during the washout period. All surveys distributed during this first period were collected prior to the start of the second arm of the study. The second round of surveys was sent after completion of the study but prior to completion of data analysis. Each provider received the same survey, but the survey questions were conditionally tailored to the protocol that each group had just finished based on provider selection of the site where they worked. For example, during the first round of the survey, participants that selected that they worked at sites A and B were asked about the immediate protocol while sites C and D were surveyed about the specimen-initiated protocol. This order was switched during the second round.
Respondents were asked to rank the level of perceived protocol adherence to the study as well as their overall comfort level on a five-point Likert scale. Respondents surveyed after completion of the specimen-initiated protocol were also asked to select from a list of clinical findings that may lead them to start antibiotic agents without waiting for culture results. A copy of the survey is included in the Supplementary Appendix. Please note that the surveys use the terms “aggressive” to refer to the immediate arm and “conservative” to refer to the specimen-initiated arm. These terms were updated for the final article.
Statistical analysis of survey responses was performed. Descriptive statistics were used. Given the small sample size, and because not every respondent answered both surveys, variables were analyzed as using both a paired and unpaired analysis. The paired analysis was conducted on the smaller subset of physicians that answered both surveys. Both χ 2 and Fisher exact test were used to compare categorical variables. Comparisons of continuous variables were done using Student t-test for the unpaired analysis. The Stuart Maxwell test and paired t-test were used for the paired analysis. All statistical analysis was conducted using SAS 9.4 (SAS Institute, Cary, NC) and R (version 4.3.1; R Foundation for Statistical Computing, Vienna, Austria).
Results
A total of 68 surveys were sent to 36 unique providers over the two survey periods. Thirty-one unique providers (86.1%) responded to at least one of the surveys whereas 20 providers answered both surveys (55.6%). The overall response rate was 75% for both survey periods. Overall respondent characteristics are listed in Table 1. Most respondents were male and had been in practice for 10 years or less. Most respondents reported that they split their time evenly between several clinical areas including critical care. There were no differences in respondent characteristics based on protocol (paired or unpaired analysis).
Respondent Provider Characteristics
No statistical differences when only paired samples analyzed.
Represents comparisons between immediate and specimen initiated groups only.
Percentages in unique responders column equal >100% because one respondent changed answer between first and second survey.
Provider perceptions of study adherence and comfort levels are listed in Table 2. Respondents perceived a higher rate of adherence for the immediate protocol than the specimen-initiated protocol. For smaller subset of paired survey responses, the mean perception of adherence was not statistically different when analyzed categorically but mean perception of adherence remained lower in the specimen-initiated arm (4.4 ± 0.50 vs. 4.1 ± 0.39; p = 0.04). Similarly, respondents were more comfortable with the immediate protocol than the specimen-initiated protocol when all survey responses were included. In the smaller paired sample, there was no difference in comfort level between the two groups. For respondents who had just completed the specimen-initiated protocol, worsening Pa
Respondent Perception of Adherence and Comfort Level
Not statistically significant when smaller subset of paired surveys are analyzed.
Provider Indications for Initiation of Antibiotics in Normotensive Patients
WBC = white blood cell count; AKI = acute kidney injury.
Respondent Comments by Protocol
ABX = antibiotic agents.
One hundred percent of respondents stated that they would participate in a similar study in the future. Comments regarding the respondents who felt it was important to participate in similar studies are listed in Table 5.
Respondent Comments Participating in Similar Studies
Discussion
In this prospective survey study of physicians participating in a randomized trial of antibiotic initiation strategies, we observed that provider perceptions of adherence and comfort level may differ and may not necessarily correlate with physician behavior during the trial.
In TARPP, adherence rates between the two protocols were not statistically different (74.2% in immediate vs. 82.8% in specimen-initiated; p = 0.15). Most of the non-compliance in the study (72.5%) was due to failure to stop antibiotic agents once cultures were negative, not due to off-protocol initiation. 14 In our full survey cohort, however, perceived adherence rates were statistically different between the two protocols with providers believing that adherence was higher in the immediate protocol. Mean perception of adherence remained statistically lower in the specimen-initiated arm when only paired surveys are considered. The difference in actual versus perceived adherence suggests a persistent bias toward immediate initiation protocols.
The Severe Sepsis and Septic Shock Management Bundle (SEP-1) from The Center for Medicare and Medicaid Services (CMS) may promote this bias through tying hospital reimbursement to compliance with rapid initiation of antibiotics. When providers in our survey were asked for comments regarding the immediate protocol, it was reported multiple times that it was in concordance with standard practice at that institution. A large systematic review of qualitative studies of physician antibiotic prescribing practices identified multiple health system-related extrinsic factors that influence prescribing practices including time-pressures, healthcare organizational structures, and guidelines. 15 Nicks et al. 10 found that more than half of the respondents in their survey study reported prescribing antibiotic agents to patients they did not believe had pneumonia in an effort to comply with the CMS guidelines. Many physicians report feeling anxiety about missing an infection, which drives antibiotic overuse even in cases in which infection is uncertain. 16
In the full unpaired survey cohort, we also observed a difference in the reported comfort level of providers between the two protocols. Providers were more comfortable with the immediate protocol compared with waiting for objective evidence in the specimen-initiated protocol. Providers commented that their comfort level was directly tied to patient stability. These observed differences were not found in the smaller paired analysis. A recent survey by Taylor et al. 17 observed that physicians had higher thresholds of for initiating antibiotic agents when the patient's severity of illness is low. It is important to note that TARPP was designed to initiate antibiotic agents immediately for any patient requiring vasopressor support regardless of study protocol. When excluding the patients in septic shock, providers reported feeling comfortable waiting to initiate antibiotic agents.
These reported perceptions seem to align with the changes made in the SSC 2021 guidelines, which allow for up to three hours of additional workup prior to initiation of antibiotic agents for those patients not in septic shock. 8 Complacency and fear of worsening clinical status may also play a large part in explaining the observed differences in provider comfort level in our study. 15 Bisarya et al. 18 observed an association between the timing of antibiotic agents and progression to septic shock, although the timing of antibiotic agents was not associated with mortality in their study.
When asked what would prompt the provider to deviate from the specimen-initiated protocol and start antibiotics before objective evidence of infection, the highest-ranked indications were worsening Pa
Our survey concluded with asking respondents why they believed participation in a study such as TARPP is important to the field of critical care. Overall, our respondents noted this is an area lacking evidence-based data to support a protocol for antibiotic restraint. Respondents commented on the importance of antibiotic stewardship to avoid overuse of antibiotics, which is not without risk. Lindsay et al. 4 performed a systematic review and meta-analysis of antimicrobial stewardship programs in critical care patients that suggested the implementation of these programs did not increase patient mortality. Respondent comments were few enough that we have chosen to display them without classification or editing apart from removing a few names. The reader is free to make their own interpretation of the comments.
Our study is strengthened by obtaining prospective surveys of physicians participating in a clinical trial of antibiotic initiation. As the sites were cluster-randomized, the physician responses are similarly cluster-randomized. Limitations of this study include a small sample size in survey respondents and that we could not obtain responses from all physicians after participating in both arms. In particular, the paired analysis is of an even smaller subset of survey responses and so is underpowered to detect smaller potential differences. Because not every physician answered both surveys our decision to perform both unpaired and paired analysis with resulting differences in statistical results leads to some challenges in interpretation. Also, our survey questions were limited, and we did not collect more nuanced data from the participants. We also did not ask the surveyed physicians about the evidence that they used to inform their judgements. Last, we are unable to pair individual physician responses with individual patients within the study cohort and are unable to draw conclusions between individual physician perspectives and compliance or outcomes. Our findings are therefore inherently limited and are not generalizable to a broader cohort.
Conclusions
There may be substantial differences in provider comfort levels and perceptions of adherence when considering two different antibiotic initiation strategies for suspected pneumonia in ventilated patients. Our study found a potential discrepancy in actual versus perceived adherence, with providers exhibiting no difference in actual adherence to immediate versus specimen-initiated protocols for the treatment of suspected pneumonia. This survey highlights provider interest in further research in this area.
Footnotes
Authors' Contributions
Conceptualization: Guidry. Methodology: Guidry, Beyene, Sawyer, Hughes. Formal analysis: Guidry. Investigation: O'Dell, Beyene, Watson, Sawyer, Chollet-Hinton, Atchison, Derickson, Cooper, Pennington, VandenBerg, Halimeh, Guidry. Writing: Swilling, Guidry. Editing and review: All authors. Visualization: Swilling. Funding acquisition: Guidry.
Funding Information
Dr. Guidry received a grant from the Surgical Infection Society Foundation for this study.
Author Disclosure Statement
The authors have no relevant financial interests to disclose.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
