Abstract
Background:
Current cervical cancer screening guidelines include the option of lengthening the screening interval to 5 years for average-risk women aged 30–65 years when screened with Pap and human papillomavirus (HPV) test (co-test). Because many providers are reluctant to extend screening intervals, we launched an educational intervention to promote recommended screening practices. The study objective was to assess changes in provider attitudes and beliefs to extending screening intervals among low-income women.
Methods:
The study was conducted in 15 clinics in Federally Qualified Health Centers in Illinois. Providers in the intervention arm received a multicomponent educational intervention. Fifty-six providers (n = 29 intervention and n = 27 control) completed baseline and 12-month follow-up surveys assessing beliefs and intentions about extending screening intervals.
Results:
The 12-month assessment showed providers in the intervention arm were significantly more likely than those in the control arm to recommend a 3-year screening interval (guideline recommendation at time of study) with a normal co-test result. Providers who received the intervention were significantly more likely to agree that routine co-testing is the best way to screen for cervical cancer, that extending the screening interval would be good, easy, and beneficial, and to disagree that the increased screening interval would cause patients to lose contact with the medical system.
Conclusion:
Educating providers on the natural history of HPV infection and cervical cancer and the benefits of extended intervals increased their willingness to follow guidelines. This study provides evidence that an educational intervention delivered with HPV testing materials may be effective in encouraging appropriate cervical screening intervals.
Introduction
P
To date, no studies have examined provider and patient acceptance of co-testing with longer screening intervals in a clinical setting that serves a low-income population. Federally Qualified Health Centers (FQHCs) provide care regardless of a person's insurance status, income, or ability to pay, and they are a large essential component of the U.S. healthcare safety-net for people who otherwise have limited options to access essential care. 11 Conducting research in FQHCs allows for understanding the access and barriers to care among the underserved. In 2009, the Centers for Disease Control and Prevention (CDC) launched the CDC's Cervical Cancer (Cx3) Study—a multicomponent educational intervention to identify facilitators and barriers to guideline-consistent use of the co-test in an underserved population receiving care at FQHCs. 12 The primary objective of the Cx3 Study was to introduce co-testing along with an educational intervention to encourage providers and patients to extend the cervical cancer screening interval for women with normal co-test results. The purpose of this analysis is to describe the baseline and follow-up assessments of providers in the study and determine the effects of the educational intervention on provider beliefs and intentions about extending screening intervals.
Methods
Study design and participants
Six FQHCs with 15 individual clinics were enrolled in the study by August 2009. Recruitment of FQHCs occurred through the CDC's National Breast and Cervical Cancer Early Detection Program (NBCCEDP). 13 Each clinic was assigned to one of two study arms: intervention (seven clinics) or control (eight clinics). The intervention and control arms were matched at baseline on clinic attributes, including racial/ethnic characteristics of the patient population, geographical location, and patient volume. Clinics in both groups received free HPV tests and hard copies of clinical practice guidelines current during the time of the study (2009–2010), which specified following a 3-year screening interval for individuals who received normal results on both the Pap and HPV tests (defined as guideline consistent in the analysis). 14 In addition, clinics in the intervention group received a multicomponent educational program, including provider and patient education materials designed for this project. 12 The educational intervention consisted of multiple evidence-based strategies to encourage providers to follow recommendations. These included grand rounds, four separate 1-hour academic detailing sessions, and a password-protected website containing educational podcasts on recommended intervals for cervical cancer screening. Details of the educational intervention are published elsewhere. 12 In total, five educational components were offered to intervention arm providers (one grand round and four academic detailing sessions). This study was approved by the CDC's Institutional Review Board and the Office of Management and Budget (OMB Control #0920–0814).
Providers in the participating FQHCs were eligible to participate in the study if they personally performed Pap testing for routine screening (n = 109). Ninety-eight providers (response rate 89.9%) were enrolled at baseline 7 with the average age of 41.3 years. Almost 70% of the providers were from the Chicago area, and 75% were female. With respect to race/ethnicity, 48% of the providers were non-Hispanic (NH) white, 22% NH Asian, and 18% NH Black. On average, providers attended to 52 female patients per week. Of the 98 providers with baseline assessments, 19 left the clinic during the study period, 9 became ineligible (stopped performing well-woman exams or routine Pap testing), 14 refused participation in the follow-up survey, and 56 completed the 12-month follow-up survey. Nonresponders to the 12-month survey were more likely to be male and physicians who specialized in obstetrics/gynecology (all chi-square p < 0.05). There were no significant differences in response status by study arm, screening interval practices, or beliefs. Of the 56 providers who completed follow-up surveys, 29 were in the intervention arm. Of those, 25 attended at least one of the teaching educational components; mean sessions attended was 4.20. Providers in the intervention arm who did not attend any training sessions were removed from the analytic sample leaving 84 providers at baseline and 52 providers at follow-up. Among providers in the intervention clinics, there were no significant differences in the measures of attitudes, beliefs, and practices at baseline by attendance at training sessions (Fisher's Exact Test, all p > 0.05).
Measures
Coordinators at participating clinics distributed surveys to providers along with a $50 cash incentive at baseline and 12-month follow-up. The surveys assessed attitudes, beliefs, and practices regarding cervical cancer screening (specifically measures related to co-testing in general and extending the screening intervals). 7 Measures and clinical vignettes were modeled upon national primary care provider cervical cancer screening practice surveys. 4,15
Statistical analysis
Cross-sectional differences were evaluated with Fisher's Exact Test and the Mantel–Haenszel chi-square test of linear trend. Cross-sectional analyses were conducted on the sample who responded to both the baseline and follow-up surveys (n = 52). Evaluation of longitudinal data was conducted with random effects, ordinal logistic regression models. Models included three terms: main effect of study arm (coded 1 for intervention arm; 0 for control arm, referent category); main effect of time (coded 1 for follow-up; 0 for baseline survey, referent category); and the interaction of study arm with time (coded 1 for intervention arm at follow-up; 0 for other, referent category). The result of the main effect of study arm indicates whether there were significant differences in provider responses between study arms. The result of the main effect of time indicates whether there were significant differences in response between the two surveys. The impact of the intervention is evaluated with the interaction term and is referred to as the “Intervention Effect” in tables and figures. The sample for longitudinal analysis includes baseline data for n = 84 providers with completed baseline surveys and n = 52 providers with completed follow-up surveys. The proportionality assumption was tested with the Brant test; no violations were found. Differences were considered statistically significant with a p-value of less than 5%.
Results
At baseline, in response to a clinical vignette of a 35-year-old woman with normal co-test results, providers suggested the following screening intervals: annual (55%), 2-year (20%), and 3-year (25%) (no significant differences by study arm; data not shown). Limiting the sample to providers who recommended annual screening intervals at baseline (n = 28), the 12-month follow-up assessment showed providers in the intervention arm were significantly more likely than those in the control arm (54% versus 7%, p = 0.008) to recommend a 3-year screening interval (Table 1).
Mantel–Haenszel chi-square test of linear trend.
Provider attitudes about extending the cervical cancer screening interval to three or more years for a woman over age 30 with normal co-test results are shown in Table 2. There were no significant differences in attitudes about extending the screening interval by study arm at baseline. However, at follow-up, there was evidence of an intervention effect with providers in the intervention arm more likely to report that extending the screening interval would be good (OR 6.45, p = 0.038), easy (OR = 5.18, p = 0.032), and beneficial (OR = 8.53, p = 0.034), and less likely to report that extending the screening interval would cause patients to lose contact with the medical care system (OR 9.80, p = 0.044).
Cross-sectional analysis presents percent distributions by study arm at each survey period. For comparability across time points, the sample was limited to the n = 52 providers who completed both baseline and follow-up surveys. Significant differences were tested with Mantel–Haenszel chi-square test of linear trend.
Evaluation of longitudinal data was conducted with random effects, ordinal logistic regression. Models included three terms: study arm (coded 1 for intervention arm; 0 for control arm, referent category); time (coded 1 for follow-up; 0 for baseline survey, referent category); and, the interaction of study arm with time (coded 1 for intervention arm at follow-up; 0 for other, referent category). The interaction of study arm with time is the estimate that tests the effect of the educational intervention. Sample includes baseline data for n = 84 providers with completed baseline surveys and n = 52 providers with completed follow-up surveys.
Bold values indicate p-value was significant at p < 0.05.
C, control arm; I, intervention arm; OR, odds ratio.
In contrast to attitudes about extending the screening interval, the vast majority of providers had positive beliefs about co-testing women over 30 years of age at study inception. At baseline, most providers believed the co-test to be beneficial (90%), good (80%), and easy (73%) (Fig. 1). The majority of providers agreed that co-testing would help determine a plan for follow-up if Pap result is abnormal (94%), help explain cervical cancer risk to patients (88%), help determine the appropriate future screening intervals (85%), and would give a more complete understanding of patients' current state of health and risk for disease (79%). In addition, the majority of providers disagreed that co-testing would take too much time (94%), would be an extra burden for office staff (92%), would not provide any more useful information than the Pap test alone (87%), would be a test patients would not want (79%), was not needed (75%), and would only be needed for high-risk patients (71%). There were no significant differences in these beliefs by study arm at baseline. There was a significant interaction effect for one measure of beliefs about co-testing (i.e., “co-testing is the best way to screen for cervical cancer”) (Fig. 2; OR 25.17, p = 0.035).

Provider baseline beliefs about using the co-test for routine cervical cancer screening (%). Testing with random effects binary and ordered logistic regression determined no significant differences by study arm or time (p < 0.10), therefore only study arm combined, baseline percent distributions are presented.

Provider beliefs about co-testing for routine cervical cancer screening by survey time period and intervention group. Co-testing is the best way to screen for cervical cancer… Significant differences were tested with random effects ordinal logistic regression. Model included three terms: study arm (control arm, referent category); time (baseline survey, referent category); and the interaction of study arm with time (for study arm, OR 0.29, p = 0.260; for time, OR 0.61; p = 0.532; for interaction, OR 25.17, p = 0.035).
Discussion
Our findings showed the impact of an enhanced educational intervention on the attitudes and intentions of providers who reported screening annually at the initiation of the study. Overall, providers in this study had positive beliefs at baseline about using the co-test and that positivity continued through to the 12-month follow-up. However, providers varied in their beliefs about extending the screening interval according to guidelines. Providers in the intervention arm gained more favorable attitudes toward extended screening intervals. In addition, more intervention providers reported they would increase the screening interval according to recommended guidelines.
Before the 2012 revisions to the screening guidelines, the recommendations for screening were not consistent across all organizations and included recommendations to screen every 2 to 3 years with a history of negative Pap tests. 14 When the Cx3 Study began in 2009, annual screening was the most common screening practice, even though not recommended by national organizations. 15,16 Our baseline data found that only 25% of providers would recommend a 3-year screening interval with a normal co-test result. 7 When we examined the same baseline data as part of a separate analysis to determine whether providers were more comfortable with extending the screening interval with a history of negative Pap tests, the same percent (27%) agreed to a 3-year interval (data not shown). Adding the HPV test to the Pap test as a screening strategy meant the history of negative tests was no longer a requirement to establish longer intervals between screenings. Current guidelines, revised in 2012, now recommend a 3-year interval with a Pap test alone and do not require the previous criteria involving a history of normal results. Studies have shown a small risk of diagnosis of cervical cancer within the 3-year time period. 3
The educational materials developed for this study focused heavily on the natural history of cervical cancer and the long latency period (up to decades) from HPV infection to invasive cervical cancer. They also addressed common concerns and barriers to extending the screening intervals. 12 One of the common barriers reported during the early formative work of this study involved legal aspects such as liability of missing cancers, which we addressed during the first academic detailing session. In addition, providers felt that women may not return for other preventive care. Thus, our patient materials also focused on the importance of well-woman exams and the importance of returning for preventive care. The significant increase in the percent of intervention providers willing to extend the screening interval from annual to 3 years compared to the control over the 12-month follow-up (Table 1), indicates that the messages provided in the enhanced educational intervention appropriately addressed some of the concerns about extending the interval of this group of providers.
In 2012, when guidelines from all major organizations consistently recommended when and how often to screen, they also were revised to recommend extending the interval to 5 years (from 3 years) with a co-test. Although our study did show an increased percentage of providers willing to extend the interval to 3 years (from annual at baseline), other studies have found that providers and women were more resistant to longer intervals (up to 5 years). 8,10 Countries with organized screening programs have had later initiation of screening and longer screening intervals with no increase in mortality when compared to the United States. 17 Clinicians in managed care organizations have been the most successful at increasing intervals. 18
The provider beliefs, attitudes, and practice recommendations are self-reported and might not reflect actual behavior in the clinical setting. As a demonstration study in one state, our results may not be generalizable. However, when we examined the racial and ethnic distribution of this study population in Illinois, it was very similar to the NBCCEDP client population nationwide. In addition, it was up to the provider whether he/she wanted to use/attend the offered intervention resources. Thus, while the intervention components were consistently delivered, uptake and use may have varied by the provider. In addition, there was a very high percentage of staff turnover at all clinics and we did not include new providers for the follow-up survey. Both study arms received HPV tests and therefore we did not have access to a true control group (in which they did not receive any intervention).
Conclusion
While many studies are aimed at introducing new technology, very few are focused on introducing new technology in a low-income population coupled with evidence-based strategies that emphasize the best care through less frequent screening. The Cx3 Study's findings on practices and attitudes regarding HPV testing and screening interval extension are very timely, now that national organizations have aligned their recommendations for co-testing and screening intervals. In addition, primary HPV testing has recently been FDA approved with interim guidelines
19
and management guidelines have been updated with a focus on triaging women with specific high-risk HPV types.
20
Thus as the science advances and additional choices are given, providers may need adequate materials and tools to facilitate talking to women about the new testing options.
21
The information on the harms of overtesting, which may lead to overdiagnosis and overtreatment, is only useful to the extent that it is understood and accepted by providers and patients. CDC has produced several materials to educate providers and patients on the appropriate use of the co-test and these materials may be adapted over time to meet the changing needs of the population and the latest science (
Footnotes
Acknowledgments
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the CDC. This article was written in the course of employment by the United States Government or under a contract with Battelle (200–2002-00573, Task Order No. 0006 and No. 0017) and it is not subject to copyright in the United States. The authors gratefully acknowledge the medical directors and administrators from the FQHCs who participated in the study, and the Illinois Breast and Cervical Cancer Early Detection Program.
The CDC Foundation provided in-kind support for testing reagents from Qiagen and Roche Molecular Diagnostics.
This research was supported, in part, by an appointment (LL) to the Research Participation Program at the CDC administered by the Oak Ridge Institute for Science and Education through an interagency agreement between the U.S. Department of Energy and CDC.
Author Disclosure Statement
The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
