Abstract
This study aimed to identify facility-level characteristics associated with prevention of mother-to-child HIV transmission service quality. This cross-sectional study sampled 60 health facilities in Mozambique, Côte d’Ivoire, and Kenya (20 per country). Performance score – the proportion of pregnant women tested for HIV in first antenatal care visit, multiplied by the proportion of HIV-positive pregnant women who received appropriate antiretroviral medications – was calculated for each facility using routine data from 2012 to 2013. Facility characteristics were ascertained during on-site visits, including workload. Associations between facility characteristics and performance were quantified using generalized linear models with robust standard errors, adjusting for country. Over six months, facilities saw 38,611 first antenatal care visits in total. On-site CD4 testing, Pima CD4 machine, air conditioning, and low or high (but not mid-level) patient volume were each associated with higher performance scores. Each additional first antenatal care visit per nurse per month was associated with a 4% (95% confidence interval: 1%–6%) decline in the odds that an HIV-positive pregnant woman would receive both HIV testing and antiretroviral medications. Physician workload was only modestly associated with performance. Investments in infrastructure and human resources – particularly nurses – may be critical to improve prevent mother-to-child HIV transmission service delivery and protect infants from HIV.
Introduction
Effective, affordable, and scalable strategies are urgently needed to improve the delivery of services to prevent mother-to-child HIV transmission (PMTCT), which has been conceptualized into four “prongs”: prevention of (1) HIV infections among women, (2) unintended pregnancies among HIV-positive women, (3) vertical transmission from HIV-infected pregnant women, and (4) providing ongoing care for mother with HIV and their infants. In developed countries, interventions that target the third PMTCT prong have reduced the rate of vertical HIV transmission to less than 1%. 1 In sub-Saharan Africa, only half of HIV-positive women receive antiretroviral (ARV) medications or antiretroviral therapy (ART) during pregnancy. 2 Despite high antenatal care (ANC) utilization, unacceptably high drop-offs across the PMTCT cascade contributed to 230,000 new pediatric HIV infections in sub-Saharan Africa in 2012. 3
Health systems can have dramatic impacts on health service delivery, 4 as evidenced by the wide variation in testing and ARV coverage between health facilities, even in similar settings. 2 Health worker shortages, stockouts of test kits or ARVs, services for patients such as support groups, and integration of PMTCT with ANC may each affect PMTCT service delivery.5–8 Identifying health systems factors – particularly those that are modifiable – that impact the quality of care is therefore crucial to maximize the effectiveness of ART. 9
Though many studies have investigated correlates of ART coverage 2 and retention in care, 7 such research has been framed in terms of identifying individual characteristics that are associated with PMTCT uptake rather than characteristics of health facilities that are associated with high PMTCT service delivery. Those studies that do investigate health facility factors often only evaluate one or a few characteristics as an adjunct to the primary analysis, 10 such as whether PMTCT is integrated in ANC, and therefore cannot compare the relative contribution of different health facility factors on PMTCT service delivery. Additionally, many studies have used the sole outcome of self-reported receipt of nevirapine, 7 which is no longer recommended, 11 and have included relatively few facilities over a limited geographic area. Though one study included 269 sites from 15 sub-Saharan African countries, its results may no longer be relevant, as its outcome was single-dose nevirapine use during 2002–2005. 12 To inform current efforts to prevent infant HIV infections, generalizable data are needed on health facility factors associated with high-quality delivery of currently recommended PMTCT regimens.
No standard definition of PMTCT service quality exists. Actively observing clinical encounters 13 or conducting in-depth interviews 14 have been utilized to measure PMTCT quality, but such assessments may not be objective, scalable, or sustainable. Routine data have several advantages. By definition, routine data are readily available at minimal cost in any facility and can compare quality across diverse settings and over time. Routine data also reflect current PMTCT regimens and therefore adapt to changing guidelines. Previous work by our group has demonstrated that routine data can meaningfully classify facilities’ PMTCT performance. 15 Despite the urgent need to quantify the quality of ARV delivery across facilities, 9 few other studies have used routine data to describe performance. Only one 16 has been conducted in the era of Option B+, but its performance definition was based on HIV testing and retention in care, not ARV coverage; others have examined nevirapine coverage.12,17
This exploratory study aimed to quantify the associations between a variety of health systems factors and delivery of high quality, currently recommended PMTCT in three countries in sub-Saharan Africa using routinely available health facility data.
Methods
This multi-country, cross-sectional study was part of a randomized trial investigating quality improvement to optimize PMTCT services. 18 In total, 90 ANC facilities were sampled in Côte d’Ivoire, Kenya, and Mozambique (30 per country); countries that were chosen to reflect western, eastern, and southern sub-Saharan Africa. In Côte d’Ivoire, sites were selected from those that (a) partnered with Health Alliance International, a non-governmental organization affiliated with the University of Washington, and (b) saw ≥10 HIV-positive pregnant women in 2012. Of 31 eligible sites, one was randomly deleted. In Kenya, facilities were selected to maximize heterogeneity in HIV prevalence from among those affiliated with the Network of AIDS Researchers of Eastern and Southern Africa (NARESA). In Mozambique, all health facilities were selected in three districts within Sofala Province, where the Beira Operations Research Center is located; the districts were chosen for convenience and to include both urban and rural settings.
The 90 sampled facilities were ranked based on PMTCT performance score, defined as the proportion of pregnant women tested for HIV at first ANC visit (ANC1) multiplied by the proportion of HIV-positive pregnant women who received dual or triple ARV regimens, two key steps along the PMTCT cascade that have quantified facility performance previously. 15 By taking their product, we calculated the proportion of eligible women who received both services. Only women on ART or with evidence of a positive HIV test would be exempt from HIV testing; self-report was not sufficient. Operationally, because study data were collected before Option B+, nearly all women should have received an HIV test during their first ANC visit. Monthly data were averaged over several months to provide stable estimates. In Côte d’Ivoire, testing coverage data were aggregated over January to June 2013, and ART coverage data were aggregated over July 2012 to June 2013 (registries distinguished between HIV tests in first or subsequent ANC visits beginning in January 2013). In Kenya, data were aggregated from January to June 2012, and in Mozambique, data were aggregated from January to December 2012. In Côte d’Ivoire and Mozambique, routine data to calculate performance scores were obtained from monthly reports; in Kenya, they were obtained directly from health facility registries.
Trained study assistants collected further data regarding health facility characteristics from the 10 highest and 10 lowest ranked facilities per country (n = 60), during in-person visits between May 2013 and January 2014. Whenever possible, data were obtained directly from the facility registry. Facility staff (facility director, director of Maternal & Child Health (MCH) services, and/or director of PMTCT services, as appropriate) were interviewed to obtain any data that was not or could not be documented in the registry.
Variables in the study instrument were chosen to reflect four of the six core areas of the WHO’s health system building blocks 4 : service delivery; health workforce; information; and medical products, vaccines, and technologies. Specifically, these included characteristics of facility setting (location; public/private/mixed; NGO support; year of PMTCT initiation; distance to reference laboratory; air conditioning), available services (community linkages; active tracing of women/children lost to follow-up; support groups for HIV-positive mothers; on-site CD4 testing; on-site Pima CD4 machine; stock-outs of ARVs and HIV tests; lag in receiving CD4 test results), patient volume (catchment area population; number of ANC1 visits, deliveries, and postpartum visits over the prior six months), and staffing (number of health workers of each cadre).
For the analysis, absolute performance score was used – rather than relative performance, which identified facilities for data collection – because ideally PMTCT service quality should be high in absolute, not relative, terms. To quantify associations, we fit generalized linear models with a logit link function, binomial distribution, and robust standard errors, adjusting for country using indicator variables to account for differences in health systems and routine data reporting. To account for differences in size, facilities were weighted using the reciprocal of the expected variance of the product of two proportions, [n1n2/(n1 + n2)], where n1 = number of ANC1 visits and n2 = number of HIV-positive women in a given facility (the denominators of the two proportions multiplied to calculate performance score). These models yielded odds ratios that could be interpreted as the change in the likelihood that an HIV-positive woman would receive both an HIV test in ANC1 and appropriate ARVs. In sensitivity analyses, the two measures that were multiplied to calculate performance score were disaggregated into separate outcomes.
Variable definitions to aggregate health workers within health facilities by country.
MCH: maternal and child health.
Other health facility workers were included only if they could meaningfully impact PMTCT service delivery, given their responsibilities within each country’s health system.
The ethics review boards of the Ministries of Health in Mozambique and Côte d’Ivoire, and of Kenyatta National Hospital in Nairobi, Kenya each approved the study. The study was reviewed by the Institutional Review Board at the University of Washington and deemed to be exempt from approval. All analyses were completed using Stata version 13.1 (College Station, TX).
The study sponsors had no role in the study design, the collection, analysis, or interpretation of the data, the writing of the report, or the decision to submit for publication.
Results
The 60 health facilities in the study saw 38,611 ANC1 visits, 38,366 deliveries, and 18,281 postpartum visits over the six months prior to data collection. Of women presenting for ANC at study facilities, 91% (interquartile range, 86%–99%) were tested for HIV in ANC1, and of those eligible, 54% (interquartile range, 25%–86%) were given dual or triple ARV regimens. The HIV prevalence among ANC attendees ranged from 2.8% (standard deviation (SD) = 1.3%) in Côte d’Ivoire to 5.2% (2.3%) in Kenya and 12.5% (6.1%) in Mozambique. Performance differed significantly across countries (p = 0.002): Kenya had the highest mean performance score of 0.665, while those in Côte d’Ivoire and Mozambique were 0.315 and 0.492, respectively. Facilities in Kenya also had most experience offering PMTCT (mean 7.7 years), compared to Côte d’Ivoire and Mozambique (3.6 and 5.1 years, respectively).
Characteristics of health facility setting, services, staffing, and staffing workloads, and mean performance scores of 60 health facilities offering PMTCT services in Côte d’Ivoire, Kenya, and Mozambique.
ANC: antenatal care; ANC1: first antenatal care visit; NGO: non-governmental organization; PMTCT: prevention of mother-to-child transmission of HIV; SD: standard deviation; AZT: zidovudine.
Variables for staffing levels and staffing workloads were modeled using quintiles (excepting variables for which the distribution of the data did not yield five equal groups). Performance score was defined as the product of two proportions: the proportion of pregnant women tested for HIV in first antenatal care visit, and the proportion of HIV-positive pregnant women who received dual or triple antiretroviral medications.
Percentage excludes unknowns, if any.
Outreach service provision, campaigns, education session, or community meetings.
Missing for three facilities with missing values for total number of nurses, and undefined for one facility with no nurses.
Undefined for seven facilities with no physicians.
Undefined for 16 facilities with no other health workers.
Missing for three facilities with missing values for total number of nurses.
Clinic characteristics and likelihood of HIV-positive pregnant women being tested for HIV in first antenatal care visit and receiving appropriate antiretrovirals, in 60 facilities offering PMTCT in Côte d’Ivoire, Kenya, and Mozambique.
ANC: antenatal care; ANC1: first antenatal care visit; AZT: zidovudine; NGO: non-governmental organization; PMTCT: prevention of mother-to-child transmission of HIV; aOR: adjusted odds ratio; CI: confidence interval.
Variables under patient volume were modeled using quintiles.
For variables with >2 categories, p values are from a Wald test of the significance of the beta-coefficients of all categories jointly, with each category included in the regression model as an indicator variable.
Adjusted for country using indicator variables (Côte d’Ivoire/Kenya/Mozambique).
Outreach service provision, campaigns, education sessions, or community meetings.
Patient volume, as measured by the catchment area population served by each health facility, ANC1 visits and postpartum visits in the prior six months, was associated with testing and ARV coverage in a U-shaped manner; mid-level patient volume was associated with lower likelihoods of HIV-positive pregnant women receiving both testing and ARV medications than either low or high patient volumes (Figure 1).
Patient volume of health facilities and their associations with the likelihood of HIV-positive pregnant women being tested for HIV in first antenatal care visit and receiving appropriate antiretroviral medications, in 60 health facilities offering PMTCT services in Côte d’Ivoire, Kenya, and Mozambique. (a) Catchment area population, by quintile; (b) first antenatal care visits, by quintile; (c) deliveries, by quintile; and (d) postpartum visits, by quintile. The referent category is lowest quintile for all panels, as indicated by the red line at y = 1. p values are from Wald tests of the significance of the beta-coefficients of all categories jointly, with each category included in the regression model as an indicator variable. ANC: antenatal care; aOR: adjusted odds ratio; CI: confidence interval; PMTCT: prevention of mother-to-child transmission.
Associations between clinic characteristics and percentage of women tested for HIV in first antenatal care visit and percentage of HIV-positive pregnant women who received appropriate antiretroviral medications of 60 health facilities offering PMTCT services in Côte d’Ivoire, Kenya, and Mozambique.
ANC: antenatal care; ANC1: first antenatal care visit; ARV: antiretroviral medication; AZT: zidovudine; NGO: non-governmental organization; PMTCT: prevention of mother-to-child transmission of HIV; aOR: adjusted odds ratio; CI: confidence interval.
Adjusted for country using dummy variables (Côte d’Ivoire/Kenya/Mozambique).
For variables with >2 categories, p values are from a Wald test of the significance of the beta-coefficients of all categories jointly, with each category included in the regression model as an indicator variable.
Outreach service provision, campaigns, education sessions, or community meetings.
Discussion
To our knowledge, this is the first study to quantify associations between health facility factors and performance in delivering currently recommended PMTCT regimens using routinely collected outcome data. In three countries in sub-Saharan Africa, ANC1 visits per nurse, per physician, and per health worker overall were inversely correlated with the likelihood that HIV-positive pregnant women would receive HIV testing in ANC1 and dual or triple ARV regimens. Low or high patient volume and infrastructure (on-site air conditioning and Pima CD4 machine) were also associated with higher likelihood of receiving HIV testing and ARVs.
Performance scores differed significantly by country. The association between years of experience in providing PMTCT and performance was attenuated after adjusting for country; country-to-country performance variation may have been due to underlying differences in experience. Over time, therefore, PMTCT service quality may tend to improve. Most facilities offered extensive services to support patients. The widespread availability of such services is encouraging, though it attenuated this study’s ability to detect any associations with performance; further, such services may decrease loss to follow-up, 19 which this study’s performance definition would not capture. The U-shaped association between performance and patient volume in this study was also observed with single-dose nevirapine coverage. 12
Staffing variables were significantly associated with performance. Nurse workload was inversely associated with performance; each additional ANC1 visit per month per nurse was associated with a 4% (1%–6%) decline in the likelihood that a given HIV-positive woman would be tested for HIV and receive appropriate ARVs. This may have driven the overall association between performance and the workload per health worker, overall (adjusted odds ratio (aOR) = 0.92, 0.88–0.96). Physician workload was significantly associated with likelihood of testing and ARV coverage, but much less substantially than among nurses (for an increase of 100 monthly ANC1 visits per physician, aOR = 0.81, 0.70–0.95, whereas for nurses, the same aOR was 0.02, 0.001–0.28). Nurses rather than physicians are primarily involved in routine care of pregnant and postpartum women, particularly since the advent of task shifting. 20
This study has several strengths. The study countries are diverse in terms of geographic location (western, southern, and eastern sub-Saharan Africa), HIV prevalence, and underlying health systems, which increases the generalizability of the results. Routinely collected data were used to rank facilities’ performance, using methods that may be inexpensively and rapidly applied to any facility offering PMTCT. These methods provide urgently needed data to maximize quality of ART delivery while minimizing cost, which are necessary to use stagnant ART funding most efficiently. 9 Performance definitions were concordant with currently accepted PMTCT regimens. Facility characteristics were ascertained in person by trained study staff using a standardized data collection instrument. Finally, workloads were used in addition to absolute number of health workers, which may more accurately capture the ability of health workers to deliver care.
The study was not without limitations. First, the cross-sectional nature of data collection precludes any causal inferences, though staffing levels have long been recognized as key determinants of ARV delivery.5–7,21 Second, characteristics of the patient population served by each facility were unavailable, aside from catchment area size and HIV prevalence. Population-level patient characteristics – such as PMTCT knowledge and HIV testing prevalence – may impact single-dose nevirapine coverage, 12 and therefore may affect this study’s outcome, which included ARV coverage. Furthermore, the complexity of a facility’s patient caseload may impact the workload of providers. However, it is unlikely that observed associations between staffing levels and performance were entirely due to confounding by patient characteristics, as such confounding could also create associations between other facility characteristics (e.g., urban setting), depending on the patient characteristic. Third, the performance definition may not capture differences in retention; however, many of the reasons women are lost to follow-up during the PMTCT cascade may not be modifiable by health facilities (e.g., traveling to deliver near family). 22 Facility-level determinants of retention merit a separate study from the present one, which aimed to identify health facility factors associated with high-quality service delivery to women who do present for care. Data were unavailable on staff attendance, which may have led to misclassification and undermined our ability to detect associations between staff workloads and PMTCT service quality. Routine data were not collected for research purposes, though the quality of routine data is high in Mozambique. 23 In Kenya, data were extracted directly from facility registries, which are more accurate in estimating PMTCT coverage than monthly reports. 24 Finally, because this study’s goal was to generate hypotheses rather than test one specific hypothesis, future research should confirm its findings.
This study’s results support the inference that human resources are critical for the delivery of effective PMTCT services in sub-Saharan Africa. The workload of nurses was more strongly correlated with the completion of steps along the PMTCT cascade than that of physicians or other health workers, perhaps because physicians play less of a direct role in patient care in resource-limited settings. Even in high-income settings, a large body of evidence points to staffing levels of nurses, rather than physicians, as critical to maximizing health outcomes.25,26 Future research is warranted into how best to distribute scarce health workers to optimize PMTCT service delivery. Other modifiable aspects of human resources – such as absences, payment interruptions, and policies regarding private sector work – may also impact performance and deserve further investigation.
Shortages of health professionals are arguably the “greatest health system constraint in achieving health goals,” 27 and health worker expansion is one of WHO’s core building blocks for health system strengthening. 4 High patient volume may also directly reduce quality by shortening visit duration, a problem that could be compounded as ANC is increasingly utilized as a vehicle to deliver a broad array of health services. 28 Though task shifting has been proposed to address the deficit of highly skilled health professionals in sub-Saharan Africa,20,29,30 task shifting alone may be insufficient if the numbers of health workers who absorb new tasks are stagnant.
Increasing the number of health workers is recognized as a key component of health system strengthening. 4 Based on the results of this and other studies, investments in human resources – perhaps in particular, nurses – may be key to maximizing the effectiveness PMTCT services.
Footnotes
Acknowledgments
We gratefully acknowledge the dedication, insight, and hard work of all members of the SAIA Study Team. Members include Ahoua Koné, Julia Robinson, S Adam Granato, Seydou Kouyaté, Grace Mbatia, Grace Wariua, Martin Maina, Peter Mwaura Njuguna, Joana Coutinho, Emelita Cruz, Quincy Moore, Justina Zucule, Cathy Michel, Bradley Wagenaar, and James Pfeiffer. In addition, we appreciate the statistical expertise of Jim Hughes. The underlying dataset can be accessed at
. This work was presented at the American Public Health Association’s 142nd Annual Meeting, November 19, 2014.
Author contributions
ASR had full access to all study data, conducted all statistical analyses, wrote the initial draft of the manuscript, and made the final decision to submit the paper for publication. SG, RN, and MFC oversaw data collection and provided technical expertise. CF, JNW, and SG provided technical expertise. KS conceived of the project, oversaw implementation, and provided statistical expertise. All authors provided comments on the manuscript and read the final version.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the President’s Emergency Plan for AIDS Relief and the National Institutes of Health [grant number R01HD075057: awarded to KS], the National Institutes of Health [grant number P30AI027757: awarded to the University of Washington Center for AIDS Research, and grant number K02TW009207: awarded to KS]; the Doris Duke Charitable Foundation’s African Health Initiative [awarded to KS]. The content is solely the responsibility of the authors and does not necessarily represent the official views of any of the funding agencies. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
