Abstract
Assays to determine cross-sectional HIV incidence misclassify some individuals with nonrecent HIV infection as recently infected, overestimating HIV incidence. We analyzed factors associated with false-recent misclassification in five African countries. Samples from 2197 adults from Botswana, Kenya, South Africa, Tanzania, and Uganda who were HIV infected >12 months were tested using the (1) BED capture enzyme immunoassay (BED), (2) avidity assay, (3) BED and avidity assays with higher assay cutoffs (BED+avidity screen), and (4) multiassay algorithm (MAA) that includes the BED+avidity screen, CD4 cell count, and HIV viral load. Logistic regression identified factors associated with misclassification. False-recent misclassification rates and 95% confidence intervals were BED alone: 7.6% (6.6, 8.8); avidity assay alone: 3.5% (2.7, 4.3); BED+avidity screen: 2.2% (1.7, 2.9); and MAA: 1.2% (0.8, 1.8). The misclassification rate for the MAA was significantly lower than the rates for the other three methods (each p<0.05). Misclassification rates were lower when the analysis was limited to subtype C-endemic countries, with the lowest rate obtained for the MAA [0.8% (0.2, 1.9)]. Factors associated with misclassification were for BED alone: country of origin, antiretroviral treatment (ART), viral load, and CD4 cell count; for avidity assay alone: country of origin; for BED+avidity screen: country of origin and ART. No factors were associated with misclassification using the MAA. In a multivariate model, these associations remained significant with one exception: the association of ART with misclassification was completely attenuated. A MAA that included CD4 cell count and viral load had lower false-recent misclassification than the BED or avidity assays (alone or in combination). Studies are underway to compare the sensitivity of these methods for detection of recent HIV infection.
Introduction
A
A critical limitation of the BED-CEIA for HIV incidence determination is that individuals with long-standing HIV infection are often misclassified as recently infected. This type of misclassification can lead to a significant overestimation of HIV incidence rates, and has prompted the Joint United Nations Programme on HIV/AIDS (UNAIDS) to discourage the use of the BED-CEIA for HIV incidence determination. 7 Factors previously associated with misclassification of the BED-CEIA in African populations include low HIV viral load, low CD4 cell count, and long-term antiretroviral therapy (ART). 8 –12 However, none of those studies has compared false-recent misclassification among demographically similar populations in different African countries, and little is known about the frequency and nature of false-recent misclassification using the avidity assay, especially in an African setting.
The Incidence Assay Critical Path Working Group has recently recommended using a testing algorithm for HIV incidence that combines results from two different assays to reduce misclassification. 13 This approach was used in a recent study from Rwanda, which demonstrated that combining the BED-CEIA with an avidity assay based on the AxSYM limited false-recent misclassification while maintaining adequate sensitivity for detection of recently infected individuals. 14 While it is important to limit misclassification of individuals with long-standing infection as recently infected, it is also desirable to identify recently infected individuals, and to maximize the length of time where laboratory assays reliably identify infections as recent (the window period for recent infection). The goals of this study were to compare the false-recent misclassification rates of four different laboratory approaches for HIV incidence determination, and to identify factors associated with false-recent misclassification using each of these testing approaches: (1) the BED-CEIA, (2) an avidity assay, (3) the BED-CEIA and the avidity assay used jointly with elevated assay cutoffs (BED+avidity screens), and (4) a multiassay algorithm that included the BED+avidity screens, as well as CD4 cell count and HIV viral load. The frequency of misclassification and factors associated with misclassification were assessed by testing samples obtained from a cohort of men and women from Botswana, Kenya, South Africa, Tanzania, and Uganda who were known to have been infected with HIV for at least 12 months.
Materials and Methods
Samples used for analysis
Samples were obtained from 2197 HIV-infected participants in the Partners in Prevention HSV/HIV Transmission Study, 15 a clinical trial that enrolled stable, HIV-serodiscordant couples (one partner HIV infected and one partner HIV uninfected) from sub-Saharan Africa to investigate the impact of acyclovir treatment on HIV transmission. We tested samples that were collected from HIV-infected participants a median of 21 months after enrollment (range 12–24 months). The duration of infection was calculated based on the participants' report of their first positive test date: using this approach, participants were infected a median of 25 months (interquartile range 20–34, range 12–253). Samples were collected from participants from Botswana (N=199), Kenya (N=902), South Africa (N=330), Tanzania (N=138), and Uganda (N=628); some samples from Uganda were obtained from an ancillary study. 16 Epidemiologic and laboratory data, including HIV viral load and CD4 cell count, were obtained during the trial and were included in the analysis. The use of ART was based on self-report.
Laboratory testing
The BED-CEIA was performed according to the manufacturer's instructions (Calypte Biomedical Corporation, Lake Oswego, OR). The BED-CEIA measures the proportion of total IgG that binds to a branched synthetic tripeptide that contains three 18-amino acid components derived from an immunodominant region of gp41 (regions corresponding to positions 590–607 of HXB2 gp160 in HIV subtypes B, E, and D). 17 Results from the BED-CEIA are reported as normalized optical density units (OD-n). A standard assay cut-off of <0.8 OD-n was used to define recent HIV infection when the BED-CEIA was used alone. 4 The avidity assay was performed using a modified Genetic Systems HIV-1/HIV-2+O EIA (enzyme linked immunoassay, Bio-Rad Laboratories, Redmond, WA) with diethylamine (DEA) as the chaotropic agent. 5 An avidity index (AI) was calculated by dividing the optical density of the DEA-treated well by the optical density of the nontreated well for the same sample, and multiplying by 100. A standard cut-off of <40% was used to define recent infection when the avidity assay was used alone. When the BED-CEIA and avidity assays were used in combination, we used cut-offs of <1.0 OD-n (BED screen) and <80% (avidity screen), respectively. These higher cut-off values were also used in the multiassay algorithm (MAA); in the MAA, recent infection was defined as BED-CEIA <1.0 OD-n, avidity index <80%, HIV viral load of >400 copies/ml, and CD4 cell count >200 cells/mm3. The cut-offs used in the MAA were selected by analyzing data obtained by testing samples from individuals in other cohorts and clinical studies who had known durations of HIV infection.
Statistical analysis
The misclassification rates with exact 95% confidence intervals (95% CI) were calculated using BED-CEIA alone, avidity assay alone, BED-CIEA and avidity in combination (BED+avidity screens), and the MAA; these frequencies were compared using Fisher's exact test or chi-square test. The association of the misclassification rates of each test method was assessed for age, viral load, CD4 cell count, country of origin, and ART using logistic regression.
Additionally, categories were generated based on the circulating subtypes in each country (subtype C endemic: Botswana and South Africa; subtype A and D endemic: Kenya and Uganda; Tanzania was not included in either group because of the heterogeneity of subtypes in that country). All factors associated in the univariate analysis based on logistic regression (p<0.1) were included in the multivariate analysis. Multivariate logistic regression analysis was performed to identify factors associated with misclassification with each method after adjustment for other factors. All statistical analyses were performed using STATA v11 (StataCorp, College Station, TX).
Human subjects
All work was conducted in accordance with the Declaration of Helsinki. Written consent was provided from each participant for participation in the Partners in Prevention Study. Experiments were conducted with the approval by the appropriate institutional review boards.
Results
We analyzed samples from 763 men and 1434 women enrolled in the Partners in Prevention HSV/HIV Transmission Study; one sample was analyzed for each of the 2197 participants. Each participant was known to have been HIV infected for at least 12 months at the time of sample collection. Though the ages were similar between countries, the proportion of female, virally suppressed, taking ART, and mean viral load was different by country (see Table 1). Of the participants with viral load data, 17% (488/2193) were virally suppressed (viral load <400 copies/ml). Among 1916 participants who indicated that that they were not on ART, 275 (14%) were virally suppressed. Only 6% (142/2197) of participants had a CD4 cell count <200 cells/mm3, and only 0.3% (7/2197) had a CD4 cell count <50 cells/mm3. Nineteen participants (0.8%) had a viral load <400 copies/ml and a CD4 cell count <200 cells/mm3.
SD, standard deviation; virally suppressed, having a viral load <400 copies/ml; ART, antiretroviral treatment; CD4, CD4 cell count (cells/mm3).
Table 2 presents the frequency of false-recent misclassification by the BED-CEIA (BED <0.8 OD-n), the avidity assay (AI <40%), the BED+avidity screens (BED <1.0 and AI <80%), and the MAA (see Materials and Methods). The percent misclassified for the BED-CEIA was 7.6% (95% CI: 6.6%, 8.8%). Country, HIV viral load, CD4 cell count, and ART were significantly associated with misclassification by the BED-CEIA (p<0.02 for all comparisons). The avidity assay misclassified 3.5% (95% CI: 2.7%, 4.3%) of the samples as recently infected. Country was the only factor significantly associated with misclassification (p<0.001). Using the BED+avidity screens, 2.2% (95% CI: 1.7%, 2.9%) of the samples were misclassified as recently infected. With this assay combination, country of origin and ART were significantly associated with misclassification. Using the MAA, 1.2% (95% CI: 0.8%, 1.8%) of the samples were misclassified. Neither ART nor country of origin was associated with misclassification using the MAA (p>0.37 and p>0.41, respectively). The subtype C endemic areas (South Africa and Botswana) had significantly lower rates of false-recent misclassification then the subtype A and D endemic areas (Uganda and Kenya) for the BED-CEIA: 4.9% (95% CI: 3.2%, 7.1%) vs. 8.7% (95% CI: 7.3, 10.2%), p=0.004, the avidity assay: 1.0% (95% CI: 0.3%, 2.2%) vs. 4.6% (95% CI: 3.6%, 5.7%), p<0.001, and the combined BED-CEIA and avidity screens: 1.0% (0.3% to 2.2%) vs. 2.8% (2.0% to 3.7%), p=0.017. The misclassification rate of the MAA was also lower in the subtype C than the A and D endemic areas; this difference was not statistically significant: 0.75% (95% CI: 0.21%, 1.92%) vs. 1.43% (95% CI: 0.90%, 2.17%), p=0.267.
p value<0.05.
p value<0.01.
MAA, multiassay algorithm; AI, avidity index; VL, viral load; OR, odds ratio; CI, confidence intervals; CD4, CD4 cell count (cells/mm3); viral load (copies/ml); ART, antiretroviral therapy. Statistically significant values are shown in bold text. Values with p<0.1 (trends) are in italics.
Multivariate logistic regression was performed to compare the odds of false-recent misclassification by BED-CEIA alone, the avidity assay alone, and the BED+avidity screens (Table 3); because no factors were associated with misclassification using the MAA (p>0.37 for all associations), the MAA results are not shown. For the BED-CEIA, three factors were independently associated with misclassification: country, viral load, and CD4 cell count. The adjusted odds ratio for misclassification was two times higher in Uganda and Kenya than in South Africa. For the avidity assay, the only factor associated with misclassification in the multivariate model was country. The adjusted odds ratio for misclassification was eight times higher in Uganda than in South Africa, and three times higher in Kenya than in South Africa. For the BED+avidity screens, the only factor associated with misclassification in the multivariate model was country of origin, where, for example, the adjusted odds ratio for misclassification was approximately four times higher in Uganda than in South Africa. It is noteworthy that the strength of association for all variables in the univariate analysis was similar to that in the multivariate analysis apart from ART use. ART use was not associated with misclassification by the BED-CEIA, the avidity assay, or the BED+avidity screens when the analysis was adjusted for other variables.
p value<0.05.
p value<0.01.
AI, avidity index; aOR, adjusted odds ratio; CI, confidence interval; CD4, CD4 cell count (cells/mm3); viral load (copies/ml); ART, antiretroviral therapy. Statistically significant values (p<0.05) are shown in bold text. Values with p<0.1 (trends) are in italics.
Discussion
In this study, we compared false-recent misclassification using four different laboratory approaches for HIV incidence determination. This study was based on analysis of samples collected from five countries in East and Southern Africa. A potential limitation of the study was that criteria used for study enrollment may have introduced bias into the cohort. All participants were HSV infected and in a stable HIV discordant relationship; most of the participants were relatively healthy, and a substantial proportion (17%) was virally suppressed. Additionally, the length of time that individuals were infected was not known, although all individuals were known to have been infected for at least 1 year. In the cohort studied, the frequency of false-recent misclassification was 7.6% the BED-CEIA alone, 3.5% using the avidity assay alone, 2.2% using a BED screen and an avidity screen combined (i.e., using both assays with higher assay cutoffs), and 1.2% using a MAA that combined the BED screen, and avidity screen, CD4 cell count, and HIV viral load. In subtype C endemic areas, the misclassification frequency of the MAA was 0.8%.
In univariate models, several factors were significantly associated with false recent misclassification using the BED-CEIA alone, an avidity assay alone, or the BED+avidity screens. These factors included country (for all three methods), HIV viral load (for BED-CEIA), CD4 cell count (for BED-CEIA), and ART use (for BED-CEIA and the BED+avidity screens). In contrast, we did not observe any statistically significant associations between any of the factors examined and false recent misclassification using the MAA. In a multivariate model, the only statistically significant associations observed were for country (for BED and avidity either alone or in combination), viral load (BED-CEIA only), and CD4 cell count (BED-CEIA only). The association that we observed for the BED-CEIA between misclassification and high CD4 cell count (>500 cells/mm3) was surprising, although a previous study from Uganda also demonstrated a similar finding among individuals on ART. 11 In previous studies, individuals with advanced HIV disease (e.g., CD4 cell counts <200 cells/mm3) were more likely to be misclassified as recently infected than those with higher CD4 cell counts. That association was presumed to reflect immunologic decline, with impaired antibody production. The frequency of BED-CEIA misclassification that we observed in Uganda (8.6%) was lower than the misclassification frequency reported in a previous study in Uganda (14.9%) 18 ; this difference may reflect the fact that individuals in the cohort studied in this report were less likely to have advanced HIV disease.
In these analyses, associations between participants' country of residence and false recent misclassification are likely to reflect differences in the prevalent HIV subtypes, although other factors may also have influenced assay performance among the countries studied. Misclassification rates were higher for Kenya and Uganda (East African countries where subtypes A and D are prevalent) than for South Africa and Botswana (Southern African countries where subtype C is prevalent). The frequency of misclassification was two times higher in the subtype A and D endemic countries using the BED-CEIA, and was four to five times higher in those countries using the avidity assay. Previous studies have shown that HIV subtype can impact the performance of cross-sectional incidence assays. 6,19 In South Africa and Botswana almost all infections are subtype C, while in Kenya and Uganda, the most common subtypes are A and D, with some infections caused by subtype C and A–D recombinants. In Tanzania, subtypes A, C, and D and intersubtype recombinant strains are prevalent. 20
This report reveals significant differences in the rate of false-recent misclassification using different laboratory methods developed for cross-sectional HIV incidence determination. The lowest misclassification rates were observed with the MAA (1.2% overall, 0.8% for subtype C endemic areas). A key feature of the MAA is inclusion of two independent serologic assays (the BED-CEIA and the avidity assay); this increases the specificity of the MAA for detection of recent HIV infection. For example, when samples analyzed in this report were tested using a similar algorithm that did not include the BED-CEIA (with recent infection defined as avidity <80%+CD4 cell count >200 cells/mm3+HIV viral load >400 copies/ml), the false-recent misclassification rate was four times higher that the rate obtained using the four-assay MAA. One advantage of using the BED-CEIA and the avidity assay for HIV incidence testing is that these assays can be performed using commercially available kits (with a minor modification in testing procedures for the avidity assay). Neither of these assays requires use of large, specialized equipment, which is an advantage in resource-limited settings. The avidity assay is based on the BioRad 1/2+O ELISA kit, which was designed for diagnosis of HIV infection. The target antigens in this kit are large polypeptides (p24 and gp160) that include multiple antigens that are recognized by anti-HIV antibodies from individuals infected with diverse HIV strains. 21 This assay is used globally for diagnosis of HIV infection and performs well across all subtypes for the detection on anti-HIV antibodies. Our results demonstrate that the avidity assay based on the BioRad 1/2+O ELISA has a relatively low rate of false-recent misclassification when samples are analyzed from African individuals who are likely to be infected with different HIV subtypes.
A disadvantage of the MAA is the requirement for CD4 cell count data. Storage of cryopreserved samples that can be used for retrospective CD4 testing is costly and not feasible in many settings. Therefore, in most settings, CD4 cell count data must be obtained at the time of sample collection. We are currently evaluating whether CD4 testing can be replaced in the MAA by a high resolution melting (HRM) assay that measures HIV diversity without sequencing, 22 which can be performed using stored serum or plasma samples. In the MAA, viral load testing is needed only for a small subset of samples (i.e., those with BED-CEIA <1.0 OD-n+avidity <80%+CD4 >200 cells/mm3). This is an advantage, since HIV viral load tests are the most expensive component of the MAA. We feel it is important to include a direct measurement of HIV viral load in the MAA, rather than relying on self-report of antiretroviral drug (ARV) use as a surrogate of viral suppression. Self-reports of ARV use may be unreliable, and some individuals on ARV therapy may not be virally suppressed. Furthermore, our previous studies have shown a high rate of false-recent misclassification among HIV-infected elite suppressors who have low or undetectable viral loads in the absence of ARV use. 23 In this study, ARV use was not associated with false-recent misclassification in multivariate models that also included HIV viral load.
This report is focused on the specificity of laboratory methods for HIV incidence determination. The specificity of HIV incidence algorithms substantially impacts their performance, since the number of prevalent infections is usually much greater than the number of incident infections. We recognize, however, that the sensitivity for detecting recent infections is also an important indicator of test performance. Furthermore, our nonrecent samples included only those samples with duration of infection >12 months. The operating characteristics (i.e., sensitivity and specificity) of the MAA are expected to vary with different definitional criteria for recent versus nonrecent infections based on duration of infection. Further studies are needed to assess the sensitivity of the MAA in detecting recent HIV infection, the window length for differentiating recent versus nonrecent infection, and whether sensitivity varies by subtype.
Footnotes
Acknowledgments
The authors would like to thank the Partners in Prevention study teams and participants, S. Michelle Owen (United States Centers for Disease Control and Prevention), Erin Kahle (University of Washington), Harald S. Haugen (University of Washington), and Amy Mueller (Johns Hopkins University).
This work was supported by (1) the HIV Prevention Trials Network (HPTN) sponsored by the National Institute of Allergy and Infectious Diseases (NIAID), the National Institute of Mental Health (NIMH), the National Institute on Drug Abuse (NIDA), Office of AIDS Research, of the National Institutes of Health (NIH), Department of Health and Human Services (DHHS) (Grants U01-AI46745, U01-AI48054, U01-AI068613, and UM1-AI068613), and the International Maternal Pediatric and Adolescent AIDS Clinical Trials (IMPAACT) Network (U01-AI068632), (2) the Division of Intramural Research, NIAID, (3) the NIAID (Grant 1R01-AI095068), and (4) the Bill and Melinda Gates Foundation (Grant 26469).
The findings and conclusions in this article are those of the authors and do not necessarily represent the views of the National Institutes of Health. Use of trade names is for identification purposes only and does not constitute endorsement by the National Institutes of Health and Prevention or the Department of Health and Human Services.
Author Disclosure Statement
No competing financial interests exist.
