Abstract
Background
E
To be useful for cross-sectional HIV incidence estimation, an assay or multi-assay algorithm (MAA) must identify a majority of samples from recently infected individuals without misclassifying samples from long-term infections (e.g., >2 years after HIV seroconversion) as recent infections. Low viral load (VL) (natural 10 or drug-induced 11 ), low CD4 cell count, 12,13 and HIV subtype D 14 are associated with misclassification by cross-sectional incidence assays. The performance of incidence assays can be characterized by two variables: the mean duration of recent infection (MDRI, the average amount of time individuals are considered recently infected for a given assay or algorithm), and the false recent rate (FRR, the frequency that individuals with long-term infection are misclassified as recently infected). 15 –17 The WHO/UNAIDS Working Group on Incidence Assays recommends that incidence assays have an MDRI of >120 days with an FRR <2%. 18 –20
A modified version of the third-generation Bio-Rad GS HIV-1/HIV-2 Plus O EIA is used in MAAs to estimate HIV incidence. 21 –23 However, the GS HIV-1/HIV-2 Plus O EIA is not available in many countries. Fourth-generation HIV screening assays detect HIV p24 antigen as well as anti-HIV antibodies, shortening the window period for detecting HIV infection. In this report, we modified a fourth-generation HIV screening assay [the GS HIV Combo Ag/Ab EIA (Bio-Rad Combo assay)] for measurement of antibody avidity and evaluated the performance of the modified assay by determining the MDRI and FRR at different avidity index (AI) cutoffs. This new incidence assay, referred to as the Bio-Rad Combo Avidity assay, was evaluated alone and in a MAA that included HIV VL.
Materials and Methods
Ethics statement
This study was approved by the Institutional Review Board of the Johns Hopkins University School of Medicine. All trial and cohort studies were conducted according to the ethical standards set forth by the institutional review boards of the participating institutions and the Helsinki Declaration of the World Medical Association. All participants provided written informed consent. This report includes analysis of stored samples and data from those studies. No participants were recruited or followed during the course of this work.
Samples used for analysis
Data analyzed in this report were obtained from testing stored plasma or serum from HIV-infected participants from the United States in the AIDS Linked to the Intravenous Experience Study (ALIVE), 24 the Multicenter AIDS Cohort Study (MACS), 25 the HIV Network for Prevention Trials (HIVNETs) 001/001.1 study, 23 the Johns Hopkins Hospital Clinical Cohort (JHHCC), 26 and the Johns Hopkins Elite Suppressor (ES) Cohort 27 (Table 1). All samples were from adults who likely had clade B HIV infection; a subset of samples from these cohorts were previously determined to have subtype B HIV, and 99% of HIV infections previously characterized from Baltimore were subtype B. 29 HIVNET 001 samples were obtained from HIV seroconverters who were followed up to 4.5 years. Samples from the ALIVE, ES, JHHCC, and MACS cohorts were from individuals who were known to be HIV-infected for at least 2 years before sample collection. 21 Individuals from the ES cohort had a VL <400 copies/ml at three study visits and a VL <50 copies/ml at one study visit without being on antiretroviral treatment (ART). JHHCC samples were from: (1) individuals with one visit before ART initiation and three to eight samples (one per year) after ART initiation, or (2) individuals who were virally suppressed (<400 copies/ml) on ART, but experienced viral breakthrough during follow-up. Additionally, 10 samples known to be p24 positive were obtained from a commercial source (ZeptoMetrix, Buffalo, NY).
Cohort descriptions are provided in the Methods section.
Age at sample collection for HIVNET 001, ALIVE, and MACS; age at HIV infection for JHHCC.
ALIVE = AIDS Linked to the Intravenous Experience Study; HIVNET = HIV Network for Prevention Trial; IQR = interquartile range; JHHCC = Johns Hopkins Hospital Clinical Cohort; MACS = Multicenter AIDS Cohort Study; VL = viral load.
Laboratory methods
Samples were tested using a modification of the GS HIV Combo Ag/Ab EIA (Bio-Rad, Redmond, WA). Assay procedures were modified to measure HIV antibody avidity, by the addition of a denaturing agent, diethylamine (DEA) 6 to disrupt the binding of low-avidity antibodies. In duplicate, 10 μl of sample was mixed with 25 μl of conjugate 1 and 65 μl phosphate-buffered saline (PBS). The samples were incubated for 30 min at 4°C. At all steps, plates were covered with a plastic plate cover rather than a plate sealer. Following sample incubation and the assay protocol wash, 100 μl of 0.025 M DEA (diluted in deionized water) was added to the first well of each sample. Assay wash buffer (100 μl of 1×) was added to the second well of each duplicate pair and the plate was incubated for 30 min at 37°C. The remainder of the assay, beginning with addition of the second conjugate, was run according to the manufacturer's protocol. Each plate included two controls: a sample from an individual with known recent infection (<2 months postinfection, ZeptoMetrix samples 9014–05 or 9014–06) and a sample from an individual with known long-term infection (>2 years postinfection). The results were considered valid if the recent infection control had an AI <40% and the long-term control was >90% AI. Additionally, an HIV-1 antibody-negative and HIV-1 antibody-positive control was included on each plate. The AI was calculated by dividing the optical density (OD) of the DEA-treated well by the OD of the nontreated well for the same sample and multiplying by 100. 30 Samples were classified as assay positive or assay negative based on the AI cutoff. Additionally, any sample where the wash buffer well OD was <1.0 was classified as assay positive.
Statistical methods
MDRI and FRR were estimated for the avidity assay alone and for the avidity assay in a MAA format that included HIV VL, where samples with VL <400 copies/ml were classified as assay negative. The MDRI was estimated using data obtained from samples from the HIVNET 001 cohort that were from individuals known to have been infected for <2 years. The estimated date of seroconversion was either 13 days postacute (HIV RNA+/antibody negative; 4 individuals) or the midpoint between last antibody-negative and first antibody-positive time points; 97 individuals). MDRIs were estimated using AI cutoffs ranging from 20% to 90%. Methods to calculate the MDRI using T = 2 have been described previously. 17,31 The FRR was determined using data obtained from samples from the ALIVE, ES, JHHCC, and MACS cohorts. The FRR (proportion of samples from individuals infected >2 years that were misclassified as recently infected) was determined using AI cutoffs of 20%–90%.
Factors associated with misclassification in the ALIVE and MACS cohorts (AI <80% for individuals infected >2 years) were examined using logistic regression, with general estimating equations and a robust variance estimator as previously described. 32 All factors associated with misclassification (p < .1) were included in the multivariate analysis. To determine if viral breakthrough influenced assay results, the change in AI within an individual was measured for all paired time points from the JHHCC group B samples. Changes in AI between longitudinally paired samples were compared by t-tests for individuals for three pair types: (1) sustained viral suppression, (2) viral suppression followed by viral breakthrough, or (3) viral breakthrough followed by viral suppression. Interoperator repeatability was also assessed by the Pearson's correlation coefficient between independent runs performed by two technicians.
Results
In this report, we analyzed 2,140 antibody-positive samples from 808 individuals with known duration of infection. The first analysis included data from 816 samples from 103 seroconverters in the HIVNET 001 cohort (Fig. 1). By 1 year after HIV seroconversion, AI results for 95% (98/103) of the seroconverters were >40%. Table 2 shows the performance characteristics of the modified Bio-Rad Combo assay alone and in a MAA that includes HIV VL. MDRI estimates ranged from 36.8 days (using an AI of 20% with VL) to 275.6 days (using an AI of 90% without VL). The percentage of samples below each AI cutoff by duration of infection is provided in Supplementary Table S1; Supplementary Data are available online at

Change in AI over time. AI values obtained using the Bio-Rad Combo Avidity assay are shown as a function of years after HIV seroconversion (data from 816 samples from 103 seroconverters in the HIVNET 001 cohort). AI, avidity index.
Cohort descriptions are provided in the Methods section.
CI, confidence intervals; ES, elite suppressor; FRR, false-recent rate; MDRI, mean duration of recent infection.
The second analysis included data from 1,041 samples from 644 participants in the ALIVE and MACS cohorts. Factors associated with misclassification were examined using an AI cutoff of 80% (Table 3). Participant age was significantly associated with misclassification in the univariate analysis, but not in the multivariate analysis. Low VL was significantly associated with misclassification in both univariate and multivariate models [adjusted odds ratio (aOR): 3.26; confidence intervals (95% CIs) = 1.57–6.77). Low CD4 cell count (<50 cells/mm3) was also significantly associated with misclassification in both models (aOR: 8.45, 95% CI = 2.99–23.85).
Cohort descriptions are provided in the Methods section. Statistically significant values (p < .05) are shown in bold text.
aOR, adjusted odds ratio; n, number misclassified; N, number tested; OR, odds ratio.
We next compared data obtained from the four cohorts that included individuals infected >2 years. The median AI and interquartile ranges (IQRs) were: ALIVE: 98.4 (94.3–99.8); MACS: 98.7 (94.3–100.1); JHHCC: 99.0 (94.3–100.2); and ES: 97.6 (94.8–99.1). The FRRs using an AI cutoff of 80% were: ALIVE: 7.2%; MACS: 4.4%; JHHCC: 4.1%; and ES: 0.0%.
While VL was associated with misclassification, the median AIs for virally suppressed and viremic individuals were comparable. The median AI for samples from individuals with VL <400 was 98.2 (IQR = 93.5–100, N = 375); the median AI for samples from individuals with VL >400 was 98.6 (IQR = 94.6–100, N = 774). There was little change in AI values over time among virally suppressed individuals (0.31% decrease per year on ART, Fig. 2); when the values from one outlier were removed whose AI increased over time, the net decrease was 0.72% per year.

Change in AI over time for virally suppressed individuals on ART. AI values obtained using the Bio-Rad Combo Avidity assay are shown as a function of years on ART for a subset of 18 individuals in the JHHCC. These individuals were suppressed on ART with no viral breakthrough events. ART, antiretroviral treatment; JHHCC, Johns Hopkins Hospital Clinical Cohort.
The last analysis assessed the relationship between viral breakthrough and AI (Fig. 3). Representative data from a single individual are shown in Figure 3A. Three different types of paired values were defined and analyzed (Fig. 3A). Results from 20 individuals are shown in Figure 3B. There was mean increase in AI of 2.5% between visits with viral suppression and visits with viral breakthrough (p = .04; Fig. 3B). AI values were significantly correlated between two technologists (r = 0.93; p < .01) when comparing independent runs.

Impact of viral breakthrough on AI.
Discussion
We developed and evaluated an avidity assay for cross-sectional HIV incidence estimation. This assay, the Bio-Rad Combo Avidity assay, is modified from a commercially available fourth-generation HIV screening test. When used in a single assay format, this assay had performance characteristics that were very close to the minimum performance characteristics recommended by the WHO/UNAIDS Working Group on Incidence Assays (an MDRI of >120 days with an FRR <2%). 19 Using an AI cutoff of 50%, the MDRI was 135 days (95% CI: 120–151) with an FRR of 2.1% (95% CI: 1.4–3.0; 26 of 1,324 samples were misclassified as assay positive). Note that this FRR was obtained for a sample set that included virally suppressed individuals (23 elite suppressors and 266 individuals who were virally suppressed on ART); viral suppression is frequently associated with misclassification.
The performance of the Bio-Rad Combo Avidity assay was similar to the performance of an avidity assay based on a third-generation Bio-Rad HIV screening test (the JHU-Bio-Rad Avidity assay). For the previous JHU-modified Bio-Rad Avidity assay, the MDRI was obtained using an AI cutoff of 40% with the same study cohort samples (HIVNET 001); this MDRI is slightly longer than the MDRI of 110 days that we obtained using the same AI cutoff with the new Bio-Rad Combo Avidity assay. The FRRs for these two assays were nearly identical (1.1% vs. 1.3%) for analyses obtained using the same study cohort samples (ALIVE and MACS).
We compared the performance of the Bio-Rad Combo Avidity assay to assays that were recently evaluated by the Consortium for the Evaluation and Performance of HIV Incidence Assays (CEPHIA). 17 In the CEPHIA evaluation, the FRR for individuals on ART was 50% for the CDC-modified Bio-Rad Avidity assay and 58.8% for LAg-Avidity assay; the FRR was 12.9% for elite suppressors for both assays. In contrast, none of the 23 elite suppressors evaluated in this report was misclassified as assay positive using the new Bio-Rad Combo Avidity assay. Using the same set of specimens from the ALIVE and MACS cohorts, the Bio-Rad Combo Avidity assay had a similar FRR to the LAg-Avidity assay, using a LAg-Avidity assay cutoff of 1.5 OD-n (FRR: 5.8% and 4.8%, respectively). 13 The same factors were associated with misclassification in multivariate analysis for these two assays: viral suppression (VL <400 copies/ml) and low CD4 cell count (<50 cells/mm3).
In another report, the third-generation Bio-Rad GS HIV-1/HIV-2 Plus O EIA was modified for incidence testing using urea as the chaotropic agent, rather than DEA. 27 The MDRI of the urea-based assay using an AI of 40% was estimated at 108 days using a CEPHIA qualification panel; the FRR for the assay was 0.89% (95% CI: 0.2%–2.3%). That analysis was performed using 449 samples with different infecting subtypes; samples from virally suppressed individuals were not included. At the same AI cutoff (40%), the Bio-Rad Combo Avidity assay described in this report had an MDRI of 110 days with an FRR of 1.3 (95% CI: 0.7–2.0).
Another avidity assay has also been developed using a different fourth-generation HIV screening assay (the Architect HIV Ag/Ab Combo EIA), which uses an automated system for sample processing. 33 In that assay, samples are incubated with a chaotropic agent during the initial sample incubation period; in contrast, in the assay described in this report, the chaotropic agent incubation occurs in a separate step, after sample incubation and a wash. In the Abbott Combo-based avidity assay, the FRR was 6.6% after excluding specimens from individuals on ART.
In this report, the Bio-Rad Combo Avidity assay was evaluated using HIV subtype B samples from the United States. Further evaluation of this assay is needed for samples from other geographic regions with other HIV subtypes. Additionally, the impact of the timing of ART initiation on antibody maturation needs to be evaluated as very early treatment blunts the antibody response to HIV. 34 With recent evidence demonstrating the benefit of early ART initiation, 35 a greater proportion of individuals infected within the first year of infection will be on ART and this will likely impact most antibody-based measures used from cross-sectional incidence testing. Another problem to address is the capacity to report the presented technology to other laboratories. Assays modified for incidence applications that do not use reagents specifically manufactured for that purpose can be difficult to replicate in different laboratories. Standardized chaotropic agents supplied from commercial vendors would greatly assist in this matter. Further evaluation is also needed to evaluate use of this assay in combination with other assays and biomarkers. 21 Because the fourth-generation Bio-Rad GS HIV Combo Ag/Ab EIA assay is widely available, the Bio-Rad Combo Avidity assay may offer an alternative option for HIV incidence testing in settings, where the third-generation Bio-Rad GS HIV-1/HIV-2 Plus O EIA assay is not available.
Footnotes
Acknowledgments
This work was supported by the HIV Prevention Trials Network (HPTN) sponsored by the National Institute of Allergy and Infectious Diseases (NIAID), the National Institute on Drug Abuse (NIDA), the National Institute of Mental Health (NIMH), and the Office of AIDS Research, of the National Institutes of Health (NIH), Department of Health and Human Services (DHHS) (UM1AI068613), and by R01 AI095068 (NIAID). Additional funding was provided by the Division of Intramural Research, NIAID, NIH.
The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the National Institutes of Health.
Author Disclosure Statement
No competing financial interests exist.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
