Abstract
The sensitivity of rapid diagnostic tests (RDT) for Chagas disease is not great enough for their single use. The aim of this paper was to evaluate the performance of two RDTs for Chagas disease, used simultaneously. Two different RDTs (A and B) were performed in 64 and 42 serum samples that were negative and positive, respectively, by conventional serological techniques. Validity and reliability of both tests were evaluated individually and simultaneously. Sensitivity was 90.5% and 97.6%, and specificity was 100% and 93.8%, for RDT A and B, respectively. The κ statistic was 0.96. When both RDTs were used simultaneously, sensitivity was 97.4%, specificity was 100% and the discordance percentage 6.6%. The combined use of two RDTs with serum samples is an acceptable application in healthcare centres.
Introduction
Chagas disease (CD) is a blood and tissue parasitic disease caused by the protozoan Trypanosoma cruzi (T. cruzi), endemic to the American continent. It is prevalent in impoverished rural areas where the insect vector is present. Moreover, it has extended to urban areas within and outside the continent owing to population migrations. 1
Diagnosis in the chronic phase of infection requires detection of specific antibodies by two different serological tests which detect antibodies against different antigens; these must yield concordant positive results. The most commonly used conventional serology (CS) tests are indirect haemagglutination (IHA) and enzyme-linked immunosorbent assay (ELISA). When results are discordant, a third assay is performed, usually indirect immunofluorescence (IFI). 2 All these tests need to be performed in healthcare centres (HCC) that have, at minimum, laboratory facilities for clinical analyses, which is not always possible in regions where CD has the greatest impact.
Immunochromatograpic tests with colloidal gold, commonly named rapid diagnostic tests (RDTs), have been recently developed; these assays have some advantages, including technical simplicity, conservation of the kits at room temperature, possibility of individual application and rapid reading of results with no need for an equipped laboratory. These characteristics make RDT very useful as screening tests in distant locations; however, a positive result should be confirmed later in a laboratory by CS. The low sensitivity values obtained with RDT by different authors suggest that they are useful only if used in parallel with a CS test, rendering them less useful in the field.3–8 This low sensitivity is observed mainly when a whole blood sample is used, with test performance being improved when applied to serum samples. Diagnostic sensitivity can be enhanced by performing tests simultaneously on a single sample; however, to date, this option has not been assayed with RDT for CD.
Methods
Two RDT detecting antibodies against different T. cruzi antigens were applied individually and simultaneously to serum samples processed also by CS and their results were compared with CS reference tests.
Serum samples were obtained from patients aged >18 years who attended HCCs in localities from a northern Santa Fe province, located in the geographic zone called Gran Chaco, Argentina, of intermediate endemicity for CD. 9 None of the patients had received aetiological treatment for CD before the study. All the patients were free from immunologically mediated diseases. Blood samples were collected by venipuncture using disposable sterile materials; sera were separated by centrifugation at the local HCC, preserved in the refrigerator and transported to the laboratory of the Centre for Research on National Endemic Diseases of the National University of Litoral (CIEN-UNL), where they were processed.
All samples were subjected to IHA (IHA Chagas Polychaco, Lemos Laboratory SRL) and ELISA (Chagatest ELISA, Wiener Lab SAIC), following the manufacturer’s instructions. When results were discordant, IFI was performed with commercial conjugates and smears prepared with T. cruzi epimastigotes of Tulahuen 0 strain. 10 The samples were processed at the laboratory of CIEN-UNL, which complies with the external quality controls by the National Parasitology Institute ‘Dr. Mario Fatala Chabén’, the national-level reference organisation.
To evaluate the RDTs, only those samples with concordant results by IHA and ELISA were used. Negative (n = 64) and positive (n = 42) samples by CS were selected. For IHA, the cut-off titre of 1/16 was taken, following the manufacturer’s instructions. The titre of positive samples was within 1/16 and 1/512, with a mode value of 1/128. For ELISA, the cut-off value was calculated in each run and the optical density (OD) index was calculated by dividing the optical density of the sample by the cut-off of the run. The mean OD index of negative and positive samples was 0.490 and 4.67, respectively. The following commercial kits were used, following the manufacturers’ instructions: RDT A: WL Check Chagas (Wiener Lab SAIC, Argentina); RDT B: SD BiolineChagasAb Rapid (Standard Diagnostics Inc., Korea)
Two researchers performed the RDTs using a double-blind procedure; neither of them knew the previous results by CS. All the results were read and interpreted by both researchers.
To evaluate the reliability of the RDT, the percentage of overall agreement between RDTs, the Chamberlain’s percent positive agreement and the κ statistic were calculated. Both RDTs were validated by comparing their results with those obtained by CS, which was considered the reference result. Sensitivity and specificity of each RDT were estimated individually and for both tests as unique result.
The patients signed an informed consent document especially elaborated for this study. CS results were delivered to each patient separately and their significance was explained. Seropositive patients were referred to the HCC for treatment, following national and provincial regulations. This study was evaluated and approved by the Bioethics Committee of the Ministry of Health of Santa Fe Province.
Results
Results of CS vs. RDT A and RDT B.
Results of serology for CD by RDT A and B.
Percentage of overall agreement = 93.3%.
Chamberlain’s percent positive agreement = 84.4%.
Kappa statistic = 0.96.
Results of serology for CD using simultaneous RDTs vs CS.
Serological status base on concordant indirect hemagglutination assay (IHA) and enzyme-linked immunosorbent assay (ELISA).
†Status defined by concordant result of RDTs 1 and 2.
Results of both RDTs were discordant in 7/106 samples (6.6%).
Results of serology for CD using simultaneous RDTs + CS in discordant samples vs. CS.
Serological status base on concordant indirect hemagglutination assay (IHA) and enzyme-linked immunosorbent assay (ELISA).
†Status defined by concordant result of RDTs 1 and 2, or defined by IHA and ELISA in case of a discordant result.
Discussion
In this study, the validity of two RDTs (A and B) for the diagnosis of CD at the chronic stage was evaluated individually in serum samples and the agreement of their results was assessed. Moreover, validity of the use of both simultaneous RDTs was assessed and the results were compared with the reference CS test.
RDT A exhibited greater specificity than RDT B, yielding a lower number of false-positive results, whereas RDT B had greater sensitivity; however, neither RDT reached 100% sensitivity and are therefore not considered suitable for use as a single screening test. Sensitivity and specificity values of these RDTs are similar to those reported by Sánchez-Camargo et al., who evaluated 11 tests individually, and to values reported in other studies using serum samples, but better than values reported using whole blood.3–7
An excellent correlation was observed between the results of both RDTs, as shown by the high percentage of overall agreement, the Chamberlain’s percent positive agreement and the κ statistic, with the latter value minimising the influence of agreements due to chance.
International organisations recommend the simultaneous use of two tests for the diagnosis of CD at the chronic stage: one of high specificity and another of high sensitivity. 11 Several alternatives have been proposed to perform CS in areas distant from HCCs, such as collecting blood samples on filter paper,12,13 preserving blood in glycerin 14 and collecting oral mucosal transudate specimens. 15 Although these studies yielded good results, they required transport of all samples to the laboratory and the need to return to the field for venous blood sampling of positive patients, with inherent expenses, loss of patient follow-up and delay in results.
Based on the present results, we propose using a RTD with high specificity and another RTD with high sensitivity. The simultaneous use of both RDTs with serum samples allows us to obtain a very reliable diagnosis of CD at the chronic stage in remote areas and with minimum equipment (a centrifuge), thereby complying with international recommendations. Given the short time involved in the whole process, including blood sampling, centrifugation, processing and RDT reading, the results can be delivered almost immediately. Thus, only discordant samples, which represent a very low percentage, would have to be transported to a laboratory in a HC to be resolved using a third method (IHA, ELISA or IFI). Efforts should be focused in optimising RDT with whole blood so that there will be no need for sampling centrifugation in the future.
Footnotes
Acknowledgements
The authors thank the patients who agreed to participate voluntarily in this study, the health staff from the healthcare centres and Dr. Marcelo Nepote, Chief of the Chagas Program of Santa Fe Province.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was financially supported by Universidad Nacional del Litoral (CAI+D 50320160200287 LI).
