Abstract
We studied the use of the INNO-LIA syphilis score assay in the resolution of discordant positive screening results of the Murex ICE Syphilis enzyme immunoassay (EIA) with the confirmatory results of both the Serodia Treponema pallidum particle agglutination (TPPA) and the fluorescent treponemal antibody-absorption (FTA-Abs) assays, for the serological diagnosis of syphilis. This was an observational study on the serum samples received by the Syphilis Laboratory, Hong Kong, during the period from January 2006 to December 2012. A total of 801 serum samples with discordant positive screening EIA results were used. Consensus results of such serum samples were derived from results of the EIA, TPPA and FTA-abs assays. The age range of the individuals was 14 to 104 years (median of 52). There were 369 males and 432 females. Of 378 serum samples, 139 showed agreement among positive results, 23 of 310 showed agreement among indeterminate results and 277 of 465 showed agreement among negative results. The proportions of agreement among positive, indeterminate and negative results were 0.37 (95% CI 0.32–0.42), 0.07 (95% CI 0.05–0.11) and 0.60 (95% CI 0.55–0.64), respectively; kappa 0.55 (95% CI 0.49–0.60). There were 60 serum samples with positive consensus results but negative INNO-LIA syphilis score results and 10 with negative consensus results but positive INNO-LIA syphilis score results. Although the INNO-LIA syphilis score assay can be considered a valid alternative confirmatory test for the serological diagnosis of syphilis, the present study showed that its use in the resolution of discordant positive screening EIA results was moderate. A more extensive characterization of serum samples with discordant reactive screening treponemal test results is necessary.
Introduction
Syphilis is an infectious disease caused by the spirochete bacterium Treponema pallidum subspecies pallidum. Laboratory diagnosis of syphilis depends heavily on serology because the causative organism is not able to grow on any artificial culture media and direct detection of the organism by dark-field microscopy is possible only in the presence of active lesions in the early stages of the disease. The serological tests for syphilis fall into two categories: (1) treponemal tests, which detect specific antitreponemal antibody, e.g. enzyme immunoassay (EIA), Treponema pallidum particle agglutination (TPPA) assay, Treponema pallidum haemagglutination (TPHA) assay, fluorescent treponemal antibody-absorption (FTA-abs) assay and immunoblot assay and (2) non-treponemal tests, which detect non-specific antilipoidal antibody, e.g. Venereal Disease Research Laboratory (VDRL) assay and rapid plasma reagin (RPR) assay. In general, treponemal tests are used to provide the serological evidence of syphilis because they are more sensitive and specific. 1 On the other hand, non-treponemal tests are used in treatment monitoring because the titres correlate with disease activity.
The INNO-LIA syphilis score (LIA) assay is an immunoblot assay methodologically distinct from the EIA, TPPA and FTA-abs assays. The LIA assay uses three recombinant antigens (TpN47, TpN17 and TpN15) and one synthetic peptide (TmpA) electrophoretically separated and blotted to nitrocellulose strips. The antitreponemal antibodies in patients’ sera bind to the antigens and are then detected by enzyme-labeled anti-human immunoglobulin. Enzyme and substrate reaction then produces visible discrete bands. The interpretation of results is based on the number and intensity of reactive bands.
Recently, the LIA assay has been validated and evaluated for use as a confirmatory treponemal test for the serological diagnosis of syphilis.2,3 The LIA assay was shown to have sensitivities of ≥ 92% in detecting the different stages of syphilis. 4 The present study explored the use of the LIA results in the resolution of discordant positive screening EIA results for the serological diagnosis of syphilis.
Materials and methods
Study design and serum samples
This was an observational study on the serum samples received for the serological testing of syphilis by the Syphilis Laboratory, Public Health Laboratory Services Branch, Centre for Health Protection, Department of Health, Hong Kong, during the period from January 2006 to December 2012. The sources of the serum samples included the attendees of social hygiene clinics (servicing patients with sexually transmitted infections), maternal & child health centres (caring for pregnant women and newborns) and an integrated treatment centre (caring for patients with human immunodeficiency virus [HIV] infection) of the Department of Health in Hong Kong, as well as referred serum samples submitted by clinical microbiology laboratories of public hospitals in Hong Kong. Duplicate serum samples were excluded and only the first serum sample of each individual was included. Neither clinical stages of syphilis nor treatment history were detailed on the request forms.
Serological testing of syphilis
All serum samples were screened with the Murex ICE Syphilis EIA (Murex Biotech Limited, Dartford, UK) assay. Negative EIA results were regarded as indicating no serological evidence of syphilis. Where the EIA results were positive, the serum samples were further tested with both the Serodia TPPA (Fujirebio Inc., Tokyo, Japan) and FTA-abs (TrepoSpot IF; bioMérieux, Marcy l’Etoile, France) assays. The positive screening EIA results were regarded as concordant when both the TPPA and FTA-abs results were reactive (i.e. ≥1+). Otherwise, the positive screening EIA results were regarded as discordant and the serum samples were further tested with the LIA (Innogenetics NV, Ghent, Belgium) assay. The testing algorithm was detailed in Figure 1.
Syphilis serological testing algorithm used in the present study.
The treponemal tests were performed according to the manufacturers’ instructions and the standard operating procedures 5 at the Syphilis Laboratory, Public Health Laboratory Services Branch, Centre for Health Protection, Department of Health, Hong Kong. The technical staff who performed the tests were blinded to the clinical details of the serum samples as well as the results of individual tests. All test results were counter-checked by another technician.
Statistical analysis
The consensus result of each serum sample with discordant positive screening EIA results was derived from the most predominant results of the EIA, TPPA and FTA-abs assays. As each serum sample had a positive screening EIA result, the consensus result of a serum sample was positive if either the TPPA or FTA-abs result was reactive, negative if both the TPPA and FTA-abs results were nonreactive and indeterminate if the TPPA result was indeterminate and the FTA-abs result was nonreactive. The strength of agreement of the LIA and consensus results was expressed by the kappa coefficient with quadratic weighting as the categories of the results were ordinal. Furthermore, the proportions of specific agreement were calculated. The 95% confidence intervals (CIs) of the proportions were calculated using the score method.
Results
A total of 801 serum samples with discordant positive screening EIA results were used in the present study. The age range of the individuals was 14 to 104 years (median of 52). There were 369 male and 432 female sera. The serum samples came from 305, 140 and 33 attendees of social hygiene clinics, maternal & child health centres and an integrated treatment centre, respectively, as well as 323 referred serum samples submitted by clinical microbiology laboratories of public hospitals in Hong Kong.
Distribution of TPPA and FTA-abs results among serum samples with discordant positive screening EIA results.
EIA: enzyme immunoassay; FTA-abs: fluorescent treponemal antibody-absorption; TPPA: Treponema pallidum particle agglutination.
Concordant positive screening EIA results.
Positive consensus results.
Indeterminate consensus results.
Negative consensus results.
Distribution of LIA and consensus results among serum samples with discordant positive screening EIA results.
EIA: enzyme immunoassay; LIA: INNO-LIA syphilis score.
Three serum samples with positive consensus results but invalid LIA results were excluded.
Two serum samples with indeterminate consensus results but invalid LIA results were excluded.
Discussion
An important principle of the serological diagnosis of syphilis is the detection of antitreponemal antibody by a screening treponemal test, followed by confirmation of a reactive screening test result by additional testing. 1 The confirmatory treponemal test or tests should have similar sensitivity but greater specificity when compared to, and should be methodologically distinct from, the screening test, in order to reduce the chance of coincident false-positive reactions. However, the situation of discordant reactive screening test results with nonreactive confirmatory test results may arise.
The 2008 European guidelines on the management of syphilis recommend syphilis screening with either EIA or TPPA, followed by confirmation of a reactive screening test result by a different treponemal test (e.g. screening with EIA and confirmation with TPPA or vice versa). An immunoblot assay is recommended as an alternative confirmatory test when the first confirmatory test does not confirm the reactive screening test result. The FTA-abs assay is no longer recommended as an alternative confirmatory test. The FTA-abs assay is difficult to standardize across different laboratories and the fluorescence intensity of its results may be subjectively interpreted by different operators. However, it could be used as an alternative confirmatory test in certain circumstances, e.g. in highly specialized laboratories with a large volume of testing and a quality assurance system in place. 6
In the present study, the EIA assay was used as the screening treponemal test. Both the TPPA and FTA-abs assays, and not just either one of them, were used as confirmatory tests so that the consensus results could be derived from the most predominant results of the EIA, TPPA and FTA-abs assays.
There is currently no single “gold standard” treponemal test available. There are inherent limitations in the serological diagnosis of syphilis. Firstly, characteristics of the individual, e.g. age, sex, pregnancy status, presence of co-morbidities and immune function status, may affect the individual’s ability to produce antitreponemal antibodies and/or cross-reacting antibodies. Secondly, the disease process, e.g. the strain of the infecting organism, stage of syphilis and treatment history, may affect the kinetics of the production of antitreponemal antibodies. Thirdly, characteristics of the assay, e.g. the methodology, nature of antigens and type of conjugates, may affect the ability to detect antitreponemal antibodies in vitro. The EIA and LIA assays use recombinant treponemal antigens, whereas the TPPA and FTA-abs assays use native antigens. The EIA, TPPA and FTA-abs assays are capable of detecting both IgM and IgG antitreponemal antibodies, whereas the LIA assay detects only IgG antitreponemal antibody. Fourthly, characteristics of the operators, e.g. training, expertise and experience, may affect the quality of test results.
The kappa test quantifies the strength of agreement of pairs of measurement categories by removing the percentage of agreement that may have occurred by chance. A kappa coefficient with a large positive value (close to 1) suggests that the majority of agreement is not due to chance. A value close to zero suggests that little or none of the agreement is not due to chance. A negative value indicates disagreement. A value of 0.41–0.60 suggests a moderate level of agreement. However, interpretation of the value of the kappa coefficient requires caution. Firstly, even if the value is high, disagreement may have occurred, which may be clinically unacceptable. 7 Secondly, the value is affected by more than just agreement. It is also affected by the distribution of results across different categories by each assay. As a consequence, it is difficult to compare the values of kappa coefficient across different studies.
Although the LIA assay can be considered a valid alternative confirmatory test for the serological diagnosis of syphilis, the present study showed that its use in the resolution of discordant positive screening EIA results was moderate. However, it was acknowledged that validity of the consensus results, which were derived from the most predominant results of the EIA, TPPA and FTA-abs assays, was uncertain. A more extensive characterization of the serum samples with discordant reactive screening treponemal test results is necessary.
Footnotes
Conflict of interest
The authors declare no conflict of interest.
Funding
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
