Prospective Head-to-Head Study Comparing 2 Commercial Interferon Gamma Release Assays for the Diagnosis of Tuberculous Uveitis




Purpose


To perform a head-to-head comparison of 2 commercially available interferon-gamma release assays, QuantiFERON-TB Gold In-Tube (Cellestis, Chadstone, Victoria, Australia) and T-SPOT.TB (Oxford Immunotech, Abingdon, Oxfordshire, UK), in the diagnosis of tuberculous uveitis.


Design


Prospective cohort to study diagnostic accuracy.


Methods


We recruited consecutive new patients who presented with uveitis to a tertiary institution over a 2-year period. All patients underwent complete ocular examination and systemic evaluation, including T-SPOT.TB, QuantiFERON-TB Gold In-Tube, and tuberculin skin test. Patients were followed-up for a minimum of 1 year after completion of antituberculous therapy where indicated. The main outcome measures were the sensitivity, specificity and accuracy of each test, estimated using Bayesian latent class analysis (presented with 95% Bayesian credible intervals) (Crl). Prior information was obtained from published meta-analyses for diagnostic tests: QuantiFERON Gold In-Tube sensitivity (0.64, 0.59-0.69) and specificity (0.99, 0.99-1.00); T-SPOT. tuberculosis sensitivity (0.50, 0.33-0.67) and specificity (0.91, 0.88-0.93).


Results


From our study in patients with uveitis, QuantiFERON-TB Gold In-Tube was more specific but slightly less sensitive (sensitivity: 0.64, 0.60-0.69; specificity: 0.995, 0.988-0.999) than T-SPOT.TB (sensitivity: 0.67, 0.60-0.74; specificity: 0.91, 0.88-0.93). However, QuantiFERON Gold In-Tube was significantly more accurate in identifying true-positive tuberculous uveitis cases than was T-SPOT.TB among discordant cases (QuantiFERON Gold In-Tube positive 98% vs T-SPOT.TB positive 76%; ratio 1.28, 95% Crl: 1.11-1.72, ie, 95% Crl >1.0, statistically significant).


Conclusion


Based on statistical decision theory, our head-to-head study suggests that QuantiFERON-TB Gold In-Tube is the first-line test that should be performed in preference to T-SPOT.TB (and the tuberculin skin test) for diagnosing tuberculous uveitis.


Tuberculosis (TB) remains one of the leading causes of morbidity and mortality worldwide, with 8.7 million cases in 2011. Currently, the diagnosis of TB still depends on the century-old Mantoux or tuberculin skin test. However, tuberculin skin testing has poor specificity due to false-positives in persons infected with nontuberculous mycobacteria or vaccinated with Bacillus Calmette-Guérin (BCG). Interferon gamma release assays (IGRAs) are based on in vitro detection of interferon gamma released by T cells in response to antigens specific to Mycobacterium tuberculosis , as opposed to tuberculin skin testing, which uses a crude extract of proteins from M. tuberculosis , ie, purified protein derivative. Commercially available interferon gamma release assays include the T-SPOT.TB (Oxford Immunotec, Oxford, United Kingdom) and the QuantiFERON-TB Gold In-Tube (Cellestis, Carnegie, Chadstone, Victoria, Australia).


The main advantage of interferon gamma release assays is that they provide an objective, reproducible test requiring only 1 visit. However, the main disadvantages are higher cost, logistical issues because the samples are time- and temperature-sensitive, and the need for trained personnel to analyze the results. Though similar, there are some key differences between T-SPOT.TB and the QuantiFERON-TB Gold In-Tube. In T-SPOT.TB, the number of interferon gamma producing T cells is counted, after stimulating isolated peripheral blood mononuclear cells with early secretory antigenic target-6 (ESAT-6) and culture filtrate protein-10 (CFP-10), using an enzyme-linked immunospot assay (ELISA). On the other hand, QuantiFERON-TB Gold In-Tube is a whole-blood assay that quantifies interferon gamma produced by T cells in response to ESAT-6, CFP-10 and TB7.7 using an ELISA.


Today, tuberculous uveitis is essentially a presumptive diagnosis. It is diagnosed when uveitis is present with a positive tuberculin skin test or IGRA and chest ×-ray findings suggestive of pulmonary TB and/or evidence of associated systemic TB infection in the absence of other underlying disease. Few ocular biopsies are positive on culture, acid-fast bacilli smear or polymerase chain reaction (PCR) analysis. Thus, the role of IGRAs in the diagnosis of tuberculous uveitis has become increasingly important because they have implications for treatment and prognosis. Although the role of IGRAs in diagnosing tubercular uveitis has been studied, to our knowledge, there is currently no head-to-head comparison between QuantiFERON-TB Gold In-Tube and T-SPOT.TB specifically for the diagnosis of tuberculous uveitis. Thus, we conducted a prospective, direct comparative study to compare these 2 commercially available interferon gamma release assays to diagnose tuberculous uveitis in our population.


Materials and Methods


Overview of Management


We conducted a prospective study of consecutive patients presenting with new onset of uveitis to the Singapore National Eye Centre Ocular Inflammation and Immunology Service over a 2-year period (January 1, 2009, through December 31, 2010). Ethical approval was obtained from the Singapore Health Services Centralized Institutional Review Board, and our study adhered to the tenets of the Declaration of Helsinki. After we obtained informed consent, all patients underwent a full systemic review, ocular examination and standard baseline investigations as previously described. We included all patients who were undergoing systemic review for acute uveitis and who gave informed consent to be enrolled in the study. We excluded patients who did not consent to the minimum follow-up period of 1 year after completion of ocular and systemic therapy.


Investigations


At presentation, all patients were tested with a standard panel of investigations as described, essentially: a complete blood count, erythrocyte sedimentation rate analysis, liver enzyme panel analysis, and infectious-disease screening, which included a venereal disease research laboratory test for syphilis, a tuberculin skin test, a urine microscopy, and a chest X-ray. Other tests, such as an HLA-B27 screen, an acid- and alcohol-fast bacilli smear from throat swabs, and PCR assays for TB DNA from ocular samples were performed if the patient consented to the procedure. Blood was taken for QuantiFERON-TB Gold In-Tube and T-SPOT.TB testing before the tuberculin skin test was performed so as to avoid any boosting effect (although it has been shown that this is unlikely to be significant). The tuberculin skin test was performed using the standard Mantoux method: intradermal injection of 0.1 mL (2 tuberculin units) purified protein derivative (RT23 SSI-2T.U./0.1 mL [Statens Serum Institut, Copenhagen, Denmark]).


Induration was measured at 72 hours with a ruler and was considered positive if it was more than or equal to 15 mm (as validated in our population).


T-SPOT.TB was performed according to the manufacturer’s instructions. For each patient, 8 mL of blood was collected in lithium heparin tubes and processed within 8 hours of sampling. Peripheral blood mononuclear cells were prepared by density-gradient centrifugation over Ficoll Paque Plus (GE Healthcare, Princeton, NJ). We seeded 250 000 cells in each of 4 wells of the assay plate. The cells were stimulated for 16 to 20 hours (under 5% carbon dioxide at 37°C) with GIBCO AIM-Vmedium (nil control), phytohaemagglutinin (mitogen-positive control, Oxford Immunotec, Oxford, United Kingdom), or the TB-specific peptide antigens (peptide pools forESAT-6 and CFP-10 in separate wells) in a total volume of 150 μL per well. Two readers quantified the number of interferon gamma spot-forming T cells visually, and a third reader was consulted if the results were disparate. The T-SPOT.TB test was considered positive if there were >8 spots compared to the negative control well; negative if there were <4 spots compared to the control well; or equivocal if the test wells had 5 to 7 spots more than the control. If the negative control well had >10 spots and/or <20 spots in the mitogen-positive control wells, the result was considered to be indeterminate.


QuantiFERON-TB Gold In-Tube was performed according to the recommended guidelines. Whole blood from each patient was divided into 3 tubes of 1 mL each (nil control, positive control, and TB-specific antigens [ESAT-6, CFP-10 and TB7.7]). Samples were incubated with the stimulating antigens for 16 to 24 hours at 37°C. Afterward, plasma samples were harvested and the amount of interferon gamma released was measured via ELISA. The result obtained in the nil control was subtracted from the mitogen control and the antigen-stimulated samples. The result was considered positive if the response to the specific antigens was ≥0.35 IU/mL, regardless of the level of the positive control; negative if the response to the specific antigens was <0.35 IU/mL and the interferon-gamma level of the positive control was ≥0.5 IU/mL; and indeterminate if both antigen-stimulated samples were <0.35 IU/mL and the level of the positive control was <0.5 IU/mL.


Treatment and Management of patients


The infectious-diseases physicians at the Singapore General Hospital independently evaluated all patients with a high clinical index of suspicion for TB. Those found to have associated systemic or pulmonary TB infection received anti-tuberculosis therapy (ATT), while uveitis patients with latent TB were advised about the risk-benefit ratio of ATT. Patients consenting to treatment received standard ATT according to the guidelines of the Centers for Disease Control and Prevention (isoniazid 5 mg/kg daily, rifampicin 450 to 600 mg daily, pyrazinamide 30 mg/kg daily, and ethambutol 15 mg/kg daily for 2 months, followed by 2 drugs for a 4-month continuation phase, for a total minimum of 6 months’ duration). In patients with posterior segment inflammation where ATT was not indicated, oral prednisolone was used at a starting dose of 1 mg/kg body weight, tapering slowly over the clinical course. Any anterior segment inflammation was treated with topical corticosteroids. The therapeutic response was monitored by 1 ophthalmologist (SPC), where a 2-step decrease in inflammation (Standardization of Uveitis Nomenclature working group activity score) was considered an improvement in clinical activity and a positive response to treatment.


Statistical Analysis


In the diagnosis of tubercular uveitis, there is currently no gold standard, ie, a diagnostic test with 100% sensitivity and specificity. Bayesian statistics are used to compute probability distributions (ie, posteriors) for parameters of interest in our statistical models by updating prior knowledge with new data, expressed formally by integrating the prior distribution and the likelihood function. We used Bayesian latent class models to evaluate the frequencies of true-positives derived from diagnostic tests as well as their sensitivities and specificities. Because the true numbers of patients with tuberculous uveitis are unknown, these were termed latent data . In this study, we performed an extended form of analysis using the Bayesian approach (previously explained in detail for the diagnosis of tuberculous uveitis in the absence of a gold standard), with some modifications. First, we collected data for another diagnostic test, the QuantiFERON-TB Gold In-Tube test, in addition to the tuberculin skin test and the T-SPOT.TB for a new group of patients with uveitis. Second, and most important, IGRAs T-SPOT.TB and QuantiFERON-TB Gold In-Tube are closely related tests, so our modified model takes into consideration their dependency in the estimation of sensitivities and specificities. Furthermore, in addition to using noninformative prior for the prevalence of tuberculous uveitis in our model, we have conducted a separate meta-analysis to estimate pooled prevalence, to incorporate informed prior knowledge as part of our sensitivity analysis. In summary, we performed the analysis in 4 major parts: (1) estimation of prevalence, sensitivity, specificity, and negative and positive predictive values; (2) analysis of the tuberculin skin test, T-SPOT.TB, and QuantiFERON-TB Gold In-Tube in combination; (3) Optimal choice of diagnostic test; and (4) Sensitivity analysis, where technical details are described in the Supplementary text . The Gibbs sampler algorithm, an iterative Markov-chain Monte Carlo technique, was used for estimations using the R and JAGS program. We used the JAGS software (v 3.3.0), running from R version 3.0.2 (R Development Core Team, 2013) to implement the Gibbs sampler, using specific marginal posterior densities. Convergence of estimation was checked and confirmed using the Gelman-Rubin convergence diagnostic.


The sensitivity (S) and specificity (C) of each test, as well as the prevalence of tuberculous uveitis ( π
π
), were the proposed model parameters to be estimated. Positive predictive value (PPV) and negative predictive value (NPV) can then be calculated with the 3 estimated parameters using the Bayes formula (refer to Supplementary text). Prior information for sensitivity and specificity of T-SPOT.TB, QuantiFERON-TB Gold In-Tube, and tuberculin skin test were obtained from a previous meta-analysis of tests for latent tuberculosis infection. To obtain relevant prior information from similar studies on the prevalence of tuberculous uveitis for patients with uveitis, we performed a meta-analysis of published literature using a similar Bayesian approach ( Table 1 , Supplementary Table 1 ) and updated the information in the model as part of our sensitivity analysis.



Table 1

Estimated sensitivity, specificity, positive predictive values and negative predictive values for the tuberculin skin test (TST), T-SPOT.TB and QuantiFERON-TB Gold In-tube (QFT)


























































































































Prevalence Prior information for S and C a Informative Prior for Prevalence
0.0162 (0.0088-0.0281)
Noninformative Prior for Prevalence
Model 1 Model 2 Model 1 Model 3 b
0.048 (0.028-0.078) 0.042 (0.025-0.067) 0.750 (0.638-0.860) 0.750 (0.642-0.867)
TST S 0.709 (0.658-0.761) 0.711 (0.658-0.758) 0.710 (0.657-0.760) 0.690 (0.638-0.739) 0.689 (0.639-0.739)
C 0.683 (0.522-0.844) 0.531 (0.451-0.609) 0.528 (0.453-0.604) 0.743 (0.596-0.861) 0.739 (0.597-0.853)
PPV 0.070 (0.040-0.118) 0.062 (0.035-0.102) 0.893 (0.795-0.955) 0.890 (0.798-0.953)
NPV 0.973 (0.955-0.986) 0.976 (0.960-0.986) 0.442 (0.261-0.590) 0.443 (0.252-0.589)
T-SPOT.TB S 0.500 (0.334-0.666) 0.603 (0.452-0.738) 0.613 (0.437-0.759) 0.669 (0.593-0.741) 0.670 (0.595-0.743)
C 0.906 (0.882-0.929) 0.880 (0.856-0.902) 0.879 (0.853-0.901) 0.905 (0.881-0.927) 0.905 (0.879-0.926)
PPV 0.199 (0.103-0.336) 0.180 (0.094-0.311) 0.955 (0.920-0.978) 0.955 (0.924-0.978)
NPV 0.978 (0.964-0.988) 0.981 (0.970-0.989) 0.480 (0.289-0.631) 0.481 (0.289-0.634)
QFT S 0.642 (0.593-0.691) 0.661 (0.614-0.704) 0.658 (0.610-0.704) 0.643 (0.595-0.686) 0.643 (0.597-0.687)
C 0.996 (0.989-1.000) 0.945 (0.924-0.967) 0.940 (0.921-0.958) 0.995 (0.988-0.998) 0.995 (0.988-0.999)
PPV 0.372 (0.216-0.618) 0.326 (0.190-0.508) 0.997 (0.993-0.999) 0.998 (0.993-0.999)
NPV 0.982 (0.972-0.990) 0.984 (0.975-0.991) 0.480 (0.299-0.622) 0.482 (0.294-0.617)
Correlations between related tests S 0.527 (−0.266, 0.890) 0.619 (0.420-0.761) 0.621 (0.426-0.765)
C 0.596 (0.398-0.730) 0.645 (0.527-0.759) 0.091 (−0.017, 0.272)

C = specificity; NPV = negative predictive value; PPV = positive predictive value; S = sensitivity.

Data presented as median (95% Bayesian credible interval) using data from all diagnostic tests.

Note: Model 1 considers correlated sensitivities and specificities between tests; Model 2 accounted only for correlated specificities between tests.

a Prior distribution and data derived from meta-analysis (Reference 23).


b Final model, accounted only for correlated sensitivities between tests.





Results


Patients’ demographics and clinical results


In this prospective study, we enrolled 120 patients (of whom 106 patients completed follow-up) with valid QuantiFERON-TB Gold In-Tube and T-SPOT.TB test results. The mean age of our patients was 48 ± 17 years, with an equal gender ratio (1:1, n = 53 males). The majority of the patients in our study were of Chinese ethnicity (65/106, 61.3%), followed by Indian (22/106, 20.8%) and Malay (7/106, 6.6%), reflecting the racial distribution in our Southeast Asian population. Of the 106 patients (152 eyes), 46 patients (43.4%) presented with bilateral uveitis. Uveitis was predominantly anterior (91/152, 59.9%), intermediate (4/152, 2.6%), or posterior (23/152, 15.1%); whereas 34 eyes (22.4%) presented with panuveitis. Suggestive clinical features of tubercular causes, such as granulomatous inflammation (38 eyes, 25.0%); extensive posterior synechiae (29 eyes, 19.1%); vasculitis (19 eyes, 12.5%); or single nodular or serpinginous choroiditis (1 eye, 0.7%) were observed in our study cohort. We found no significant differences in terms of age, gender, race or anatomic classification of uveitis when we compared the different QuantiFERON-TB Gold In-Tube, T-SPOT.TB, and tuberculin skin test results of the patients. We also did not have any definite cases of ocular TB infection, ie, culture-positive TB from ocular samples, in this study cohort. A single patient (0.9%) had Mycobacterium tuberculosis smear-positive sputum samples, and 1 patient (0.9%) had positive PCR results for Mycobacterium fortuitum based on the urine sample (tuberculin skin test positive, interferon-gamma release assay negative). The majority of patients (n = 90, 84.9%) had chest x-ray findings that were not suggestive of pulmonary TB infection. None of the study subjects were found to be immunocompromised, nor had they had BCG vaccinations within 10 years of the study enrolment.


Using all diagnostic tests results, we had more data to improve estimations for individual tests ( Table 1 ) and found that the QuantiFERON-TB Gold In-Tube was estimated to be more specific (QuantiFERON-TB Gold In-Tube: 0.995, 0.988 to 0.999) than T-SPOT.TB (0.905, 0.879 to 0.926); and slightly less sensitive (QuantiFERON-TB Gold In-Tube: 0.64, 0.60 to 0.69) compared to T-SPOT.TB (0.67, 0.60 to 0.74). Tuberculin skin test, as a reference, has sensitivity (0.69, 0.64 to 0.74) and specificity (0.74, 0.60 to 0.85). The correlations of sensitivities between QuantiFERON-TB Gold In-Tube and T-SPOT.TB were estimated to be 0.62 (0.43 to 0.77), but the specificities were not found to be correlated. The pooled prevalence of tuberculous uveitis based on our meta-analysis of similar studies was 1.62 (95% CrI: 0.88, 2.81) ( Supplementary Figure 1 ). Comparisons between estimations in our final model and the model updated with prior knowledge from our meta-analysis for prevalence of tuberculous uveitis are also shown in Table 1 . Sensitivity and specificity estimates were similar. Predictive values differ greatly, but this was not surprising because they are dependent on the prevalence of disease.


Table 2 shows the estimated number of true-positives corresponding to each of the 4 possible outcomes of the diagnostic tests. All who tested positive on QuantiFERON-TB Gold In-Tube and T-SPOT.TB in our study were estimated to be true-positive. However, among discordant results, QuantiFERON-TB Gold In-Tube was significantly more accurate than T-SPOT.TB (QuantiFERON-TB Gold In-Tube positive 98% vs T-SPOT.TB positive 76%, with a ratio of 1.28, 95%Crl: 1.11 to 1.72, ie, 95%Crl >1.0 was statistically significant). Similarly, both QuantiFERON-TB Gold In-Tube (0.99 95%Crl 0.98 to 1.00) and T-SPOT.TB (0.90 95%Crl 0.82 to 0.96) were more accurate than the tuberculin skin test in the discordant results. Using the estimated sensitivity and the specificity of each diagnostic test (tuberculin skin test, T-SPOT.TB, and QuantiFERON-TB Gold In-Tube), we then calculated the risk of each test as expressed as the function of probability of tuberculous uveitis ( Figure 1 ). Based on statistical decision theory, QuantiFERON-TB Gold In-Tube is the first-line test and should be performed in preference to T-SPOT.TB and the tuberculin skin test for diagnosis of tuberculous uveitis. Our sensitivity analysis confirmed that posterior distribution of parameters with mock data varied appreciably with the changing likelihood functions, suggesting that our results were data driven and were not overly influenced by priors. Furthermore, the optimal choice of diagnostic test is QuantiFERON-TB Gold In-Tube as seen in Figure 1 , regardless of the influence of choice of prior for prevalence of tuberculous uveitis.



Table 2

Counts of actual and estimated true-positive cases of tuberculous uveitis in our study cohort, compared to test results of QuantiFERON-TB Gold In-tube, tuberculin skin test and T-SPOT.TB














































Study Data a Estimated true-positive Counts b
T-SPOT.TB QFT Total T-SPOT.TB QFT Total
+ +
+ 72 16 88 + 72 (1.00, 1.00-1.00) 12 (0.76, 0.57-0.88) 84
7 57 64 7 (0.98, 0.93-1.00) 27 (0.46, 0.30-0.67) 34
Total 79 73 152 Total 79 39 118











































T-SPOT.TB TST Total T-SPOT.TB TST Total
+ +
+ 57 27 84 + 56 (0.98, 0.96-0.99) 24 (0.90, 0.82-0.96) 80
18 43 61 14 (0.75, 0.56-0.89) 14 (0.32, 0.18-0.54) 28
Total 75 70 145 Total 70 38 108











































QFT TST Total QFT TST Total
+ +
+ 55 20 75 + 55 (1.00, 1.00-1.00) 20 (0.99, 0.98-1.00) 75
20 50 70 15 (0.75, 0.56-0.88) 16 (0.31, 0.19-0.53) 31
Total 75 70 145 Total 70 36 106

QFT = QuantiFERON-TB Gold In-tube; TST = tuberculin skin test; + = positive test result; − = negative test result.

Only gold members can continue reading. Log In or Register to continue

Stay updated, free articles. Join our Telegram channel

Jan 8, 2017 | Posted by in OPHTHALMOLOGY | Comments Off on Prospective Head-to-Head Study Comparing 2 Commercial Interferon Gamma Release Assays for the Diagnosis of Tuberculous Uveitis

Full access? Get Clinical Tree

Get Clinical Tree app for offline access