Purpose
To determine classification criteria for syphilitic uveitis.
Design
Machine learning of cases with syphilitic uveitis and 24 other uveitides.
Methods
Cases of anterior, intermediate, posterior, and panuveitides were collected in an informatics-designed preliminary database, and a final database was constructed of cases achieving supermajority agreement on the diagnosis, using formal consensus techniques. Cases were analyzed by anatomic class, and each class was split into a training set and a validation set. Machine learning using multinomial logistic regression was used on the training set to determine a parsimonious set of criteria that minimized the misclassification rate among the different uveitic classes. The resulting criteria were evaluated on the validation set.
Results
Two hundred twenty-two cases of syphilitic uveitis were evaluated by machine learning, with cases evaluated against other uveitides in the relevant uveitic class. Key criteria for syphilitic uveitis included a compatible uveitic presentation (anterior uveitis; intermediate uveitis; or posterior or panuveitis with retinal, retinal pigment epithelial, or retinal vascular inflammation) and evidence of syphilis infection with a positive treponemal test. The Centers for Disease Control and Prevention reverse screening algorithm for syphilis testing is recommended. The misclassification rates for syphilitic uveitis in the training sets were as follows: anterior uveitides 0%, intermediate uveitides 6.0%, posterior uveitides 0%, panuveitides 0%, and infectious posterior/panuveitides 8.6%. The overall accuracy of the diagnosis of syphilitic uveitis in the validation set was 100% (99% confidence interval 99.5, 100)—that is, the validation set’s misclassification rates were 0% for each uveitic class.
Conclusions
The criteria for syphilitic uveitis had a low misclassification rate and seemed to perform sufficiently well for use in clinical and translational research.
S yphilis is a sexually transmitted disease caused by the spirochete Treponema pallidum . If untreated, it results in a lifelong infection and typically progresses through identifiable stages. Primary syphilis is a genital ulcerative disease, though other tissues may be affected; secondary syphilis typically results in a disseminated rash, often with other systemic manifestations, such as fever, fatigue, myalgias, and adenopathy. Even if untreated, the symptoms and signs of primary and secondary syphilis spontaneously resolve, resulting in a state of latent infection, which may last indefinitely. Tertiary syphilis results in gumma formation and/or cardiac disease. Neurosyphilis may occur with any stage of syphilis. In 2000 and 2001, the rates of primary and secondary syphilis in the United States were at their lowest since reporting began in 1941, at a rate of 2.1 cases per 100,000 population. , Since 2001, rates of primary and secondary syphilis have steadily risen in the United States, and by 2017 the rate was 9.5 cases per 100,000 population, an increase mirrored elsewhere in the world. , This increase in the United States has occurred in all races and ethnicities and in both sexes, although the majority of cases occur in men, with approximately one-half of cases occurring in men who have sex with men. Human immunodeficiency virus (HIV) infection is a frequent co-infection among patients with syphilis, and a diagnosis of syphilis should lead to testing for HIV infection. ,
Serologic testing for syphilis relies on the use of nontreponemal tests, such as the rapid plasmin regain test and the Venereal Disease Research Laboratory test, and treponemal tests, which may be enzyme immunoassays (eg, the syphilis IgG test), chemiluminescence immunoassays (eg, fluorescent treponemal antibody test), or Treponema pallidum particle agglutination tests. The traditional screening algorithm involved screening with a nontreponemal test first and confirmation with a treponemal test. More recently, a reverse sequence screening algorithm has been proposed and used in some laboratories, and it employs screening with a treponemal test followed by confirmation with a nontreponemal test or an alternate treponemal test. Although the rate of false-positive treponemal tests for syphilis is low (<1%), because false-positives occur, diagnosis requires 2 positive tests, with at least 1 treponemal test. Nontreponemal test titers should fall with successful treatment and may convert to negative, whereas treponemal test results may remain positive despite successful treatment, indicating the utility of nontreponemal tests in disease management.
Ocular syphilis rates also have been increasing since 2000-2001. Syphilis may cause any anatomic class of uveitis, including anterior uveitis, intermediate uveitis, posterior uveitis, or panuveitis, although posterior uveitis and panuveitis have been reported as most common. Syphilitic uveitis accounts for ∼1% to 2.5% of uveitis cases at tertiary referral centers and an estimated 0.5% to 0.65% of syphilis cases. , , , , In Brazil, syphilis increased from 1.8% of uveitis cases in 1980 to 6.1% in 2012-2013. Ocular syphilis has been reported to occur in as many as 9% of HIV-infected persons with syphilis and has been reported to be the most frequent cause of uveitis in HIV-infected persons in the era of modern antiretroviral therapy. The British Ocular Syphilis Study estimated the annual incidence of ocular syphilis in the United Kingdom at 0.3 cases per 1 million adult population.
Because as many as one-third of cases of ocular syphilis may be treponemal test–positive and nontreponemal test–negative, many uveitis experts recommend that patients with uveitis be screened for syphilis using the reverse sequence screening algorithm (ie, screening with a treponemal test, such as the fluorescent treponemal antibody or syphilis IgG test). Because of the frequent occurrence of neurosyphilis with ocular syphilis, estimated to be as high as 50%, , the Centers for Disease Control and Prevention (CDC) recommend that patients with ocular syphilis undergo lumbar puncture, and that patients with ocular syphilis be treated with a neurosyphilis regimen, regardless of the results of cerebrospinal fluid examination. A summary of the reverse sequence screening algorithm for syphilis is outlined in Table 1 , and a summary of the CDC treatment recommendations for ocular syphilis management is outlined in Table 2 .
1. Screen with a treponemal test, either an enzyme immunoassay (eg, syphilis IgG) or a chemiluminescence assay (eg, FTA) |
a. If treponemal test negative, syphilis is not present |
b. If treponemal test positive, perform a nontreponemal test (eg,RPR or VDRL) |
2. Confirmation with nontreponemal test result |
a. If nontreponemal test positive, patient has syphilis |
b. If nontreponemal test negative, perform a different specifictest (eg, TP-PA) |
3. Second (different) treponemal test result |
a. If second treponemal test result positive, patient has syphilis |
b. If second treponemal test result negative, patient does nothave syphilis (may have false-positive test or treated syphilis) |
Test for HIV (frequent co-infection) |
Lumbar puncture even in the absence of clinical neurologic findings (neurosyphilis frequently present) for CSF examination |
•If CSF examination abnormal, follow CSF with serial lumbarpunctures as for neurosyphilis to assess treatment response |
Treat as neurosyphilis regardless of lumbar puncture results |
•3-4 million units aqueous crystalline penicillin Gintravenously every 4 hours for 10-14 days (or 18 to 24 millionunits per day continuous infusion) |
•Consider adding following after completion of initial 10-14days of treatment: benzathine penicillin, 2.4 million units onceper week for up to 3 weeks |
If nontreponemal serologic test abnormal pre-treatment, follow titer at 6, 12, and 24 months to assess response to therapy |
•Titers ≥1:32 should have a 4-fold decline in titer by 12-24months |
The Standardization of Uveitis Nomenclature (SUN) Working Group is an international collaboration that has developed classification criteria for the leading 25 uveitides using a formal approach to development and classification. Among the diseases studied was syphilitic uveitis.
Methods
The SUN Developing Classification Criteria for the Uveitides project proceeded in 4 phases, as previously described: (1) informatics, (2) case collection, (3) case selection, and (4) machine learning.
Informatics
As previously described, the consensus-based informatics phase permitted the development of a standardized vocabulary and the development of a standardized, menu-driven hierarchical case collection instrument.
Case Collection and Case Selection
De-identified information was entered into the SUN preliminary database by the 76 contributing investigators for each disease, as previously described. , Cases in the preliminary database were reviewed by committees of 9 investigators for selection into the final database. , Because the goal was to develop classification criteria, only cases with a supermajority agreement (>75%) that the case was the disease in question were retained in the final database (ie, were “selected”), using formal consensus techniques described in the accompanying article. ,
Machine Learning
The final database then was analyzed by anatomic class, and cases in each class were randomly separated into a learning set (∼85% of the cases) and a validation set (∼15% of the cases) for each disease, as described in the accompanying article. Machine learning was used on the learning set to determine criteria that minimized misclassification. The criteria then were tested on the validation set; for both the learning set and the validation set, the misclassification rate was calculated for each disease. The misclassification rate was the proportion of cases classified incorrectly by the machine learning algorithm when compared to the consensus diagnosis. Because syphilis can present as any class of uveitis, relevant cases were analyzed within each class of uveitides. Cases of syphilitic anterior, intermediate, and posterior uveitis and syphilitic panuveitis were evaluated in the machine learning phase against anterior uveitides (cytomegalovirus anterior uveitis, herpes simplex virus anterior uveitis, juvenile idiopathic arthritis–associated anterior uveitis, sarcoidosis-associated anterior uveitis, spondyloarthritis/HLA-B7-associated anterior uveitis, tubulointerstitial nephritis with uveitis, varicella zoster virus anterior uveitis), intermediate uveitides (multiple sclerosis–associated intermediate uveitis; pars planitis; intermediate uveitis, non–pars planitis type; sarcoidosis-associated intermediate uveitis), noninfectious posterior uveitides (acute posterior multifocal placoid pigment epitheliopathy, birdshot chorioretinitis, multifocal choroiditis with panuveitis, punctate inner choroiditis, sarcoidosis-associated posterior uveitis, serpiginous choroiditis), noninfectious panuveitides (Behçet disease, sarcoidosis-associated panuveitis, sympathetic ophthalmia, Vogt-Koyanagi-Harada disease), and infectious posterior uveitides and panuveitides (acute retinal necrosis, cytomegalovirus retinitis, tubercular uveitis, and toxoplasmic retinitis).
Results
Two hundred fifty cases of syphilitic uveitis were collected; 222 of these cases (89%) achieved supermajority agreement on the diagnosis during the “selection” phase and were used in the machine learning phase. The details of the machine learning results for these diseases are outlined in the accompanying article. The characteristics of cases of syphilitic uveitis are listed in Table 3 . The characteristics of the cases of syphilitic uveitis by anatomic class are listed in Table 4 . Review of images for posterior segment involvement by syphilitic uveitis suggested that posterior uveitis and posterior segment involvement in panuveitis typically presents as either (1) placoid inflammation of the retinal pigment epithelium (sometimes previously termed “placoid chorioretinitis,” even though it is the retinal pigment epithelium and not the choroid that is involved; Figures 1 and 2 ); (2) necrotizing retinitis akin to that seen with cytomegalovirus retinitis or acute retinal necrosis ( Figure 3 ); (3) a multifocal inflammation of the retina and/or retinal pigment epithelium ( Figures 4 and 5 ); and (4) retinal vascular disease with either an occlusive retinal vasculitis or retinal vascular sheathing and/or leakage. The multifocal lesions were typically 250-500 µm in size, with some variability. In the SUN database necrotizing retinitis was seen only in cases with HIV infection. The criteria developed after machine learning are listed in Table 5 . Because any anatomic class of uveitis can be caused by syphilis, and because of its protean manifestations, a positive treponemal test for syphilis was selected as the key diagnostic feature. For anterior and intermediate uveitis, the clinical features were not distinct from other anterior or intermediate uveitides. However, for posterior uveitides, the posterior segment involvement is inflammation of the retina or retinal pigment epithelium with a limited number of presentations. The overall accuracies by anatomic class were as follows: anterior uveitides, learning set 97.5% and validation set 96.7% (95% confidence interval [CI] 92.4, 98.6); intermediate uveitides, learning set 99.8% and validation set 99.3% (95% CI 96.1, 99.9); noninfectious posterior uveitides, learning set 93.9% and validation set 98.0% (95% CI 94.3, 99.3); noninfectious panuveitides, learning set 96.3% and validation set 94.0% (95% CI 89.0, 96.8); and infectious posterior uveitides / panuveitides, learning set 92.1% and validation set 93.3% (95% CI 88.1, 96.3). The misclassification rates for syphilitic uveitis in the learning set were as follows: against anterior uveitides 0%, intermediate uveitides 6%, noninfectious posterior uveitides 0%, noninfectious panuveitides 3.4%, and against infectious posterior uveitides and panuveitides 8.6%. In the validation set the misclassification rates were as follows: against anterior uveitides 0%, intermediate uveitides 0%, noninfectious posterior uveitides 0%, noninfectious panuveitides 0%, and infectious posterior uveitides and panuveitides 0%. The overall accuracy of the diagnosis of syphilitic uveitis in the test set was 100% (95% CI 99.5, 100).
Characteristic | Result |
---|---|
Number of cases | 222 |
Demographics | |
Age, median, years (25th, 75th percentile) | 49 (37, 56) |
Sex (%) | |
Male | 80 |
Female | 20 |
Race/ethnicity (%) | |
White, non-Hispanic | 50 |
Black, non-Hispanic | 14 |
Hispanic | 12 |
Asian, Pacific Islander | 5 |
Other | 8 |
Missing | 11 |
Uveitis history | |
Uveitis course (%) | |
Acute, monophasic | 62 |
Acute, recurrent | 2 |
Chronic | 24 |
Indeterminate | 12 |
Laterality (%) | |
Unilateral | 44 |
Unilateral, alternating | 0 |
Bilateral | 56 |
Ophthalmic examination | |
Keratic precipitates (%) | |
None | 45 |
Fine | 33 |
Round | 11 |
Stellate | 2 |
Mutton fat | 9 |
Anterior chamber cells, grade (%) | |
0 | 26 |
½+ | 9 |
1+ | 21 |
2+ | 24 |
3+ | 17 |
4+ | 3 |
Hypopyon (%) | 0 |
Anterior chamber flare, grade (%) | |
0 | 50 |
1+ | 25 |
2+ | 17 |
3+ | 8 |
4+ | 1 |
Iris (%) | |
Normal | 86 |
Posterior synechiae | 10 |
Iris nodules | 4 |
Sectoral iris atrophy | 0 |
Patchy iris atrophy | 0 |
Diffuse iris atrophy | 0 |
Heterochromia | 0 |
IOP, involved eyes | |
Median, mm Hg (25th, 75th percentile) | 15 (13, 18) |
Proportion patients with IOP > 24 mm Hg either eye (%) | 12 |
Vitreous cells, grade (%) | |
0 | 18 |
½+ | 11 |
1+ | 24 |
2+ | 25 |
3+ | 17 |
4+ | 5 |
Vitreous haze, grade (%) | |
0 | 33 |
½+ | 10 |
1+ | 20 |
2+ | 18 |
3+ | 11 |
4+ | 7 |
Vitreous snowballs (%) | 6 |
Pars plana snowbanks (%) | 0 |
Optic disc edema (%) | 19 |
Placoid inflammation of the retinal pigment epithelium (%) | 16 |
Multifocal inflammation of the retina/retinal pigment epithelium (%) | 21 |
Necrotizing retinitis | 7 |
Occlusive retinal vasculitis (%) | 5 |
Retinal vascular sheathing/leakage (%) | 34 |
Systemic disease | |
Immunocompromised patient (%) a | 40 |
Anatomic uveitic class (%) | |
Anterior uveitis | 13 |
Intermediate uveitis | 39 |
Posterior uveitis | 15 |
Panuveitis | 33 |