Abstract
Background:
In clinical trials that recruited patients with early Parkinson’s disease (PD), 4–15% of the participants with a clinical diagnosis of PD had normal dopamine transporter single photon emission computed tomography (DAT SPECT) scans, also called “scans without evidence of dopaminergic deficit” (SWEDD).
Objective:
To investigate in patients with a clinical diagnosis of PD, if specific clinical features are useful to distinguish patients with nigrostriatal degeneration from those that have no nigrostriatal degeneration.
Methods:
We performed a diagnostic test accuracy study. Patients that participated in the Levodopa in Early Parkinson’s disease trial, a clinical trial in patients with early PD, were asked to participate if they had not undergone DAT SPECT imaging earlier. The index tests were specific clinical features that were videotaped. A panel of six neurologists in training (NT), six general neurologists (GN), and six movement disorders experts (MDE) received a batch of ten videos consisting of all SWEDD subjects and a random sample of patients with abnormal DAT SPECT scans. The raters analyzed the videos for presence of specific signs and if they suspected the patient to have SWEDD. The reference test was visually assessed DAT SPECT imaging.
Results:
Of a total of 87 participants, three subjects were SWEDDs (3.4%). The overall intraclass correlation coefficient (ICC) of the Parkinsonian signs was poor to moderate with ICCs ranging from 0.14 to 0.67. NT correctly identified 50.0% of the SWEDD subjects, GN 33.3%, and MDE 66.7%.
Conclusion:
Our study suggests that the selected videotaped clinical features cannot reliably distinguish patients with a clinical diagnosis of PD and an abnormal DAT SPECT from patients with clinical PD and a SWEDD.
Keywords
INTRODUCTION
Despite the significant advances in (nuclear) imaging and genetics to support the diagnosis of Parkinson’s disease (PD) in recent years, the diagnosis of PD remains mainly a clinical one. Bradykinesia is the cardinal symptom, which must be accompanied by tremor and/or rigidity [1–3]. In order to make the diagnosis, supportive signs are often present and exclusionary signs absent. An accurate diagnosis can be challenging in early stages, particularly when the clinical features are subtle [4, 5]. Using dopamine transporter single photon emission computed tomography (DAT SPECT) imaging, patients can be classified into two distinct groups; patients with nigrostriatal dysfunction, which can be degenerative (e.g., PD, multiple system atrophy, progressive supranuclear paralysis, dementia with Lewy bodies), and patients without nigrostriatal dysfunction. Among patients with clinically diagnosed PD whom are enrolled in trials or imaging studies for PD, 4–15% have been found to have normal DAT scans, also referred to as “scans without evidence of dopaminergic deficit” (SWEDD) [6, 7]. SWEDD cases do not develop abnormal DAT SPECT scans on long-term follow up [8]. In contrast, in early stages of PD, and even in preclinical stages, striatal DAT binding is significantly reduced [9–11]. Previous studies however suggest that a significant proportion of SWEDD cases may be related to an incorrect visual interpretation of DAT SPECT scans, rather than or in addition to an erroneous clinical diagnosis [12].
Reliable identification of diagnoses is paramount to individual patient care. As an adjunct, for clinical trials in early PD it is critical to ensure that the appropriate patients are included. The Levodopa in EArly Parkinson’s disease (LEAP) clinical trial provided a unique opportunity to investigate if patients clinically diagnosed with early PD and nigrostriatal dysfunction can reliably be differentiated from SWEDD subjects. Using a video assessment and raters with various levels of expertise [13], we explored the usefulness of selected clinical features to identify SWEDD subjects.
METHODS
This study was a diagnostic test accuracy study. The index tests were specific clinical features that were videotaped. The reference test was visually assessed DAT SPECT imaging. This study was ancillary to a multicenter, randomized, double-blind, placebo-controlled trial with a delayed-start design, the LEAP trial [13]. Patients for the LEAP trial were recruited by general neurologists from 50 community hospitals and by movement disorders specialists in seven academic hospitals in the Netherlands. The LEAP clinical trial and this ancillary study were approved by the ethics committee at the Amsterdam University Medical Centers in the Netherlands. The studies were conducted in accordance with the principles of the Declaration of Helsinki.
Patients
Patients were eligible for the LEAP clinical trial if they had received a clinical diagnosis of PD within the previous two years from a neurologist who based the diagnosis on standard clinical criteria [14, 15], if they had insufficient disability to warrant treatment with anti parkinson medication, if they were 30 years of age or older, and if they had a life expectancy of more than two years. Patients who had been treated previously with anti parkinson medication were excluded.
All LEAP participants were able to participate in this ancillary study unless they used medication or substances interfering with DAT SPECT imaging that could not be discontinued, in case of pregnancy, or if the patient underwent prior DAT SPECT imaging.
Study procedures
After inclusion in the LEAP clinical trial, but prior to randomization, a physical examination focused on Parkinsonism was video recorded and DAT SPECT imaging performed. There was no fixed sequence of study procedures (acquisition of the DAT SPECT scan and video recording). The results of the imaging had no influence on the participation in the LEAP clinical trial.
Physical examination
We used the following parameters to be assessed by the video panel (see Supplementary File 1 for video protocol): bradykinesia defined as a decreased amplitude and/or progressive deceleration of movement [17], re-emerging tremor in patients with a postural or rest tremor, reduced arm swing while walking, asymmetric arm swing during walking that normalizes during running, contra lateral mirror movements, reduced tremor in the most affected limb during finger tapping on the contra lateral side [18], and ten-step tandem gait test [19].
DAT SPECT imaging
DAT SPECT imaging was performed in seven hospitals (four tertiary referral hospitals and three community hospitals) in the Netherlands. Each parti-cipant was injected intravenously with approxi-mately 185 MBq 123I-N-omega-fluoropropyl-2ß-car-bomethoxy-3ß-(4-iodophenyl)nortropane ([123I]FP-CIT or [123I]ioflupane) and images were acquired 3 hours later [16]. Patients were pretreated with potassium iodide drops or tablets according to the standard protocol of the hospital. Images were acquired on 2-headed or brain-dedicated SPECT systems. Although all centers had experience in DAT imaging for routine clinical purposes, each participating center was asked to optimize the acquisition of the images by considering the EANM guidelines regarding the acquisition of DAT SPECT scans [20].
Classification and outcome of DAT SPECT
The DAT SPECT scans were visually assessed independently by two experts in neuroreceptor imaging (JB, HV). The experts were blinded to the initial assessment of the DAT SPECT and the clinical details aside from gender and date of birth scans. The images were analyzed in a familiar and consistent color scale on a HERMES workstation. The DAT SPECT images were classified as either “normal” or “abnormal”. This determination was based on the extent and intensity of the uptake of the radiotracer in the striatum. “Normal” DAT SPECT imaging was characterized by intense binding of the radiotracer in the putamen and caudate nuclei bilaterally, mostly symmetrical with almost equal intensity of the binding. Normal striatal binding looks comma- or crescent-shaped on transversal images (Fig. 1) [21]. The result of DAT SPECT imaging was considered “abnormal” when a decreased binding of the radiotracer was apparent in any of the striatal areas, in most cases asymmetrically. In the early phase reduced binding of the radiotracer is usually visible in the dorsal putamen and expands to the ventral putamen and caudate nucleus [21].
DAT SPECT imaging. Normal (A) and abnormal (B) [123I]FP-CIT SPECT imaging of patients in the LEAP-cohort. Patient A is a 64-year-old male. Patient B is a 63-year-old female. DAT, dopamine transporter; SPECT; single-photon emission computed tomography; LEAP, Levodopa in EArly Parkinson’s disease.
Video assessment
Since the accuracy of video assessments of the specific symptoms may be dependent on experience [22], we formed a video panel of assessors with different levels of expertise. Six neurologists in training (NT), six general neurologists (GN), and six movement disorder experts (MDE) individually analyzed the videos (presence of signs tested during the comprehensive neurological examination) while blinded for the DAT SPECT imaging results. An example of the case record form for the video assessment can be found in Supplementary File 2. All raters received the same set of ten videos, which consisted of three SWEDD subjects and a random selection of seven patients with abnormal DAT SPECT imaging that participated in this ancillary study.
The random sample of seven videos was selected using the = RAND() formula in Microsoft Excel. This function generates a list with a random number per participant that can be sorted from low to high. The first seven subjects with the lowest numbers on the list were selected. The quality of the videos and neurological examinations were assessed (e.g., sufficient lighting, socks removed, whole body was filmed during execution of UPDRS items 18, 19, and 20, and all parts of the examination were performed correctly and long enough). If a video was considered to be of insufficient quality, the following video on the list was selected until there were seven videos of sufficient quality. The assessors were blinded for the number of SWEDD subjects, or the number of subjects with abnormal DAT SPECT imaging as well as any other clinical information.
Statistical analysis
Because of the unexpected low number of SWEDD subjects, the analysis of the data was mainly qualitative with limited statistical analysis. The inter-rater reliability per item of the comprehensive neurological examination was determined by calculating the intraclass correlation coefficient. We selected the two-way mixed model and tested the absolute agreement. The single measure coefficient was used. Based on the 95% confident interval (CI) of the ICC estimate, values less than 0.50, between 0.50 and 0.75, between 0.75 and 0.90, and greater than 0.90 are indicative of poor, moderate, good, and excellent reliability, respectively [23]. Analyses were performed with the use of SPSS software, version 25.
RESULTS
Patients
From August 2011 through May 2016, 446 patients were enrolled in the LEAP trial. The ancillary study was initiated after 85 had already been included in the LEAP trial and 271 participants declined participation or met exclusion criteria. One patient withdrew consent prior to DAT SPECT imaging and two patients were excluded due to technical issues with the DAT SPECT images. This left a total of 87 participants that underwent both DAT SPECT imaging and a videotaped examination (Fig. 2). Eighty-four patients had abnormal DAT SPECT imaging. Three patients (3.4%) had normal DAT SPECT imaging, which remained normal on rescanning 80 weeks after baseline imaging. There were no discrepancies between the two experts in neuroreceptor imaging who assessed the images. The baseline characteristics and demographics are shown in Table 1.
Selection of LEAP patients evaluated to participate in the ancillary study.
Baseline characteristics and demographics
SWEDD Scan without evidence of dopaminergic deficit, PD Parkinson’s disease, UPDRS Unified Parkinson’s disease Rating Scale, IQR inter quartile range, SD Standard deviation.
SWEDD identification
One of the MDE did not fill out the question asking if he suspected the subjects to have a normal or abnormal DAT SPECT imaging due to misinterpretation of the question. Overall, SWEDD subjects were correctly identified in 41.2%. NT correctly identified 50.0% (median, range 0–70%), GN 33.3% (0–66.7%), and MDE 66.7% (0–100%) of the SWEDD subjects. The full dataset of the video assessments is provided in Supplementary File 3.
Patients with abnormal DAT imaging
Overall, the assessors identified 80.7% of the patients with abnormal DAT SPECT imaging correctly. The NT identified 71.4% (median, range 57.1–85.7%) of the patients with abnormal DAT SPECT imaging correctly compared to 85.7% (median, range 71.4–100%) of GN and 85.7% (median, range 71.4–85.7%) of MDE.
In contrast, one patient (Subject 5) was overall correctly identified in only 52.9% of the assessments. Interestingly, the raters that did not find an asymmetrical arm swing while walking (88.9%), suspected the patient frequently (55.6%) of having a SWEDD, even in presence of bradykinesia.
Intraclass correlation coefficient
The overall intraclass correlation coefficient (ICC) of the individual items was poor to moderate with ICCs ranging from 0.14 to 0.67 (Table 2). Re-emerging tremor (0.62, 95% confidence interval (CI) 0.40–0.88), arm swing while walking (0.52, 95% CI 0.32–0.79), reduced tremor after immobilization (0.54, 95% CI 0.33–0.82), and tandem gait test (0.67, 95% CI 0.44–0.91) were the only items with an overall ICC above 0.5. All other items had ICCs below 0.5.
Intra class correlation coefficient with confidence intervals
*Intra class correlation coefficient with confidence intervals are based on five assessments instead of six.
DISCUSSION
This analysis showed that video-based assessments of clinical features might be insufficient to accurately distinguish individuals with SWEDD from patients with abnormal DAT SPECT imaging. The inter-rater agreement of interpreting clinical features in patients with suspected PD is poor to moderate, independent of the level of expertise.
Our panel for the video assessment was not able to reliably differentiate SWEDD subjects from patients with neurodegenerative parkinsonism based on videos. However, two MDE were able to identify all three SWEDD subjects correctly. One of these MDE was even able to classify all patients correctly. This rater scored the individual items of the examination similarly to the other raters, but had a different conclusion if the patient had normal or abnormal DAT SPECT imaging. This was the only patient in which the same ratings led to a different conclusion. These findings may suggest that a “custom weighted compound score” of all findings is more reliable rather than the individual features of the neurological examination. However, due to the small number of SWEDD subjects in this study it was not possible to determine whether individual items or a combination thereof were critical in correctly identifying the subjects. Furthermore, we had expected that the accuracy of SWEDD identification would increase with increasing level of expertise and experience, which was not the case.
This study showed that the overall inter-rater agreement regarding the presence or absence of clinical features is poor to moderate. In contrast to Fearon et al. [22] we did not find that MDE had a higher inter-rater agreement compared to non-MDE (NT and GN). However, we did find that NT had the lowest inter-rater agreement in 7 (out 13 items) compared to 3 for GN and MDE.
The items of the physical examination that were selected merit some discussion. Bradykinesia is one of the cardinal features of Parkinsonism so it has to be present in patients with any Parkinsonism. SWEDD subjects however may not have true bradykinesia [17, 24]. The re-emerging rest tremor is seen in the majority of patients with PD and is reported in other forms of neurodegenerative Parkinsonism. This phenomenon may be absent in SWEDD subjects [25]. Patients with PD nearly always (92%) have a reduced asymmetric arm swing during walking; this or a bilateral reduction of arm swing is recognized in about two-thirds of subjects with SWEDD [25]. We also included normalization of the arm swing while running. There is no published literature on this phenomenon. However, we observed that many PD patients with an asymmetric arm swing during walking have a normal or markedly improved arm swing while running. We hypothesized that for running a change in motor program is initiated, therefore in patients with psychogenic Parkinsonism the arm swing could remain reduced. A reduced tremor in the most affected limb during finger tapping on the contra lateral side is found in patients without dopaminergic degeneration [18]. Tandem gait performance was included since patients with PD have a normal tandem gait, therefore we expected this to be abnormal in patients with a normal DAT SPECT scan [19]. The included patients were patients without impairment in daily life and therefore we hypothesized that possible patients with MSA or PSP would still have a normal tandem gait.
One of the shortcomings of this study, as with any video study, is that clinical features like rigidity cannot be appreciated, and other items assessed clinically can vary from individual to individual; e.g., sequential handwriting. Furthermore, most patients were visited at home, which led to improvising to obtain the best videos possible. For example, in some cases the walking distance had to be reduced due to the living situation of the patient. Moreover, the lighting varied among the videos, which could have influenced the assessments.
One could argue that erroneous visual assessment of DAT SPECT imaging contributes to the SWEDD percentage. However, previous studies have shown that visual assessment of DAT SPECT imaging by experts and even non-experts is highly reliable [26, 27]. Additionally, all three SWEDD cases were rescanned approximately 80 weeks later, and also all three follow-up scans were rated as being normal by the two expert readers who analyzed the scans independently.
One of the strengths of this study is the fact that these were all patients who were referred to participate in the LEAP-clinical trial. To our knowledge this is the first study in which the included SWEDDs were initially referred by a neurologist who had no clinical doubt and diagnosis was made on clinical grounds only. We agree the number of SWEDDs is low, however these are the exact type of SWEDDs we wanted to evaluate.
In conclusion, our findings suggest that it is very difficult to reliably identify SWEDD subjects from patients with PD based solely on a video assessment of a neurological examination focused on parkinsonism [6]. Interestingly, the level of expertise of the video assessors did not appear to play a significant role in the inter-rater agreement as well as in the correct identification of the patients. As mentioned above the sample size was considerably smaller than anticipated, therefore we cannot draw firm conclusions. Until other reliable diagnostic and mechanistic biomarkers become available, DAT imaging should be used to confirm appropriate patient selection in clinical trials on disease-modifying drugs.
CONFLICT OF INTEREST
The authors report no conflicts of interest
Financial Disclosures for the Previous 12 Months: Susan Fox has received clinic support from the Edmond J Safra Foundation for Parkinson Research; National Parkinson Foundation and the Toronto Western and General Foundation. Salary from UHN Dept of Medicine Practice Plan. She has received Research Funding from the Michael J Fox Foundation for Parkinson Research, NIH (Dystonia Coalition), CIHR and Parkinson Canada. She has received Honoraria from the International Parkinson, Movement Disorder Society and American Academy of Neurology; served as site PI for Clinical Trials for Biotie, Cynapsus, Eisai; Revance and received consultancy/Speaker fees from Acadia; Atuka; CHDI; Lundbeck; Merz; Kyowa; Palidan, Sequirus; Sunovion; Teva; Zambon; and Royalties from Oxford University Press.
Carsten Eggers has received grant support paid to the institution from the German Research Foundation (DFG), the European Union (Horizon 2020), the German Ministry of Science, Education (BMBF), the German Parkinson Association (DPV) and the Parkinson’s Association. He has received personal compensation as a consultant/scientific advisory board member for Abbvie, Medtronic, Philyra; and honoraria for lectures/speaks from Abbvie, Bayer Vital, Bial, Daiichi Sankyo, UCB, Zambon.
Mike Samuel has received educational support from Medtronic (paid to the institution), Parkinson’s UK (via the UK DBS network), acts as a consultant for Abbott, and received honoraria from the Movement Disorders Society.
Monty Silverdale has received grants from Michael J Fox Foundation for Parkinson Research (paid to the institution), Parkinson’s UK (paid to the institution) and NIHR (paid to the institution) as well as conference expenses from Medtronic (paid to the institution).
Joke M. Dijk has received unrestricted grants from Medtronic (paid to the institution).
Alberto J. Espay has received grant support from the NIH and the Michael J Fox Foundation; personal compensation as a consultant/scientific advisory board member for Abbvie, Neuroderm, Neurocrine, Amneal, Adamas, Acadia, Acorda, Sunovion, Lundbeck, Osmotica Pharmaceuticals, and US World Meds; publishing royalties from Lippincott Williams & Wilkins, Cambridge University Press, and Springer; and honoraria from US World Meds, Acadia, Sunovion, the American Academy of Neurology, and the Movement Disorders Society.
Anthony E. Lang has received grants from Brain Canada, Canadian Institutes of Health Research, Corticobasal Degeneration Solutions, Edmond J Safra Philanthropic Foundation, Michael J. Fox Foundation, the Ontario Brain Institute, Parkinson Foundation, Parkinson Canada, and W. Garfield Weston Foundation; personal compensation as a consultant/scientific advisory board member for Abbvie, AFFiRis, Biogen, Janssen, Lilly, Lundbeck, Merck, Paladin, Roche, Sun Pharma, Theravance, Corticobasal Degeneration Solutions, Jazz Pharma, Photo Pharmics, Sunovion; publishing royalties from Elsevier, Saunders, Wiley-Blackwell, Johns Hopkins Press, and Cambridge University Press.
Jan Booij has received unrestricted research grants from GE Health (paid to the institution).
Rob M.A. de Bie received unrestricted research grants from GE Health (paid to the institution) and Lysosomal Therapeutics (paid to the institution).
Footnotes
ACKNOWLEDGMENTS
We thank all the participating centers for the acquisition of the DAT SPECT imaging.
The LEAP clinical trial was supported by unrestricted grants from the Netherlands Organization for Health Research and Development (Dutch governmental fund for health research, project number 0-82310-97-11031), Parkinson Vereniging (Dutch patient association), Stichting Parkinson fonds (Charity foundation for Parkinson’s disease research funding), and Stichting Parkinson Nederland (Charity foundation for Parkinson’s disease research funding). This ancillary study was supported by General Electric Healthcare.
