Abstract
Background:
For developing future clinical trials in Cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy (CADASIL), it seems crucial to study the long-term changes of cognition.
Objective:
We aimed to study the global trajectory of cognition, measured by the Mini-Mental State Examination (MMSE) and the Mattis Dementia Rating Scale (MDRS), along the course of CADASIL.
Methods:
Follow-up data of 185 CADASIL patients, investigated at the French National Referral center CERVCO from 2003, were considered for analysis based on strict inclusion criteria. Assuming that the MMSE and the MDRS provide imprecise measures of cognition, the trajectory of a common cognitive latent process during follow-up was delineated using a multivariate latent process mixed model. After adjustment of this model for sex and education, the sensitivities of the two scales to cognitive change were compared.
Results:
Analysis of the cognitive trajectory over a time frame of 60 years of age showed a decrease of performances with aging, especially after age of 50 years. This decline was not altered by sex or education but patients who graduated from high school had a higher mean cognitive level at baseline. The sensitivities of MMSE and MDRS scales were similar and the two scales suffered from a ceiling effect and curvilinearity.
Conclusion:
These data support that cognitive decline is not linear and mainly occurs after the age of 50 years during the course of CADASIL. They also showed that MMSE and MDRS scales are hampered by major limitations for longitudinal studies.
Keywords
INTRODUCTION
Cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy (CADASIL), caused by mutations of the NOTCH3 gene on chromosome 19, is a unique model of pure vascular dementia to investigate the natural history of severe ischemic small vessel diseases [1]. The main symptoms of CADASIL include attacks of migraine with aura, stroke events, mood and behavior troubles, gait disturbances, and cognitive decline from executive dysfunction up to severe dementia [2]. Accumulating data showed that disability, particularly cognitive decline from the early stage, can progress in CADASIL in the absence of ischemic or hemorrhagic stroke events. Therefore, cognitive decline should be obviously considered as a key outcome in future clinical trials in CADASIL in addition to the occurrence of stroke events.
Yet, the selection of cognitive scales for evaluating the actual longitudinal changes of cognitive performances in CADASIL is not trivial. Many aspects should be considered for selecting the most relevant tools. First, disease progression is observed over several decades and may not be linear. Recent data support that progression of disability along aging can differ at the individual level according to the stage of the disease. Second, factors such as sex or mostly education may largely impact cognitive performances. Previous data support that females may have better performances than males, particularly at the early stage, in CADASIL [3–6]. Also, more generally, highly educated subjects have better performances on a wide range of cognitive tasks included in different global scales [7–9]. Finally, measures of cognitive changes in longitudinal studies also depend largely on the neuropsychological test itself. In order to capture cognitive changes with enough accuracy, a neuropsychological test should be able not only to explore the different cognitive domains specifically affected during the progression of the disease but also to measure these changes in the range of cognitive levels observed in the targeted population. This capacity might be strongly limited by several metrological properties of tests such as the presence of a ceiling effect as observed using the Mini-Mental State Examination (MMSE) [10] in Alzheimer’s and Parkinson’s diseases [11–13]. Potential curvilinearity may also represent another major limitation when a fixed loss of points does not correspond to the same intensity of cognitive decline over the whole range of the test values. In CADASIL, global cognitive performances were previously assessed longitudinally using various global cognitive scales such as the MMSE or the Mattis Dementia Rating Scale (MDRS) [14]. The MMSE is widely used to screen cognitive impairment in daily clinical practice. The MDRS is an alternative test for evaluating global cognitive impairment in clinical settings including disorders affecting primarily executive functions. In CADASIL, significant variations of the corresponding scores were previously detected over 3 years [15]. However, the overall trajectory of cognitive decline during the whole disease progression and the actual factors that may influence this evolution remain poorly understood, even though this information is crucial for the timely use of cognitive testing in longitudinal studies. Indeed, the profile of cognitive deficits in CADASIL has been previously investigated in four major studies [16–19] mainly focused on variations of performances in different specific cognitive domains. However, the global cognitive level during the course of the disease was not investigated yet.
In the present study, we aimed to investigate the global trajectory of cognitive decline during the course of CADASIL, a model of vascular dementia related to cerebral small vessel disease, over several decades and compare the metrological properties of MMSE and MDRS scales for longitudinal studies. For this purpose, an original analytical approach was used to take into account the curvilinearity and ceiling effect of the two scales. Curvilinear mixed models, which can be seen as extended linear mixed models [20], were used to investigate both the change over time of the latent cognitive process in CADASIL and the sensitivity to cognitive change of the two scales.
MATERIALS AND METHODS
Study population
Between 2003 and 2017, a total of 366 patients were recruited at the French National Referral center CERVCO (https://www.cervco.fr/) in a large prospective cohort of CADASIL patients. Inclusion criteria in the cohort were being at least 18 years of age, with a documented mutation in the NOTCH3 gene, and willing to be regularly evaluated. Neuropsychological assessment was obtained at inclusion and every 20 months of follow-up in median. Reasons for dropout of patients during follow-up were not recorded. Dedicated methods were used for database verification, cleaning, and validation.
Informed consent was obtained from each subject or from a close relative when the patient was too severely disabled to give written consent. The study was approved by an independent ethics committee.
Assessment of cognition
Cognitive performances were assessed at each visit using both the MMSE and the MDRS. The MMSE is a global neuropsychological test evaluating the following dimensions of cognition: orientation, memory, attention, language, and constructional praxis. The sum score on the MMSE ranges from 0 (worse) to 30 (best). The MDRS consists of five subscale scores related to attention, initiation-perseveration, construction, conceptualization, and memory. The MDRS total score ranges from 0 (worse) to 144 (best). When a subtest could not be applied because of too severe cognitive alterations, the patient was considered to have altered performance for this subtest. The lowest score for this subtest was then used for this specific performance. Raw total scores were analyzed.
Explanatory variables
The following parameters considered as potential predictors of clinical worsening in CADASIL were available at baseline: age, sex, education, smoking, alcohol consumption, hypertension, diabetes, systolic blood pressure, diastolic blood pressure, homocysteine, previous stroke events, gait disturbances, balance problems, disability, and dementia. Education was determined according to the French Barbizet scale [21] and summarized into a binary covariate as 1 when the subject passed at least the high school diploma (high level) and 0 otherwise (low level). Alcohol consumption was a qualitative variable with three categories: never, <2 glasses of wine for a man (1 glass or equivalent for a woman), and >2 glasses of wine for a man (1 glass or equivalent for a woman). Previous stoke events were considered to be transient ischemic attacks if they lasted less than 24 hours. Disability was assessed using the modified Rankin Scale (mRS) and was turned into a binary covariate corresponding to 1 when the subject had a score of 3 or more (moderate or severe disability) and to 0 otherwise (no disability). Dementia was assessed according to DSM-IV criteria. Age was available throughout the follow-up and considered as the time variable. For computation purposes, the time scale was the age minus 24 years per 10 years where 24 corresponds to the age of the youngest patient observed at baseline. In this way, the intercept represents the cognitive level at 24 years of age and the change in cognitive level is measured for a decade. Neuroimaging data were not available.
Statistical analysis
Descriptive statistics
Data were first summarized at baseline, with frequencies and percentages for qualitative data and means and standard deviations (SD) for quantitative variables.
Modeling of the cognitive trajectory
We used mixed models for curvilinear outcomes [20]. They are divided into two parts: 1) a linear mixed model which describes the change over time of the latent cognitive process and evaluates the common effects of covariates on this latent cognitive trajectory; 2) test-specific nonlinear measurement models which relate each neuropsychological assessment with the latent cognitive process and allows determining metrological properties of the different neuropsychological tests and evaluating test-specific associations with covariates after adjustment for their effect on the latent cognitive process (contrasts). In the model involving both the MMSE and the MDRS, the latent cognitive process captures the common cognitive part measured by the neuropsychological tests. The latent process constitutes the actual unobserved cognitive level that generated the scores on the MMSE and the MDRS and does not have a particular clinical meaning.
First, we analyzed the MMSE and the MDRS separately. The change over time of the latent process underlying each score was described using a cubic function of time with correlated random effects on the intercept, slope, quadratic slope, and cubic slope. The objective was to select the best parameterized function linking each sum score to its underlying latent process. For this purpose, we estimated latent process mixed models for univariate longitudinal data assuming a similar trajectory of the underlying latent process with a different link function for each model. We compared eight link functions according to the Akaike information criterion (AIC): linear transformation, beta CDF, and quadratic I-splines with three, five, or seven nodes located at the quantiles of the neuropsychological test distribution or equidistant.
Second, we used a latent process mixed model for multivariate longitudinal data to analyze the cognitive trajectory. We assumed that MMSE and MDRS tests are measures with error of the same underlying latent process corresponding to global cognitive functioning. In order to link the common latent process with each neuropsychological test, we used the transformations previously selected to link each test with its underlying latent process. We then ascertained the shape of the cognitive trajectory. To test whether the addition of a random effect improves the model fit, we compared nested models using an approximation of the distribution of the likelihood ratio statistic as proposed by Stram and Lee [22]. We used the AIC to select the best variance-covariance structure of the random effects between unstructured and diagonal and to ascertain the need for an autocorrelated Gaussian process. To test whether an additional fixed effect was different from 0, nested models were compared using the likelihood ratio test (LRT). The AIC was used to determine whether test-specific random effects should be added.
The model was adjusted for sex and education since cognitive performances have been previously related to these factors [3–9]. Interactions between sex and time and between education and time were tested using the LRT. Adequacy of the model to data was checked with plots, namely marginal residuals versus marginal predictions and subject-specific residuals versus subject-specific predictions. The assumption of normality of marginal and subject-specific residuals was evaluated with QQ plots (data not shown). All other potential predictors of clinical worsening in CADASIL were then considered one by one using the LRT.
Statistical tests were performed at the conventional two-tailed type I error of 0.05. Data were analyzed using R version 3.4.0 [23]. Nonlinear mixed models for longitudinal data were estimated using the package ‘lcmm’ [24].
RESULTS
Sample selection
Only individuals having at least three visits with complete results for both MMSE and MDRS tests were selected. A total of 841 observations were collected from 185 patients with a median number of four observations available per individual (interval quartile range (IQR): 3–6). The numbers of observations and patients per age range are given in Supplementary Table 1. The follow-up duration varied from 3 to 14 years with a median follow-up interval of 20 months (IQR: 18–25). These patients were younger and less severe than those who were not included in the analysis as they significantly suffered less from hypertension, gait disturbances, balance problems, disability, and dementia at inclusion and had a significantly lower homocysteine level and significantly higher scores on the MMSE and the MDRS at inclusion (Table 1). They also tended to suffer less from diabetes than the patients who were not included in the analysis.
Baseline characteristics of the patients and comparison of patients included and not included in the analysis
*SD, standard deviation. †NA, number of missing data. The groups were compared using Pearson’s Chi-squared test when the variables were qualitative and Student’s t-test when the variables were quantitative.
Descriptive statistics
Among the 185 patients, 43.2% were men and 41.6% had passed their high school diploma (Table 1). At baseline, the mean scores of MMSE and MDRS tests were 27.8 and 137.8, respectively. The patients were aged 50.3 years on average (SD: 11.5; IQR: 42.3–59.3). The distributions of the two neuropsychological tests (total scores) were strongly skewed to the left (Supplementary Figure 1). The maximum values of MMSE and MDRS tests were reached respectively in about 34% and 21% of the data, indicating a strong ceiling effect of these two neuropsychological tests. The observed mean evolutions are given in the additional material (Supplementary Figure 2).
Choice of the link functions
For each total score, eight univariate latent process mixed models including each a different link function were tested (Supplementary Table 2), without adjustment for covariates since we aimed to analyze the relationship between each score and its underlying latent process. According to the AIC, the quadratic I-splines with three nodes located at the quantiles of the MMSE distribution and the quadratic I-splines with five nodes located at the quantiles of the MDRS distribution provided the best fits.
Cognitive evolution with age
We modeled the trajectory of the latent process underlying the MMSE and the MDRS using the two best link functions to link each score with the common latent process. The shape of the cognitive trajectory resulted in a quadratic function of time with correlated random effects on the intercept, slope, and quadratic slope to account for inter-individual variability (Supplementary Table 3). The quadratic shape suggests an acceleration of cognitive decline at older ages (Fig. 1). The intercept represents the cognitive level at 24 years of age in the reference category, corresponding to women who did not obtain the high school diploma, and the slope and the quadratic slope measure the change in cognitive level for a decade. The model was improved by a Brownian motion accounting for the within-subject variability (Δ AIC = –5.91 points) and the addition of test-specific random effects (Δ AIC = –41.74 points), which implies that for a same value of latent cognition, subjects score differently on the neuropsychological tests. The model was then adjusted for sex and education.

Predicted trajectories in the scale of the latent process underlying the MMSE and the MDRS according to the educational level. The structural model was y = 0.76t – 0.23t2 + 1.01 for subjects with at least the high school diploma and y = 0.76t – 0.23t2 for subjects who did not have the high school diploma.
The estimates and standard errors (SE) related to the fixed effects parameters are shown in Table 2. Sex was not significantly associated with the mean cognitive level at baseline (p = 0.136). In contrast, subjects who graduated from high school had a significantly better mean cognitive level at baseline (
Estimated fixed effects of the multivariate latent process mixed model in the latent process scale
*SE, standard error. †The intercept was not estimated. Indeed, two constraints are required to obtain an identified multivariate latent process mixed model: the intercept is equal to 0 and the variance of the random intercept is equal to 1. ‡The contrasts for sex and education on the MDRS were not estimated but obtained from the estimations of the contrasts for sex and education on the MMSE because the sum of the contrasts for a given covariate is equal to 0. In the first part of the table (above the dashed line), the estimates relate to the first part of the multivariate latent process mixed model, namely the structural model. In the second part of the table (below the dashed line), the estimates relate to the second part of the multivariate latent process mixed model, namely the measurement models. The estimates of the parameters of the two nonlinear transformations that relate the scores on each neuropsychological test with the common latent process are not provided.
Influence of baseline characteristics on cognitive evolution
The estimated interactions between age at inclusion (per 10 years increase) and the slope and between age at inclusion and the quadratic slope were respectively 0.60±0.23 (SE) and – 0.02±0.03 (SE) (p < 0.001) (Table 3), which suggests that age at inclusion impacts the change in cognitive functioning during follow-up. No other significant interaction was detected between the different covariates and time. In particular, the effects of sex and education on the change of cognitive level related to age were not significant (interactions: p = 0.104; p = 0.344).
Estimated interactions between the slopes and the characteristics at baseline
*SE, standard error. †For each covariate, the p-value is derived from the likelihood ratio test involving the model that includes this covariate at baseline and the model that includes this covariate at baseline as well as the interaction between this covariate and the slope and the interaction between this covariate and the quadratic slope.
Sensitivity to cognitive change of the MMSE and the MDRS
The estimated link functions between each neuropsychological test and the common underlying latent process are displayed in Fig. 2. The two neuropsychological tests showed a nonlinear transformation: a one-point change in the natural scale of the MMSE and the MDRS at high levels of cognition corresponds to a greater decrease in cognitive level than a one-point change in the natural scale of the MMSE and the MDRS at low levels of cognition, which highlights the curvilinearity of these two tests. The shape of the tests at high cognitive levels was horizontal: the neuropsychological tests do not allow identifying small cognitive changes at high levels of cognition, which attests to their ceiling effect. The confidence intervals of both link functions largely overlapped (Fig. 2), suggesting that the two transformations are very similar. However, the values in the latent process scale vary between –5.46 and 2.34 for the MMSE and from –5.07 to 2.00 for the MDRS. In the latent process scale, the range of values of the MDRS is included in that of the MMSE and represents 91% of the range of values of the MMSE.

Estimated link functions between each test and the common underlying latent process with 95% confidence bands.
DISCUSSION
The results of this study allowed for the first time to delineate a global trajectory of cognitive decline during the course of CADASIL. This was obtained with a dedicated analytical model and with pooled individual evolutions from a large amount of cognitive data obtained from 185 patients of different age who were followed-up regularly for 3 to 14 years. Globally, a decrease in MMSE and MDRS total scores was observed in relation to cognitive decline developing with age, especially after 50 years. An increase of scores related to the latent cognitive process was also detected on the initial trajectory until approximately the age of 40 years. Such an increase may result from a first re-test effect as already described in studies of normal aging [25]. Indeed, better scores can be obtained at the second visit due to stress-induced effects on cognitive performances at the initial visit and to possible learning effects between the first two visits. In our results, we did not find such an effect and hypothesized that this initial increase of the latent cognitive level was rather related to the quadratic shape of the modeled trajectory itself. The model was adjusted for sex and education although no significant effect of sex or education was detected on the cognitive decline. Only a difference of cognitive level was observed at baseline for individuals with the highest level of education. These results are concordant with previous data obtained in healthy elderly subjects or in patients with Alzheimer’s disease showing that a higher educational level is associated with a higher latent cognitive level at baseline [20, 26]. Contrasts for these two covariates on the latent cognitive level derived from MMSE or MDRS tests were also not found significant.
Our analysis also allowed investigating the potential impact of different covariates obtained at baseline on the global cognitive trajectory of the disease. Neither sex nor education level was found to influence the global course of cognition, which suggests that these variables should not be necessarily considered for future analysis of longitudinal data in CADASIL. Only age at baseline had a significant effect on the course of cognitive decline. These results are in line with those obtained on the latent cognitive decline along aging in the PAQUID study or in Alzheimer’s disease patients [20, 26]. In contrast with previous results obtained in a 3-year follow-up study, we did not find either any effect of gait disturbances, balance problems, or dementia on the global cognitive decline trajectory. This discrepancy might be related to our inclusion criteria in the present study which may have caused a survival bias. Herein, patients included in the analysis had to complete both MMSE and MDRS tests at three visits at least and were therefore less likely to have motor difficulties occurring at the latest stage of the disease and severe dementia. Furthermore, all patients were selected from a cohort of individuals originating from multiple regions in France and who had to travel to the referral center for their clinical evaluation, which may have prevented the inclusion of patients presenting with the most severe motor difficulties. Interestingly, no significant effect of the traditional vascular risk factors was found on the global cognitive trajectory. However, we cannot exclude some age-dependent effects of cardiovascular risk factors on cognitive performances as already reported in large epidemiological studies with aging [27] since our models were adjusted for baseline covariates instead of time-varying covariates. Unfortunately, the results lack of neuroimaging data which would complete the study. Furthermore, there was presumably limited statistical power to evaluate some of the hypotheses tested with no more than 185 patients included in the analysis and a model that estimates many parameters. In addition, the results may be influenced by the type of neuropsychological tests used in the analysis.
The selection of a limited number of measures for longitudinal studies of cognition is crucial as previously investigated in healthy elderly subjects [28] or in Alzheimer’s disease patients [26]. Major limitations were observed using the MMSE and the MDRS for evaluating cognitive decline in CADASIL. Both showed an obvious problem of curvilinearity which could have major consequences on the results of clinical trials. Indeed, due to the varying sensitivity to cognitive change of the MMSE and the MDRS, it will be complicated to assess the benefits of a treatment for cognitive impairment in CADASIL patients with no or mild cognitive impairment using these tests because an identical decrease in scores on the MMSE and the MDRS results in a more or less important decrease in cognitive level depending on the initial scores of the patients on these tests. The two neuropsychological tests also have a problem of ceiling effect for longitudinal studies as already shown for the MMSE when measuring the rate of cognitive changes in dementia with Lewy bodies [13]. The two estimated transformations were finally very close although MDRS score changes were explained by a larger percentage of the latent cognitive variation.
The strength of this study relates to the methodology adopted for longitudinal analysis of MMSE and MDRS scores. Our analysis considered the characteristic properties of these tests which are often ignored such as their ceiling effect and curvilinearity. We initially verified that non-linear transformations provided much better fitting for both MMSE and MDRS scores than the use of a standard linear transformation (data not shown). The amount of data collected in CADASIL patients aged from 24 to 82 years is also an exceptional source for conducting such an analytical approach. There are also limitations for interpreting the present results because it is complicated to characterize the latent process which is defined according to the pool of neuropsychological tests included in the analysis. The link functions were selected from the univariate models (Supplementary Table 2) and used in the multivariate model with a different latent process than those of the univariate models. However, since the MMSE and the MDRS are both a measure of global cognition, it is reasonable to interpret the modeled latent cognitive process as a global cognitive factor. Finally, our analysis was based on MMSE and MDRS scores as they are often used in clinical practice [29, 30]. Different results cannot be excluded using subscores derived from these two global scales.
In conclusion, this study strongly supports that patients aged around 50 years of age should be selected preferentially for future therapeutic clinical trials that aim to reduce cognitive decline in CADASIL. It also indicates that both the MMSE and the MDRS have important limitations, including curvilinearity and ceiling effect, which limit their use in patients with a large range of cognitive deficits or in the healthier or highly educated subjects. The results obtained with such scales should be interpreted with caution. Additional studies are needed to improve the available armamentarium for evaluating cognitive decline in longitudinal studies of progressive ischemic small vessel disease as CADASIL.
Footnotes
ACKNOWLEDGMENTS
The authors acknowledge all patients who participated in this research, their families, and the association CADASIL France (http://www.cadasil.fr/) for their active collaboration. They also thank Pr. Sylvie Chevret, Claire Pacheco, and Abbas Taleb for their investment in the preparation of the database. This study was supported by grants from the RHU TRT_cSVD (
).
