Which cutoff value of the Montreal Cognitive Assessment should be used for post-stroke cognitive impairment? A systematic review and meta-analysis on diagnostic test accuracy
Restricted accessReview articleFirst published online October, 2023
Which cutoff value of the Montreal Cognitive Assessment should be used for post-stroke cognitive impairment? A systematic review and meta-analysis on diagnostic test accuracy
Post-stroke cognitive impairment (PSCI) is one of the serious complications of stroke. The Montreal Cognitive Assessment (MoCA), as a brief cognitive impairment screening tool, is widely used in stroke survivors. However, some studies have suggested that the use of the universal cutoff value of 26 may be inappropriate for detecting cognitive impairments in stroke settings.
Aim:
We conducted this study to identify the optimal cutoff value of the MoCA in screening for PSCI.
Methods:
PubMed, CINAHL, Embase, the Cochrane Library, and Web of Science were searched for eligible studies until March 23, 2023. All studies were screened by two independent researchers. The quality of each article was evaluated by the Quality Assessment of Diagnostic Accuracy Studies-2 tool. A bivariate mixed-effects model was used to pool sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, and the summary receiver operating characteristic curve.
Results:
Twenty-four studies with a total of 4231 patients were included in this review. Despite the lack of evidence of publication bias, a high degree of heterogeneity was observed. A meta-analysis revealed that a cutoff value of 21/22 yielded the best diagnostic accuracy. The optimal cutoff varied in different regions, stroke types, and stroke phases as well.
Conclusion:
The optimal cutoff of MoCA was 21/22 for stroke populations rather than the initially recommended cutoff of 26. A revised (lower) cutoff should be considered for stroke survivors.
GBD 2019 Stroke Collaborators. Global, regional, and national burden of stroke and its risk factors, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Neurol2021; 20: 795–820.
2.
OwolabiMOThriftAGMahalA, et al. Primary stroke prevention worldwide: translating evidence into action. Lancet Public Health2022; 7: e74–e85.
3.
MarinSSerra-PratMOrtegaO, et al. Healthcare costs of post-stroke oropharyngeal dysphagia and its complications: malnutrition and respiratory infections. Eur J Neurol2021; 28: 3670–3681.
Wortman-JuttSEdwardsD. Poststroke aphasia rehabilitation: why all talk and no action?Neurorehabil Neural Repair2019; 33: 235–244.
7.
JaillardANaegeleBTrabucco-MiguelSLeBasJFHommelM. Hidden dysfunctioning in subacute stroke. Stroke2009; 40: 2473–2479.
8.
JokinenHMelkasSYlikoskiR, et al. Post-stroke cognitive impairment is common even after successful clinical recovery. Eur J Neurol2015; 22: 1288–1294.
9.
RenjenPNGaubaCChaudhariD. Cognitive impairment after stroke. Cureus2015; 7: e335.
10.
AamSEinstadMSMunthe-KaasR, et al. Post-stroke cognitive impairment-impact of follow-up time and stroke subtype on severity and cognitive profile: the Nor-COAST study. Front Neurol2020; 11: 699.
11.
ZhangXBiX. Post-stroke cognitive impairment: a review focusing on molecular biomarkers. J Mol Neurosci2020; 70: 1244–1254.
12.
BlomgrenCSamuelssonHBlomstrandCJernCJoodKClaessonL. Long-term performance of instrumental activities of daily living in young and middle-aged stroke survivors—impact of cognitive dysfunction, emotional problems and fatigue. PLoS ONE2019; 14: e0216822.
13.
BlackCMRitchieCWKhandkerRK, et al. Non-professional caregiver burden is associated with the severity of patients’ cognitive impairment. PLoS ONE2018; 13: e0204110.
14.
LanctôtKLLindsayMPSmithEE, et al. Canadian stroke best practice recommendations: mood, cognition and fatigue following stroke, 6th edition update 2019. Int J Stroke2020; 15: 668–688.
15.
QuinnTJRichardETeuschlY, et al. European Stroke Organisation and European Academy of Neurology joint guidelines on post-stroke cognitive impairment. Eur J Neurol2021; 28: 3883–3920.
16.
QuinnTJElliottELanghorneP. Cognitive and mood assessment tools for use in stroke. Stroke2018; 49: 483–490.
17.
NasreddineZSPhillipsNABédirianV, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc2005; 53: 695–699.
18.
Munthe-KaasRAamSSaltvedtI, et al. Test accuracy of the Montreal Cognitive Assessment in screening for early poststroke neurocognitive disorder: the Nor-COAST study. Stroke2021; 52: 317–320.
19.
FengYZhangJZhouYChenBYinY. Concurrent validity of the short version of Montreal Cognitive Assessment (MoCA) for patients with stroke. Sci Rep2021; 11: 7204.
20.
PotocnikJStanteKORakusaM. The validity of the Montreal cognitive assessment (MoCA) for the screening of vascular cognitive impairment after ischemic stroke. Acta Neurol Belg2020; 120: 681–685.
21.
LeesRSelvarajahJFentonC, et al. Test accuracy of cognitive screening tests for diagnosis of dementia and multidomain cognitive impairment in stroke. Stroke2014; 45: 3008–3018.
22.
ShiDChenXLiZ. Diagnostic test accuracy of the Montreal Cognitive Assessment in the detection of post-stroke cognitive impairment under different stages and cutoffs: a systematic review and meta-analysis. Neurol Sci2018; 39: 705–716.
23.
SalamehJPBossuytPMMcGrathTA, et al. Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): explanation, elaboration, and checklist. BMJ2020; 370: m2632.
24.
WhitingPFRutjesAWWestwoodME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med2011; 155: 529–536.
25.
SwetsJA. Measuring the accuracy of diagnostic systems. Science1988; 240: 1285–1293.
26.
GreinerMPfeifferDSmithRD. Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Prev Vet Med2000; 45: 23–41.
27.
DongYSlavinMJChanBP, et al. Improving screening for vascular cognitive impairment at three to six months after mild ischemic stroke and transient ischemic attack. Int Psychogeriatr2014; 26: 787–793.
28.
CummingTBChurilovLLindenTBernhardtJ. Montreal Cognitive Assessment and mini-mental state examination are both valid cognitive tools in stroke. Acta Neurol Scand2013; 128: 122–129.
29.
DongYVenketasubramanianNChanBP, et al. Brief screening tests during acute admission in patients with mild stroke are predictive of vascular cognitive impairment 3–6 months after stroke. J Neurol Neurosurg Psychiatry2012; 83: 580–585.
30.
PendleburySTMarizJBullLMehtaZRothwellPM. MoCA, ACE-R, and MMSE versus the National Institute of Neurological Disorders and Stroke-Canadian Stroke Network vascular cognitive impairment harmonization standards neuropsychological battery after TIA and stroke. Stroke2012; 43: 464–469.
31.
GodefroyOFicklARousselM, et al. Is the Montreal Cognitive Assessment superior to the mini-mental state examination to detect poststroke cognitive impairment? a study with neuropsychological evaluation. Stroke2011; 42: 1712–1716.
32.
ShenYJWangWAHuangFD, et al. The use of MMSE and MoCA in patients with acute ischemic stroke in clinical. Int J Neurosci2016; 126: 442–447.
33.
WongGKLamSWWongANgaiKPoonWSMokV. Comparison of Montreal cognitive assessment and mini-mental state examination in evaluating cognitive domain deficit following aneurysmal subarachnoid haemorrhage. PLoS ONE2013; 8: e59946.
34.
ZhuYZhaoSFanZ, et al. Evaluation of the Mini-Mental State Examination and the Montreal Cognitive Assessment for predicting post-stroke cognitive impairment during the acute phase in Chinese minor stroke patients. Front Aging Neurosci2020; 12: 236.
35.
XuYYiLLinY, et al. Screening for cognitive impairment after stroke: validation of the Chinese version of the quick mild cognitive impairment screen. Front Neurol2021; 12: 608188.
36.
ChanEKhanSOliverRGillSKWerringDJCipolottiL. Underestimation of cognitive impairments by the Montreal Cognitive Assessment (MoCA) in an acute stroke unit population. J Neurol Sci2014; 343: 176–179.
37.
ChanEAltendorffSHealyCWerringDJCipolottiL. The test accuracy of the Montreal Cognitive Assessment (MoCA) by stroke lateralisation. J Neurol Sci2017; 373: 100–104.
38.
SwartzRHCayleyMLLanctôtKL, et al. Validating a pragmatic approach to cognitive screening in stroke prevention clinics using the Montreal Cognitive Assessment. Stroke2016; 47: 807–813.
39.
DongYXuJChanBP, et al. The Montreal Cognitive Assessment is superior to National Institute of Neurological Disease and Stroke-Canadian Stroke Network 5-minute protocol in predicting vascular cognitive impairment at 1 year. BMC Neurol2016; 16: 46.
40.
LiaoXZuoLPanY, et al. Screening for cognitive impairment with the Montreal cognitive assessment at six months after stroke and transient ischemic attack. Neurol Res2021; 43: 15–21.
41.
ZuoLDongYZhuR, et al. Screening for cognitive impairment with the Montreal Cognitive Assessment in Chinese patients with acute mild stroke and transient ischaemic attack: a validation study. BMJ Open2016; 6: e011310.
42.
Ramírez-MorenoJMBartolomé AlbercaSMuñoz VegaPGuerrero BaronaEJ. Screening for cognitive impairment with the Montreal Cognitive Assessment in Spanish patients with minor stroke or transient ischaemic attack. Neurologia2022; 37: 38–44.
43.
TuQYJinHDingBR, et al. Reliability, validity, and optimal cutoff score of the Montreal cognitive assessment (Changsha version) in ischemic cerebrovascular disease patients of Hunan province, China. Dement Geriatr Cogn Dis Extra2013; 3: 25–36.
44.
ChanEGarritsenEAltendorffS, et al. Additional Queen Square (QS) screening items improve the test accuracy of the Montreal Cognitive Assessment (MoCA) after acute stroke. J Neurol Sci2019; 407: 116442.
45.
ZaidiKBRichJBSunderlandKM, et al. Methods for improving screening for vascular cognitive impairment using the Montreal Cognitive Assessment. Can J Neurol Sci2020; 47: 756–763.
46.
SalvadoriECovaIMeleFPomatiSPantoniL. Prediction of post-stroke cognitive impairment by Montreal Cognitive Assessment (MoCA) performances in acute stroke: comparison of three normative datasets. Aging Clin Exp Res2022; 34: 1855–1863.
47.
KaulSGoyalSPaplikarA, et al. Evaluation of vascular cognitive impairment using the ICMR-Neuro Cognitive Tool Box (ICMR-NCTB) in a stroke cohort from India. Ann Indian Acad Neurol2022; 25: 1130–1137.
48.
ChitiGPantoniL. Use of Montreal Cognitive Assessment in patients with stroke. Stroke2014; 45: 3135–3140.
49.
BurtonLTysonSF. Screening for cognitive impairment after stroke: a systematic review of psychometric properties and clinical utility. J Rehabil Med2015; 47: 193–203.
50.
StolwykRJO’NeillMHMcKayAJWongDK. Are cognitive screening tools sensitive and specific enough for use after stroke? a systematic literature review. Stroke2014; 45: 3129–3134.
51.
CiesielskaNSokołowskiRMazurEPodhoreckaMPolak-SzabelaAKędziora-KornatowskaK. Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? meta-analysis. Psychiatr Pol2016; 50: 1039–1052.
52.
KoskiL. Validity and applications of the Montreal cognitive assessment for the assessment of vascular cognitive impairment. Cerebrovasc Dis2013; 36: 6–18.
53.
O'DriscollCShaikhM. Cross-cultural applicability of the Montreal Cognitive Assessment (MoCA): a systematic review. J Alzheimers Dis2017; 58: 789–801.
54.
AndersenKKOlsenTSDehlendorffCKammersgaardLP. Hemorrhagic and ischemic strokes compared: stroke severity, mortality, and risk factors. Stroke2009; 40: 2068–2072.
55.
WongGKLamSNgaiK, et al. Evaluation of cognitive impairment by the Montreal cognitive assessment in patients with aneurysmal subarachnoid haemorrhage: prevalence, risk factors and correlations with 3 month outcomes. J Neurol Neurosurg Psychiatry2012; 83: 1112–1117.
56.
TurunenKEALaariSPKKauranenTV, et al. Domain-specific cognitive recovery after first-ever stroke: a 2-year follow-up. J Int Neuropsychol Soc2018; 24: 117–127.
57.
GongLGuYYuQ, et al. Prognostic factors for cognitive recovery beyond early poststroke cognitive impairment (PSCI): a prospective cohort study of spontaneous intracerebral hemorrhage. Front Neurol2020; 11: 278.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
