Clinician predicted survival for cancer patients is often inaccurate, and prognostic tools may be helpful, such as the Palliative Prognostic Index (PPI). The PPI development study reported that when PPI score is greater than 6, it predicted survival of less than 3 weeks with a sensitivity of 83% and specificity of 85%. When PPI score is greater than 4, it predicts survival of less than 6 weeks with a sensitivity of 79% and specificity of 77%. However, subsequent PPI validation studies have evaluated various thresholds and survival durations, and it is unclear which is most appropriate for use in clinical practice. With the development of numerous prognostic tools, it is also unclear which is most accurate and feasible for use in multiple care settings.
Aim:
We evaluated PPI model performance in predicting survival of adult cancer patients based on different thresholds and survival durations and compared it to other prognostic tools.
Design:
This systematic review and meta-analysis was registered in PROSPERO (CRD42022302679). We calculated the pooled sensitivity and specificity of each threshold using bivariate random-effects meta-analysis and pooled diagnostic odds ratio of each survival duration using hierarchical summary receiver operating characteristic model. Meta-regression and subgroup analysis were used to compare PPI performance with clinician predicted survival and other prognostic tools. Findings which could not be included in meta-analyses were summarised narratively.
Data sources:
PubMed, ScienceDirect, Web of Science, CINAHL, ProQuest and Google Scholar were searched for articles published from inception till 7 January 2022. Both retrospective and prospective observational studies evaluating PPI performance in predicting survival of adult cancer patients in any setting were included. The Prediction Model Risk of Bias Assessment Tool was used for quality appraisal.
Results:
Thirty-nine studies evaluating PPI performance in predicting survival of adult cancer patients were included (n = 19,714 patients). Across meta-analyses of 12 PPI score thresholds and survival durations, we found that PPI was most accurate for predicting survival of <3 weeks and <6 weeks. Survival prediction of <3 weeks was most accurate when PPI score>6 (pooled sensitivity = 0.68, 95% CI 0.60–0.75, specificity = 0.80, 95% CI 0.75–0.85). Survival prediction of <6 weeks was most accurate when PPI score>4 (pooled sensitivity = 0.72, 95% CI 0.65–0.78, specificity = 0.74, 95% CI 0.66–0.80). Comparative meta-analyses found that PPI performed similarly to Delirium-Palliative Prognostic Score and Palliative Prognostic Score in predicting <3-week survival, but less accurately in <30-day survival prediction. However, Delirium-Palliative Prognostic Score and Palliative Prognostic Score only provide <30-day survival probabilities, and it is uncertain how this would be helpful for patients and clinicians. PPI also performed similarly to clinician predicted survival in predicting <30-day survival. However, these findings should be interpreted with caution as limited studies were available for comparative meta-analyses. Risk of bias was high for all studies, mainly due to poor reporting of statistical analyses. while there were low applicability concerns for most (38/39) studies.
Conclusions:
PPI score>6 should be used for <3-week survival prediction, and PPI score>4 for <6-week survival. PPI is easily scored and does not require invasive tests, and thus would be easily implemented in multiple care settings. Given the acceptable accuracy of PPI in predicting <3- and <6-week survival and its objective nature, it could be used to cross-check clinician predicted survival especially when clinicians have doubts about their own judgement, or when clinician estimates seem to be less reliable. Future studies should adhere to the reporting guidelines and provide comprehensive analyses of PPI model performance.
JoHSParkKJungSM. A scoping review of consumer needs for cancer information. Patient Educ Couns2019; 102: 1237–1250.
2.
HenselmansISmetsEMAHanPKJ, et al. How long do I have? Observational study on communication about life expectancy with advanced cancer patients. Patient Educ Couns2017; 100: 1820–1827.
3.
TemelJSShawATGreerJA. Challenge of prognostic uncertainty in the modern era of cancer therapeutics. J Clin Oncol2016; 34: 3605–3608.
4.
KrikorianAMaldonadoCPastranaT. Patient’s perspectives on the notion of a good death: A systematic review of the literature. J Pain Symptom Manag2020; 59: 152–164.
5.
ZhangZChenM-LX-lGU, et al. Use of palliative chemotherapy near the end of life: a retrospective cohort study. Ann Palliat Med2020; 9: 2809–2816.
6.
PobarIJobMHoltT, et al. Prognostic tools for survival prediction in advanced cancer patients: A systematic review. J Med Imaging Radiat Oncol2021; 65: 806–816.
7.
SborovKGiarettaSKoongA, et al. Impact of accuracy of survival predictions on quality of End-of-Life care among patients with metastatic cancer who receive radiation therapy. J Oncol Pract2019; 15: e262–e270.
8.
ChuCAndersonRWhiteN, et al. Prognosticating for adult patients with advanced incurable cancer: a needed oncologist skill. Curr Treat Options Oncol2020; 21: 5.
9.
GlarePSinclairCDowningM, et al. Predicting survival in patients with advanced disease. Eur J Cancer2008; 44: 1146–1156.
10.
WhiteNReidFHarrisA, et al. A systematic review of predictions of survival in palliative care: how accurate are clinicians and who are the experts?PLoS One2016; 11: e0161407.
11.
CheonSAgarwalAPopovicM, et al. The accuracy of clinicians’ predictions of survival in advanced cancer: a review. Ann Palliat Med2016; 5: 22–29.
12.
FarrisC. Prognostic tools in hospice and palliative medicine. Physician Assist Clin2020; 5: 331–340.
13.
MoonsKGAltmanDGReitsmaJB, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med2015; 162: W1–73.
14.
Tousignant-LaflammeYHouleCCookC, et al. Mastering prognostic tools: an opportunity to enhance personalized care and to optimize clinical outcomes in physical therapy. Phys Ther2022; 102: ac023.
15.
MaltoniMCaraceniABrunelliC, et al. Prognostic factors in advanced cancer patients: evidence-based clinical recommendations—A study by the Steering Committee of the European Association for Palliative Care. J Clin Oncol2005; 23: 6240–6248.
16.
MoritaTTsunodaJInoueS, et al. The Palliative Prognostic Index: a scoring system for survival prediction of terminally ill cancer patients. Support Care Cancer1999; 7: 128–133.
17.
MoritaTTsunodaJInoueS, et al. Improved accuracy of physicians’ survival prediction for terminally ill cancer patients using the Palliative Prognostic Index. Palliat Med2001; 15: 419–424.
18.
MoritaTTsunodaJInoueS, et al. Survival prediction of terminally ill cancer patients by clinical symptoms: development of a simple indicator. Jpn J Clin Oncol1999; 29: 156–159.
19.
PirovanoMMaltoniMNanniO, et al. A new palliative prognostic score: a first step for the staging of terminally ill cancer patients. J Pain Symptom Manag1999; 17: 231–239.
20.
StonePWhiteNOostendorpLJM, et al. Comparing the performance of the palliative prognostic (PaP) score with clinical predictions of survival: A systematic review. Eur J Cancer2021; 158: 27–35.
21.
ScarpiEMaltoniMMiceliR, et al. Survival prediction for terminally ill cancer patients: revision of the palliative prognostic score with incorporation of Delirium. Oncologist2011; 16: 1793–1799.
22.
HuiDMaxwellJPPaivaCE. Dealing with prognostic uncertainty: the role of prognostic models and websites for patients with advanced cancer. Curr Opin Support Palliat Care2019; 13: 360–368.
23.
MalhotraKFentonJJDubersteinPR, et al. Prognostic accuracy of patients, caregivers, and oncologists in advanced cancer. Cancer2019; 125: 2684–2692.
24.
ChengW-HKaoC-YHungY-S, et al. Validation of a palliative prognostic index to predict life expectancy for terminally ill cancer patients in a hospice consultation setting in Taiwan. Asian Pac J Cancer Prev2012; 13: 2861–2866.
25.
KimASYounCHKoHJ, et al. The survival time of terminal cancer patients: prediction based on clinical parameters and simple prognostic scores. J Palliat Care2014; 30: 24–31.
26.
LiuYSuLWangY, et al. The application of the palliative prognostic index in predicting the life expectancy of patients in palliative care: a systematic review and meta-analysis. Aging Clin Exp Res2018; 30: 1417–1428.
27.
TakwoingiYDeeksJJ. Systematic reviews of diagnostic accuracy. In: EggerMHigginsJPTSmithGD (eds) Systematic reviews in health research. Oxford: John Wiley & Sons, Ltd, 2022, pp.296–323.
28.
DinnesJMallettSHopewellS, et al. The Moses–Littenberg meta-analytical method generates systematic differences in test accuracy compared to hierarchical meta-analytical models. J Clin Epidemiol2016; 80: 77–87.
29.
SalamehJ-PBossuytPMMcGrathTA, et al. Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): explanation, elaboration, and checklist. BMJ2020; 370: m2632.
30.
MacaskillPTakwoingiYDeeksJJ, et al. Chapter 9: Understanding meta- analysis draft version. In: DeeksJJBossuytPMLeeflangMM, et al. (eds) Cochrane handbook for systematic reviews of diagnostic test accuracy. Hoboken: Wiley, 2022, https://training.cochrane.org/9-understanding-meta-analysis (accessed 16 February 2023).
31.
SimmonsCPLMcMillanDCMcWilliamsK, et al. Prognostic tools in patients with advanced cancer: a systematic review. J Pain Symptom Manag2017; 53: 962–970.e10.
32.
PageMJMcKenzieJEBossuytPM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ2021; 372: n71.
33.
MoonsKGde GrootJABouwmeesterW, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med2014; 11: e1001744.
34.
DebrayTPDamenJASnellKI, et al. A guide to systematic review and meta-analysis of prediction model performance. BMJ2017; 356: i6460.
PlanaMNPérezTZamoraJ. New measures improved the reporting of heterogeneity in diagnostic test accuracy reviews: a metaepidemiological study. J Clin Epidemiol2021; 131: 101–112.
39.
WennmackerSZLambertsMPDi MartinoM, et al. Transabdominal ultrasound and endoscopic ultrasound for diagnosis of gallbladder polyps. Cochrane Database Syst Rev2018; 8: CD012233.
40.
MacaskillPTakwoingiYDeeksJJ, et al. Chapter 10: Undertaking meta-analysis. Draft version. In: DeeksJJBossuytPMLeeflangMMTakwoingiY (eds) Cochrane handbook for systematic reviews of diagnostic test accuracy. Hoboken, NJ: Wiley, 2022, https://training.cochrane.org/10-undertaking-meta-analysis (accessed 16 February 2023).
41.
ZamoraJAbrairaVMurielA, et al. Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol2006; 6: 31.
42.
RutterCMGatsonisCA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med2001; 20: 2865–2884.
43.
GlasASLijmerJGPrinsMH, et al. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol2003; 56: 1129–1135.
44.
FreemanSCKerbyCRPatelA, et al. Development of an interactive web-based tool to conduct and interrogate meta-analysis of diagnostic test accuracy studies: MetaDTA. BMC Med Res Methodol2019; 19: 81.
45.
PatelACooperNFreemanS, et al. Graphical enhancements to summary receiver operating characteristic plots to facilitate the analysis and reporting of meta-analysis of diagnostic test accuracy data. Res Synth Methods2021; 12: 34–44.
HosmerDWLemeshowSSturdivantRX. Chapter 5: Assessing the fit of the model. In: BaldingDJCressieNACFitzmauriceGM, et al. (eds) Applied logistic regression. 3rd ed. Hoboken, NJ: Wiley, 2013, pp.177.
48.
DebrayTPDamenJARileyRD, et al. A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes. Stat Methods Med Res2019; 28: 2768–2786.
49.
JASP Team. JASP. 2022.
50.
HigginsJThomasJChandlerJ, et al. (eds) Cochrane Handbook for Systematic Reviews of interventions. 2nd ed.Hoboken, NJ: John Wiley & Sons, 2019.
51.
MoonsKGMWolffRFRileyRD, et al. PROBAST: A tool to assess risk of bias and applicability of prediction model studies: Explanation and elaboration. Ann Intern Med2019; 170: W1–W33.
52.
McGuinnessLAHigginsJPT. Risk-of-bias VISualization (robvis): An R package and Shiny web app for visualizing risk-of-bias assessments. Res Synth Methods2021; 12: 55–61.
53.
StoneCATiernanEDooleyBA. Prospective validation of the palliative prognostic index in patients with cancer. J Pain Symptom Manag2008; 35: 617–622.
54.
StielSBertramLNeuhausS, et al. Evaluation and comparison of two prognostic scores and the physicians’ estimate of survival in terminally ill patients. Support Care Cancer2010; 18: 43–49.
55.
AlshemmariSEzzatHSamirZ, et al. The palliative prognostic index for the prediction of survival and in-hospital mortality of patients with advanced cancer in Kuwait. J Palliat Med2012; 15: 200–204.
56.
MaltoniMScarpiEPittureriC, et al. Prospective comparison of prognostic scores in palliative care cancer populations. Oncologist2012; 17: 446–454.
57.
HamanoJMaenoTKizawaY, et al. Usefulness of palliative prognostic index for patient with advanced cancer in home care setting. Am J Hosp Palliat Care2013; 30: 264–267.
58.
SubramaniamSThornsARidoutM, et al. Accuracy of prognosis prediction by PPI in hospice inpatients with cancer: a multi-centre prospective study. BMJ Support Palliat Care2013; 3: 324–329.
59.
HamanoJKizawaYMaenoT, et al. Prospective clarification of the utility of the palliative prognostic index for patients with advanced cancer in the Home Care Setting. Am J Hosp Palliat Med2014; 31: 820–824.
60.
HungC-YWangH-MKaoC-Y, et al. Magnitude of score change for the palliative prognostic index for survival prediction in patients with poor prognostic terminal cancer. Support Care Cancer2014; 22: 2725–2731.
61.
InomataMHayashiRTokuiK, et al. Usefulness of the palliative prognostic index in patients with lung cancer. Med Oncol2014; 31: 154.
62.
KaoC-YHungY-SWangH-M, et al. Combination of initial palliative prognostic index and score change provides a better prognostic value for terminally ill cancer patients: A six-year observational cohort study. J. Pain Symptom Manag2014; 48: 804–814.
63.
SonodaHYamaguchiTMatsumotoM, et al. Validation of the palliative prognostic index and palliative prognostic score in a palliative care consultation team setting for patients with advanced cancers in an acute care hospital in Japan. Am J Hosp Palliat Med2014; 31: 730–734.
64.
YoonS-JJungJ-GKimJ-S, et al. Comparison of accuracy among prognostic scores for predicting life expectancy in Korean patients with cancer with weeks of Survival. Am J Hosp Palliat Med2014; 31: 845–852.
65.
BabaMMaedaIMoritaT, et al. Survival prediction for advanced cancer patients in the real world: a comparison of the palliative prognostic score, Delirium-palliative prognostic score, palliative prognostic index and modified prognosis in palliative care study predictor model. Eur J Cancer2015; 51: 1618–1629.
66.
BelangerETetraultDTradounskyG, et al. Accuracy and usefulness of the Palliative Prognostic Index in a community setting. Int J Palliat Nurs2015; 21: 602–605.
67.
HamanoJMoritaTOzawaT, et al. Validation of the simplified palliative prognostic index using a single item from the communication capacity scale. J Pain Symptom Manag2015; 50: 542–547.e4.
68.
OhnoEAbeMSasakiH, et al. Validation of 2 prognostic models in hospitalized patients with advanced hematological malignancies in Japan. Am J Hosp Palliat Med2017; 34: 258–262.
69.
YamadaTMoritaTMaedaI, et al. A prospective, multicenter cohort study to validate a simple performance status-based survival prediction system for oncologists. Cancer2017; 123: 1442–1452.
70.
FarinholtPParkMGuoY, et al. A comparison of the accuracy of clinician prediction of survival versus the Palliative Prognostic Index. J Pain Symptom Manag2018; 55: 792–797.
71.
Palomar-MuñozCMartín-ZamoranoMMogolloA, et al. Assessment of the Palliative Prognostic Index in hospitalized oncologic patients treated by a palliative care team: impact of acute concomitant diseases. Oncotarget2018; 9: 18908–18915.
72.
SubramaniamSDandPRidoutM, et al. Prognosis prediction with two calculations of Palliative Prognostic Index: further prospective validation in hospice cancer patients with multicentre study. BMJ Support Palliat Care2019; 9: 326–331.
73.
ErmacoraPMazzerMIsolaM, et al. Prognostic evaluation in palliative care: final results from a prospective cohort study. Support Care Cancer2019; 27: 2095–2102.
74.
KadokuraMOkuwakiTImagawaN, et al. Utility of prognostic prediction models in the terminal stage of gastrointestinal cancer. J Gastrointest Cancer2020; 51: 515–519.
75.
HuiDRossJParkM, et al. Predicting survival in patients with advanced cancer in the last weeks of life: How accurate are prognostic models compared to clinicians’ estimates?Palliat Med2020; 34: 126–133.
76.
ZhouJXuSCaoZ, et al. Validation of the Palliative Prognostic Index, Performance Status–based palliative prognostic index and Chinese prognostic scale in a home palliative care setting for patients with advanced cancer in China. BMC Palliat Care2020; 19: 167.
77.
ArkınFSArasG. The usefulness of Palliative Prognostic Index in predicting the survival of patients with advanced lung cancer. Eurasian J Pulmonol2021; 23: 174.
78.
FernandesMPugliese BrancoTNavarro FernandezMC, et al. Palliative Prognostic Index accuracy of survival prediction in an inpatient palliative care service at a Brazilian tertiary hospital. ecancermedicalscience2021; 15: 1228.
79.
GerberKTuerZYatesP. Who makes it out alive?—Predicting survival to discharge of hospital patients referred to residential aged care. Collegian2021; 28: 431–437.
80.
GuXLChenMLLiuMH, et al. Value of traditional Chinese medicine syndrome differentiation in predicting the survival time of patients with advanced cancer. J Tradit Chin Med2021; 41: 636–641.
81.
Iizuka-HonmaHMitsumoriTYoshikawaS, et al. Prognostic value of palliative prognostic index for hospitalized patients with End-of-Life hematologic malignancies in a Japanese University Hospital. J Oncol Pract2022; 18: e108–e116.
82.
LeeSHLeeJGChoiYJ, et al. Prognosis palliative care study, palliative prognostic index, palliative prognostic score and objective prognostic score in advanced cancer: a prospective comparison. BMJ Support Palliat Care. Epub ahead of print 1 July 2021. DOI: 10.1136/bmjspcare-2021-003077
83.
LeeS-HChouW-CYangH-Y, et al. Utility of Palliative Prognostic Index in predicting survival outcomes in patients with hematological malignancies in the acute ward setting. Am J Hosp Palliat Med2022; 39: 548–554.
84.
MiyagiTMiyataSTagamiK, et al. Prognostic model for patients with advanced cancer using a combination of routine blood test values. Support Care Cancer2021; 29: 4431–4437.
85.
ShatriHPrasetyaningtyasAPutrantoR, et al. Palliative Prognostic Index validation in hospitalized advanced cancer patients in Indonesia Tertiary Hospitals. Acta Med Indones2021; 53: 442–449.
86.
StonePVickerstaffVKalpakidouA, et al. Prognostic tools or clinical predictions: which are better in palliative care?PLoS One2021; 16: e0249763.
87.
KishinoTMondenNAkisadaN, et al. Comparison of the accuracy of clinical prediction of survival and palliative prognostic index for patients with head and neck squamous cell carcinoma in the end-of-life setting. Auris Nasus Larynx2022; 49: 133–140.
88.
VenemaEWesslerBSPaulusJK, et al. Large-scale validation of the prediction model risk of bias assessment tool (PROBAST) using a short form: high risk of bias models show poorer discrimination. J Clin Epidemiol2021; 138: 32–39.
HaunMWEstelSRückerG, et al. Early palliative care for adults with advanced cancer. Cochrane Database Syst Rev2017; 6: CD011129.
91.
SullivanDRChanBLapidusJA, et al. Association of early palliative care use with survival and place of death among patients with advanced lung cancer receiving care in the Veterans Health Administration. JAMA Oncol2019; 5: 1702–1709.
ScarpiENanniOMaltoniM. Development and validation of the PaP score nomogram for terminally ill cancer patients. Cancers2022; 14: 2510.
94.
SteyerbergEWMoonsKGMvan der WindtDA, et al. Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research. PLoS Med2013; 10: e1001381.
95.
RamspekCLJagerKJDekkerFW, et al. External validation of prognostic models: what, why, how, when and where?Clin Kidney J2021; 14: 49–58.
96.
HendersonRKeidingN. Individual survival time prediction using statistical models. J Med Ethics2005; 31: 703–706.
97.
HuiDMoLPaivaCE. The importance of Prognostication: Impact of Prognostic Predictions, disclosures, awareness, and acceptance on patient outcomes. Curr Treat Options Oncol2021; 22: 12.
98.
StonePCChuCToddC, et al. The accuracy of clinician predictions of survival in the prognosis in Palliative care Study II (PiPS2): A prospective observational study. PLoS One2022; 17: e0267050.
99.
StoneCACampbellRGrimesS. Prognostication in palliative care. In: MacLeodRDVan den BlockL (eds) Textbook of palliative care. Cham: Springer International Publishing, 2019, pp.663–687.
100.
HallenSAMHootsmansNAMBlaisdellL, et al. Physicians’ perceptions of the value of prognostic models: the benefits and risks of prognostic confidence. Health Expect2015; 18: 2266–2277.
101.
SalinsNGhoshalAHughesS, et al. How views of oncologists and haematologists impacts palliative care referral: a systematic review. BMC Palliat Care2020; 19: 175.
102.
JordanRIAllsopMJElMokhallalatiY, et al. Duration of palliative care before death in international routine practice: a systematic review and meta-analysis. BMC Med2020; 18: 368.
103.
KimYJYoonSJSuhS-Y, et al. Performance of clinician prediction of survival in oncology outpatients with advanced cancer. PLoS One2022; 17: e0267467.
104.
GramlingRGajary-CootsECiminoJ, et al. Palliative Care Clinician overestimation of survival in advanced cancer: Disparities and association with end-of-life care. J Pain Symptom Manag2019; 57: 233–240.
105.
PatelMNNicollaJMFriedmanFAP, et al. Hospice use among patients with cancer: trends, Barriers, and future directions. J Oncol Pract2020; 16: 803–809.
106.
DhimanPMaJAndaur NavarroCL, et al. Methodological conduct of prognostic prediction models developed using machine learning in oncology: a systematic review. BMC Med Res Methodol2022; 22: 101.
107.
HeusPDamenJAAGPajouheshniaR, et al. Poor reporting of multivariable prediction model studies: towards a targeted implementation strategy of the TRIPOD statement. BMC Med2018; 16: 120.
108.
WynantsLCalsterBVCollinsGS, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ2020; 369: m1328.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
