Validation of a Patient-Completed Caprini Risk Assessment Tool for Spanish,Arabic,and Polish Speakers

Abstract

Targeted prophylaxis for venous thromboembolism (VTE) using the Caprini risk score (CRS) is effective reducing postoperative VTE. Despite its availability as preventive strategy, risk scoring remains underutilized. Critics to the CRS contend the time it takes to complete, and its limitation to English language. Aim is to create and validate patient-completed CRS tools for Spanish, Arabic, and Polish speakers. We translated the first patient-completed CRS to Spanish, Arabic, and Polish. We conducted a pilot study followed by the validation study. Using PASS version 11, we determined that a sample size of 37 achieved a power of 80%, to detect a difference of 0.1 between the null hypothesis correlation of 0.5 and the alternative hypothesis correlation of 0.7 using a 2-sided hypothesis test, significance level of .05. We tabulated and categorized scores using SPSS version 23 to estimate κ, linear correlation, and Bland Altman test. κ value >0.8 was defined as “almost perfect agreement.” From 129 recruited patients, 50 (39%) spoke Spanish, 40 (31%) spoke Arabic, and 39 (30%) spoke Polish; average age 51 (16.69) years, 58 (45%) were men, with less than college education (67%). Mean (standard deviation) CRS was 5 (3.90), the majority (63%) above moderate VTE risk. We report excellent agreement comparing physician and patient results (κ = 0.93) and high correlation 0.97 (P < .01) for the overall score. Bland Altman did not show trend for extreme values. We created and validated the first Spanish, Arabic, and Polish versions of the patient-completed CRS, with excellent correlation and agreement when compared to CRS-trained physician-completed form. Based on these results, the physician needs to calculate the body mass index. Completing the form was not time-consuming.

Keywords

Caprini risk assessment venous thromboembolism risk assessment model thrombosis prophylaxis patient-completed language validation

Introduction

Venous thromboembolism (VTE), comprising deep vein thrombosis and pulmonary embolism (PE), is a largely preventable global cause of morbidity and mortality. It represents the second most common postoperative complication and the third most common cause of excess mortality and cost in perioperative patients.¹ Nonfatal VTE events are responsible for one-third of disability-adjusted life years.^2,3 Hence, VTE prevention is the most important strategy for improving hospitalized patients’ safety and reducing VTE-related complications.^4,5 Surprisingly, despite the available strategies for VTE prevention, adequate target prophylaxis remains underutilized.^6
–8

The need and timing of thromboprophylaxis are based upon balancing both patient and procedure-specific risks for bleeding and thrombosis, and the use of VTE prediction tool is recommended to aid on this decision. Among the existent VTE risk assessment models, the 2005 Caprini risk score (CRS) is the most widely used and validated model.^9

–15 It weights independent risk factors for the individual, summing up a total score that correlates with the risk of postoperative VTE.¹⁶ Implementation of the CRS has lowered the incidence of postoperative VTE; in fact, the 9th American College of Chest Physician (ACCP) guidelines recommend the use of this model for risk stratification in nonorthopedic surgical patients.¹⁷ However, critiques to the CRS include relative complexity for reliable use, interpreter dependence, limited to one language, and time-consuming for health-care providers.¹⁸

There is a known association between low health literacy and worse medical outcomes.^19,20 This, combined with limited English proficiency, constitutes an even greater barrier to health care, comprising a vulnerable group with high prevalence of poor health status in the nonnative speaker population.^21,22 Our study was designed taking advantage of the patient-centered communication^23
–25 and focused on the subject of VTE prevention. Moreover, we expanded our reach to 3 widely spoken languages worldwide (Spanish, Polish, and Arabic).^26
–28 In the absence of patient-centered VTE risk assessment instruments, we aim to create and validate patient-completed versions of the CRS in these 3 languages.

Methods

Patients and Methods

We prospectively recruited consecutive Spanish, Arabic, and Polish native-speaking patients and their relatives (>18 years old) at John H. Stroger Hospital from October 2016 through March 2017. We included patients admitted to a medical or a surgical unit and excluded patients with inability to read or write, altered mental status, visual disorders, and acquired/congenital cognition impairment. A 3 step methodology was used for creation and validation on each language.

Step 1: Standardized translation

We recently designed and validated the first patient-completed CRS with almost perfect agreement compared to a physician-completed score.²⁹ Considering body mass index (BMI) was ineffectively estimated by patients, this should be calculated by the physician to obtain the final score.

We translated the patient-completed CRS from English to Spanish, Arabic, and Polish following a standardized process. First, 3 language-native authors independently translated each form into Spanish (L.H.P., D.O., and X.A.), Arabic (A.A., M.I., and A.I.), and Polish (W.K., A.L., and L.P.). Then, a fourth author created a unified version for Spanish (H.F.), Arabic (F.I.), and Polish (A.I.). Finally, all translators for each language reviewed the last form for accuracy. (Appendix)

Step 2: Pilot study

We conducted a pilot study to identify additional challenges specific to each language. In this phase, we conducted a standardized interview on hospitalized patients and their family members. During the first part of the interview, patients calculated their CRS using the form in their native language. Subsequently, a native-speaker physician blinded to the patient’s answers, scored the CRS for the same patient. At the end of the interview, we tabulated both forms for analysis.

Step 3: Validation

In a 15-week process, we prospectively enrolled patients admitted to the medical and surgical units. Patients were interviewed following the standardized process detailed above. Each rater received a training session on the CRS by one of the senior authors prior to starting the validation process. The local institutional review board approved this study and waived signed consent.

Statistical Analysis

We categorized CRS into very low, low, moderate, and high risk, as proposed in the 9th edition of the ACCP Evidence–Based Clinical Practice Guidelines,¹⁸ and measured agreement level using Cohen κ. Using PASS version 11, we determined that a sample size of 37 achieved a power of 80%, to detect difference of 0.1 between the null hypothesis correlation of 0.5 and the alternative hypothesis correlation of 0.7 using a 2-sided hypothesis test with a significance level of .05. κ statistic values of 0.4 or less are considered as poor, 0.41-0.60 as moderate, 0.61-0.80 as substantial (good), and 0.81-1 as almost perfect (excellent) agreement.³⁰ We calculated Spearman correlation coefficient to assess validity and correlation of the overall scores. Also, to quantify agreement between patient–physician cumulative CRS, we used the Bland Altman method. All statistical analysis was conducted in SPSS, version 22 (IBM Corp, Armonk, New York)

Results

In the pilot phase, we recruited a total of 83 patients, 33 (40%) spoke Spanish, 15 (18%) spoke Arabic, and 35 (42%) spoke Polish. Patients found difficulties adding up each item to obtain the cumulative score. However, in the interim analysis, this mathematical error did not affect the agreement level between physician- and patient-completed CRS. Therefore, no changes were made to the forms prior to the validation phase.

In the validation phase, we enrolled a total of 129 patients, 50 (39%) spoke Spanish, 40 (31%) spoke Arabic, and 39 (30%) spoke Polish. The Spanish-speaking group (n = 50) had a mean (standard deviation [SD]) age of 48 (15.8) years; 22 (44%) were men, with less than college education in its majority (76%). The Arabic-speaking group (n = 39) had a mean (SD) age of 43(15.6) years; 20 (50%) were men, with less than college education (50%). The Polish-speaking group (n = 39) had a mean(SD) age of 62(12.7) years; 16 (41%) were men, with less than college education (74%). The mean (SD) CRS calculated by the physician were 5 (4.37), 4(3.85), and 4 (3.12) for Spanish, Arabic, and Polish, respectively. When combined, the majority (63%) were classified above moderate risk of VTE based on the CRS (Table 1). Patients spent a median of 6 minutes (3-8) filling the form.

Table 1.

Patient Characteristics.

Variables	Cohort
n	129
Language	n (%)
Spanish	50 (39.00)
Arabic	40 (31.00)
Polish	39 (30).00
Age (SD); range	51(16.7); 17-91
Spanish	48(15.8); 18-88
Arabic	43(15.6); 17-82
Polish	62(12.7); 29-91
Gender
Women	71 (55.00)
Men	58 (45.00)
Education level
No education	3 (2.3)
Elementary	40 (31)
High School	44 (34.1)
College	40 (31)
Postgraduate	2 (1.6)
Patient-completed score, mean (range)	5.00 (0-18)
Physician-completed score, mean (range)	5.00 (0-18)

Abbreviation: SD, standard deviation.

The agreement level was excellent when the CRS was categorized following the ACCP guideline recommendations (κ = 0.93). Similar results were obtained when we stratified the analysis by languages, there was an excellent agreement level for Spanish (κ = 1.00), Arabic (κ = 0.93), and Polish (κ = 0.85) forms. Spearman correlation coefficients between patient- and physician-completed forms were 0.97 (P < .01) for the entire cohort (Figure 1), 0.98 (P < .01) for Spanish, 0.95 (P < .01) for Polish, and 0.99 (P < .01) for Arabic. The Bland Altman plot did not show any trend for extreme values (Figure 2).

Figure 1.

Spearman correlation.

Figure 2.

Bland Altman.

Discussion

We have created and validated the first Spanish, Arabic, and Polish versions of a patient-completed CRS, the most widely used perioperative VTE risk assessment model resulting not only in excellent correlation but also in excellent agreement when compared to CRS-trained physician-completed form. Our results may facilitate the implementation of a patient-driven risk assessment for Spanish-, Arabic-, and Polish-speaking communities in the world.

Patient-reported questionnaires have been found useful, valid, and well suited when health issues of complexity are explored in medical and surgical patients.^31,32 Jolly et al validated a self-reported instrument to assess disease impact named The Lupus Impact Tracker³³; capturing unique information prior to the medical encounter and incorporating patient’s perspective for disease management. The incorporation of a patient-completed CRS is in line with this approach.

Providing a good estimate of the risk of thrombosis may positively influence physicians in the selection of appropriate prophylaxis and aid in reducing the burden of VTE. Although the individualized risk assessment approach might be currently time consuming, it is effective and more importantly strongly advocated.^34,35,18

The 2005 Caprini Risk Assessment Model (RAM)¹⁷ has been extensively validated in terms of its predictive value for VTE posthospitalizations, enabling adequate extended postdischarge prophylaxis when warranted.^10,11,36,37 It is the most widely used RAM and currently serves as the guideline for thromboprophylaxis decision-making in nonorthopedic surgical patients.¹⁸ However, the scoring for VTE risk stratification using CRS has been obtained by the physician or care provider since its inception. Cassidy et al successfully implemented a thromboprophylaxis protocol based on the CRS in surgical patients. This protocol aimed to dictate the type and duration of VTE prophylaxis by incorporating recommendations to the electronic medical records. Using this protocol, patients with scores less than 5 efficiently received a mechanical thromboprophylaxis avoiding bleeding complications. There was a proven decrement of PE rate at 30 days (1.1%-0.5%).³⁸ Similar results were observed in a recent meta-analysis of 13 studies by Pannucci et al. Among 14 776 patients, those with scores less than 6 did not get any significant VTE reduction by using pharmacological thromboprophylaxis, indicating that these patients can be safely spared from pharmacological prophylaxis.³⁹

Strengths of our study include the lower average level of education in the patients assessed, which may enhance the external validity of our results. In addition, our methodology included a rigorous standardized translation process. The availability of the patient-completed CRS in 3 commonly spoken languages in the globe strengthens its potential reach and applicability. Moreover, despite the criticized cumbersome nature of the score,¹⁹ in our study patients required an average of 6 minutes to fill the form with an excellent agreement level.

Limitations to our study include that this was a single-center study and that we did not plan to determine correlation with VTE incidence. Conversely, the demographics at our institution allowed for a diverse nationality enabling us to use native speakers of each of the languages from both the patient and the physician standpoint. The new score needs confirmation of the BMI by the treating physician. There is substantial evidence reporting inappropriate obesity estimation when BMI calculation is based on patient-reported height and weight.⁴⁰ Because such data would be readily available in the medical records and are necessary to define the intensity of prevention, we do not think this should extinguish the applicability of our score.

We believe that implementing a patient-completed RAM would be a favorable way to promote self-advocacy in collaboration with the hospital team and provide the appropriate prophylaxis with a less time-consuming decision process. Taking advantage of a self-completed questionnaire, the incorporation of the patient CRS may precede the patient–physician encounter, and the results as well as interpretation be discussed during the patient–physician interaction. This strategy may apply for hospitalized patients as well as ambulatory encounters during perioperative risk evaluations.

The patient CRS is not meant to supplant the final physician’s oversight for the intensity and duration of thromboprophylaxis, but to assist in simplifying the risk stratification of patients, accounting for BMI and bleeding risk.

Footnotes

Appendix

Spanish Questionnaire

Polish Questionnaire

Arabic Questionnaire

Acknowledgment

The authors thank the patients of the DVT support group and Anna Liz and Lukasz Poborca for their contribution with the Polish translation.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

References

Zhan

Miller

. Excess length of stay, charges, and mortality attributable to medical injuries during hospitalization. JAMA. 2003;290(14):1868–1874.

Jha

Larizgoitia

Audera-Lopez

Prasopa-Plaizier

Waters

Bates

. The global burden of unsafe medical care: analytic modelling of observational studies. BMJ Qual Saf. 2013;22(10):809–815.

Raskob

Angchaisuksiri

Blanco

; ISTH Steering Committee for World Thrombosis Day . Thrombosis: a major contributor to global disease burden. Arterioscler Thromb Vasc Biol. 2014;34(11):2363–2371.

Shojania

Duncan

McDonald

Wachter

Markowitz

. Making health care safer: a critical analysis of patient safety practices. Evid Rep Technol Assess (Summ). 2001;(43):i–x, 1–668. Retrieved from https://www.ncbi.nlm.nih.gov/books/NBK26966/

Guyatt

Eikelboom

Gould

. Approach to outcome measurement in the prevention of thrombosis in surgical and medical patients: antithrombotic therapy and prevention of thrombosis, 9th ed: American College Of Chest Physicians evidence-based clinical practice guidelines. Chest. 2012;141(suppl 2):e185S–e194S.

Caprini

Hyers

. Compliance with antithrombotic guidelines. Manag Care. 2006;15(9):49–50, 3–60, 6.

Cohen

Tapson

Bergmann

; ENDORSE Investigators . Venous thromboembolism risk and prophylaxis in the acute hospital care setting (ENDORSE study): a multinational cross-sectional study. Lancet. 2008;371(9610):387–394.

Hohmann

Eickhoff

Kaemmerer

Schulz

. Compliance with antithrombotic guidelines in surgery patients in German hospitals: a multicenter study involving pharmacy interns. Clin Appl Thromb Hemost. 2012;18(3):299–304.

Bahl

Henke

Wakefield

Campbell

Jr Caprini

. A validation study of a retrospective venous thromboembolism risk scoring method. Ann Surg. 2010;251(2):344–350.

10.

Pannucci

Bailey

Dreszer

. Validation of the Caprini risk assessment model in plastic and reconstructive surgery patients. J Am Coll Surg. 2011;212(1):105–112.

11.

Shuman

Pannucci

Jackson

Bradford

Bahl

. Stratifying the risk of venous thromboembolism in otolaryngology. Otolaryngol Head Neck Surg. 2012;146(5):719–724.

12.

Stroud

Whitworth

Miklic

. Validation of a venous thromboembolism risk assessment model in gynecologic oncology. Gynecolo Oncol. 2014;134(1):160–163.

13.

Hewes

Hachey

Zhang

. Evaluation of the Caprini model for venothrombo embolism in esophagectomy patients. Ann Thorac Surg. 2015;100(6):2072–2078.

14.

Weber

Seal

McGirr

Fielding

. Case series of elective instrumented posterior lumbar spinal fusions demonstrating a low incidence of venous thromboembolism. ANZ J Surg. 2016;86(10):796–800.

15.

Macht

Gardner

Talutis

Rosenkranz

Doherty

McAneny

. Evaluation of a standardized risk-based venous thromboembolism prophylaxis protocol in the setting of thyroid and parathyroid surgery. J Am Coll Surg. 2017;224(6):1029–1035.

16.

Caprini

. Thrombosis risk assessment as a guide to quality patient care. Dis Mon. 2005;51(2-3):70–78.

17.

Gould

Garcia

Wren

. Prevention of VTE in nonorthopedic surgical patients: Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest. 2012;141(2 Suppl): e227S–e277S.

18.

Maynard

Stein

. Designing and implementing effective venous thromboembolism prevention protocols: lessons from collaborative efforts. J Thromb Thrombolysis. 2010;29(2):159–66.

19.

Nielsen-Bohlman

. Health literacy: a prescription to end confusion. In: Nielsen-Bohlman

Panzer

Kindig

, eds. Health Literacy: A Prescription to End Confusion. Washington, DC; 2004, National Academies Press (US). Available from: https://www.ncbi.nlm.nih.gov/books/NBK216032/doi: 10.17226/10883.

20.

Berkman

Sheridan

Donahue

. Health literacy interventions and outcomes: an updated systematic review. Evid Rep Technol Assess (Full Rep). 2011(199):1–941.

21.

Pippins

Alegria

Haas

. Association between language proficiency and the quality of primary care among a national sample of insured Latinos. Med Care. 2007;45(11):1020–1025.

22.

Sentell

Braun

. Low health literacy, limited English proficiency, and health status in Asians, Latinos, and other racial/ethnic groups in California. J Health Commun. 2012;17(suppl 3):82–99.

23.

Andersen

Urban

. Involvement in decision-making and breast cancer survivor quality of life. Ann Behav Med. 1999;21(3):201–209.

24.

Epstein

Fiscella

Lesser

Stange

. Why the nation needs a policy push on patient-centered health care. Health Aff (Millwood). 2010;29(8):1489–1495.

25.

McCormack

Treiman

Rupert

. Measuring patient-centered communication in cancer care: a literature review and the development of a systematic approach. Soc Sci Med. 2011;72(7):1085–1095.

26.

Comrie

. The World’s Major Languages. Oxford, UK: Oxford University Press. 1990.

27.

Dalby

. Dictionary of Languages: The Definitive Reference to More Than 400 Languages. New York, NY: Columbia University Press; 2004.

28.

Vitores

. El español: una lengua viva. Informe 2016. Dirección Académica del Instituto Cervantes; 2016. Departamento de comunicación digital del Instituto Cervantes.Retrieved from http://www.cervantes.es/imagenes/File/prensa/EspanolLenguaVnstitute of Cervantes Spain: iva16.pdf

29.

Fuentes

HE PL

Al-Ogaili

Acob

Tafur

Caprini

. Abstracts. Research and practice in thrombosis and haemostasis. RPTH. 2017;1(2475-0379):324–5.

30.

Landis

Koch

. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–174.

31.

Gerbert

B BA

Pantilat

McPhee

Allerton

Moe

. When asked, patients tell: disclosure of sensitive health-risk behaviors. Med Care. 1999;37(1):104–111.

32.

Goodhart

Andrzejowski

Jones

. Patient-completed, preoperative web-based anaesthetic assessment questionnaire (electronic personal assessment questionnaire preoperative): development and validation. Eur J Anaesthesiol. 2017;34(4):221–228.

33.

Jolly

Kosinski

Garris

Oglesby

. Prospective validation of the lupus impact tracker: a patient-completed tool for clinical practice to evaluate the impact of systemic lupus erythematosus. Arthritis Rheumatol. 2016;68(6):1422–1431.

34.

Caprini

Arcelus

Reyna

. Effective risk stratification of surgical and nonsurgical patients for venous thromboembolic disease. Semin Hematol. 2001;38(2 suppl 5):12–19.

35.

Cohen

Alikhan

Arcelus

. Assessment of venous thromboembolism risk and the benefits of thromboprophylaxis in medical patients. Thromb Haemost. 2005;94(4):750–759.

36.

Zhou

Peng

Yan

. Validation of the Caprini risk assessment model in Chinese hospitalized patients with venous thromboembolism. Thromb Res. 2012;130(5):735–740.

37.

Hachey

Hewes

Porter

. Caprini venous thromboembolism risk assessment permits selection for postdischarge prophylactic anticoagulation in patients with resectable lung cancer. J Thorac Cardiovasc Surg. 2016;151(1):37–44 e1.

38.

Cassidy

Rosenkranz

McAneny

. Reducing postoperative venous thromboembolism complications with a standardized risk-stratified prophylaxis protocol and mobilization program. J Am Coll Surg. 2014;218(6):1095–1104.

39.

Pannucci

Swistun

MacDonald

Henke

Brooke

. Individualized venous thromboembolism risk stratification using the 2005 Caprini score to identify the benefits and harms of chemoprophylaxis in surgical patients: a meta-analysis. Ann Surg. 2017;265(6):1094–1103.

40.

McAdams

Van Dam

. Comparison of self-reported and measured BMI as correlates of disease markers in U.S. Adults. Obesity (Silver Spring). 2007;15(1):188–196.