Abstract
Introduction
The relationship between patient and hospital characteristics and their influence on quality of life (QoL) variance following varicose vein treatment is little understood. Whilst Patient-reported outcome measures (PROMs) can record postoperative outcomes, the actual comparison of PROMs between hospitals can be misleading when the clustered nature of varicose vein care is overlooked. Multilevel models can accommodate hierarchical data and therefore can provide a more accurate reflection of the relationship between patients and hospitals when investigating postoperative outcomes.
Methods
A multilevel model of PROMs was developed to analyse the relationship of patient characteristics (gender, age), postoperative outcomes (complications, postoperative satisfaction, treatment success) and hospital type (operative volume and if private or NHS institution) with the change in Aberdeen Varicose Vein Score (AVVQ) six months after varicose vein treatment.
Results
Between April 2010 and July 2014, some 24,460 PROMs from 162 hospitals were analysed. Whilst the majority of variance in AVVQ improvement was due to patient factors, a small but statistically significant amount of variance was detected due to differences between hospitals. Multilevel regression revealed that females saw a greater improvement in AVVQ, as did those who reported greater levels of treatment success and satisfaction. Patient age, complications, intervention, readmission, hospital size and hospital type were not significantly associated with AVVQ improvement.
Conclusion
Although QoL is intrinsically tied to an individual, hospitals can provide a small but potentially important benefit in AVVQ improvement following vein treatment. A patient-centred approach is therefore recommended to optimise patient outcomes.
Introduction
Varicose veins are a common disease and estimated to affect up to half of all adults.1–4 Whilst compression of the afflicted limb may provide some symptomatic relief, most patients find that treatment of the underlying venous incompetence by surgery or ablation results in better symptom resolution and enhanced quality of life.5–7 Consequently, intervention for varicose veins is in high demand in the UK with at least 30,000 procedures performed annually. 8
Since 2009, the Department of Health England has collected national statistics on the varicose vein service provided in England. A two-part questionnaire, the Patient Reported Outcome Measures (PROMs), is offered to all patients undergoing elective varicose vein treatment. 8 The PROMs measure several patient outcomes such as postoperative satisfaction, treatment success, complications and, most importantly, quality of life (QoL). There are two measures of QoL used in the PROMs; the EuroQol 5-Dimension (EQ5D) 9 and the Aberdeen Varicose Vein Questionnaire (AVVQ).10,11 The EQ5D is a common general QoL instrument while the AVVQ is a more specific venous disease QoL instrument. Both are valid and sensitive measurements of QoL in patients with venous disease.7,12,13 While all PROMs outcomes can be considered valuable, the National Institute for Health and Care Excellence (NICE) regards QoL improvement as one of the most important measures of a treatment outcome. 14
While a cursory analysis of the PROMs data provides an overview of venous outcomes across the country and may even allow for a superficial comparison of care between hospital units, this ignores that these patients had, by definition, “clustered” into hospital groups for their vein treatment. Populations served by hospitals tend to be more similar when compared to a population as a whole and by not taking this into account, inaccurate conclusions can be drawn. By performing a multilevel linear regression, the stratification of the patient and hospital units can be controlled and the significance of certain patient and hospital characteristics correctly quantified. 15 The aim of this study was to investigate the effect of patient and hospital characteristics as measured by PROMs on improvement of patient QoL as determined by the AVVQ.
Methods
Between April 2010 and July 2014, patients undergoing elective primary varicose vein treatment (as coded as per the Appendix) were offered the opportunity to complete pre- and post-treatment PROMs under the auspices of the Health and Social Care Information Centre (HSCIC). 16 The preoperative PROMs record baseline demographics (age and gender) and baseline QoL using the EQ5D and AVVQ. After six months, the postoperative PROMs record complications, the treatment success, patient satisfaction and repeat the QoL using EQ5D and AVVQ. The AVVQ consists of 13 questions which calculate the level of disease severity on a scale of 0–100. A score of 0 would indicate no QoL impairment due to venous disease and a score of 100 would indicate significant QoL impairment due to venous disease. However, AVVQ scores close to 100 are unusual and most patients with uncomplicated varicose veins typically scoring between 10 and 30, and even patients with venous ulcers normally scoring between 30 and 60. 13 The AVVQ reacts well to QoL improvement after venous intervention and consequently is one of the most popular disease-specific QoL measures used in venous research.17–19 The EQ5D is a general measure of QoL and calculates an individual’s health state by asking five three-level ordinal questions. An EQ5D score of 1 is classed as a perfect health state without any impairment of the domains which determine QoL. Health states of 0 would represent a zero health state (i.e. death) and below 0 would represent a health state worse than death. Post-operative complications were self-reported by patients and recorded any incidence of allergy or reaction to a drug, post-operative bleeding, wound problems, urine problems or any need for further treatment or readmission after their initial treatment over the subsequent six months. Success and satisfaction were self-reported by patients on a five-level ordinal scale with 1 representing the best outcome and 5 the worst outcome. Individuals were censored of age and gender when fewer than six records were returned from a single provider to reduce the potential risk of patient identification.
The HSCIC database also recorded the volume of varicose vein operations performed at each individual institution using the national Hospital Episode Statistic (HES) database. 8 Hospital units were classed as “NHS” if it was a NHS institution or “Private” if it was run by a private healthcare concern.
Outcomes
The primary outcome of this study was to explore AVVQ change following varicose vein treatment using a multilevel linear regression model. By treating all units of analysis as independent observations, a conventional linear regression model could inaccurately calculate the standard errors of the regression coefficients and therefore overstate statistical significance. By allowing for residual components to vary at different levels, a multilevel model will avoid this pitfall and provide a more reliable statistical conclusion.
Statistics
Descriptive statistics were calculated for both the patient-level and hospital-level variables. Hypothesis testing was performed using paired and unpaired t-tests for normally distributed data and Mann–Whitney U and Wilcoxon Signed Rank tests for non-normally distributed data. Correlation was performed using Spearman’s Rank testing, and if significant was further explored using linear regression for continuous data. Multivariable regression was performed to explore PROMs variables prior to multilevel regression. Multilevel linear regression is elaborated as follows.
Multilevel regression model
A series of multilevel hierarchical models were built in sequence to investigate the variance in AVVQ change. Models were of two levels, whereby patients constitute the first (lower) level and hospitals constitute the second (higher) level. The analysis was completed in three stages with each iteration increasing the model complexity and therefore explanatory capacity. The first model (Model 1) is a simple variance component model which measures the amount of variance in AVVQ observed across the two levels. This indicates how much of the overall variance observed is due to first- (patient) or second-level (hospital) characteristics.
The second model (Model 2) introduced independent variables at the first (patient) level to examine how much of the variance is due to the patient characteristics as follows: age, gender, allergy or reaction to drug, postoperative bleeding, wound problems, urine problems, further treatment, readmission and also self-reported success and treatment satisfaction scores. The third model (Model 3) introduced independent variables at the second higher (hospital) level to determine how much variance can be explained by the hospital size (varicose vein procedures performed per annum) and the hospital designation as either an NHS or Private hospital. Preliminary analysis was first undertaken in SPSS (Chicago, Version 22) while MLwiN (University of Bristol, Version 2.30) was used for subsequent multilevel analysis.
Results
Baseline characteristics.
Median (interquartile range).
EQ5D: EuroQol 5 dimension.
Follow-up outcomes.
Mean (standard deviation).
EQ5D: EuroQol 5 dimension.
Gender
A significant difference in quality of life was noted between the genders. Females reported worse AVVQ compared to males at baseline [female: 18.6 (13.5–25.5) vs male: 15.6 (10.1–23.2) P < 0.001] and worse scores after treatment [female: 10.6 (5.0–17.8) vs male: 6.7 (2.4–14.3) P < 0.001]. However, both groups saw an improved AVVQ score after treatment (P < 0.001 Wilcoxon) and mean improvement in AVVQ score was similar for both genders [female: −7.8 (9.4) vs male: −8.0 (9.9) P = 0.344]. This disparity in QoL between the genders was confirmed in EQ5D scores. Both the preoperative [female: 0.796 (0.725–0.796) vs male: 0.796 (0.725–1.000) P < 0.001] and postoperative [female 0.850 (0.760–1.000) vs male: 1.000 (0.796–1.000) P < 0.001] EQ5D scores showed females at a disadvantage. However, again, there was no difference in actual improvement for either genders [female + 0.052 (0.000–0.204) vs male + 0.033 (0.000–0.204) P = 0.053].
Age
As shown in Figure 1, there was a significant difference in median AVVQ across the age groups preoperatively and postoperatively (Kruskal Wallis P < 0.001). Older age groups typically reported higher AVVQ scores when compared to younger age groups. Most age groups were not drastically dissimilar in AVVQ score from their neighbouring age group except for a significant step in AVVQ severity noted between the age groups 40–49 to 50–59 in both preoperative (P < 0.001) and postoperative (P = 0.015) AVVQ scores. Although older age groups typically saw greater falls in AVVQ compared to younger patients (P < 0.001), no significant step in AVVQ improvement was detected across the age groups.
Preoperative and postoperative Aberdeen Varicose Vein Score (AVVQ) and patient age.
Private vs pubic healthcare sectors
Complications.
χ2.
Mann–Whitney U.
Unit size and outcomes
The number of procedures performed at an institution correlated significantly with AVVQ change (r2 = 0.041, P < 0.001). Exploration of this relationship using linear regression suggested that every additional 10 vein treatments worsen the expected AVVQ improvement by 0.02 points.
Multivariable regression model
Multivariable linear regression.
Note: Reference category: gender (male); age (20–29); satisfaction (bad); success (Much worse); allergy problem (yes); post-operative bleeding problem (yes); post-operative wound problem (yes); further treatment required (yes); readmission (yes); hospital sector (private hospital).
Multilevel linear regression model
Model estimates for multilevel regression of AVVQ change.
Note: S.E.: standard error
Reference category: gender (male), age (20–29), satisfaction (bad), success (much worse), allergy or drug reaction (yes), post-operative bleeding (yes), post-operative wound infection (yes), further surgery (yes), readmission (yes), hospital sector (private).
Patient characteristics were then introduced into the model (Model 2). Patient characteristics, as measured by the PROMs, could explain 12.7% of the overall fall in model variance when compared to the first model. However, these characteristics were only able to explain 12.03% of the actual reduction in variance within the patient level itself, suggesting that 87.97% of the variance seen between patients was due to presently unobserved patient characteristics. A much greater fall in variance was seen between hospitals with a 38.34% reduction in variance seen at the second level, suggesting that patient characteristics are comparatively much better predictors of outcomes. Hospital characteristics were then introduced into the model (Model 3). Total model variance improved minimally (0.003%), with hospital-level variation increasing slightly and patient-level variation decreasing slightly. Using scaled log-likelihood ratio χ2 test to compare models, Model 3 was a better model fit (Log difference = 1029.64, df = 2, P < 0.001). In this final model, differences between hospitals explained 1.96% of the variance in AVVQ outcomes with 98.04% of the variance explained by patient-level factors.
The final model suggests that, in holding all other variables constant, females have 0.586 more AVVQ point improvement over males, patients “Excellently” satisfied have 5.235 more AVVQ points improvement over those with “Bad” satisfaction, and those “Much better” success have 11.320 more AVVQ points improvement than those with “Much worse” success. Age, allergy or drug problem, bleeding problem, wound problem, additional treatments and readmission were not significant explanatory variables, and neither hospital sector or hospital size were significant characteristics in explaining the variance in AVVQ improvement between hospitals.
Discussion
Whilst the vast majority of variation in AVVQ improvement following varicose vein treatment does appear to reside in differences between individual patients, a small but statistically significant amount of variance in AVVQ improvement can be attributed to differences between hospitals. Most of the factors that affect AVVQ variance are, however, as of yet still unclear. Current PROMs suggest that gender, treatment success and satisfaction are patient characteristics which are strongly associated with AVVQ improvement. Reasons for the difference between hospitals are currently unknown and evidently such intra hospital variance observed is not explained by hospital size nor hospital type. It therefore appears that a significant proportion of unobserved patient and hospital characteristics remain to be identified which may potentially help explain this unaccounted variance. While the presence of “unknown unknowns” may cause some unease, it is a fortuitous advantage of multilevel models modelling that such gaps in knowledge can be clearly quantified and delineated several noteworthy results have been extracted from the data regardless.
Firstly, females are more represented within the PROMs and respond better to treatment. Although women are more likely to be referred for treatment compared to males, it is important to note that females suffer a significantly disproportional amount of venous disease QoL impairment compared to men, typically scoring 3–4 AVVQ points with the same clinical severity potentially explaining this phenomenon.20,21 Whilst the burden of venous disease is worse for women, it also appears that females are generally more susceptible to developing venous disease over their lifetime and consequently this explains why more females undergo treatment and contribute a higher proportion of PROMs.2,22 This study indicates that once the burden of venous disease is lifted, women respond with a much greater fall AVVQ, thereby confirming the additional impairment women experience due to venous disease on their quality of life.
Second, it is understandable that patients report higher levels of satisfaction and perceive better treatment outcomes if they find that their QoL has significantly improved after treatment. Despite most patients reporting reasonable to excellent treatment outcomes, it is a concern that so many patients report “fair” to “bad” satisfaction. Two decades ago, a study by Davies et al. 23 suggested that 26% of NHS and 13% of private varicose vein patients report high levels of dissatisfaction after vein surgery. Since conventional vein surgery has become a third choice after minimally invasive surgical techniques, it is hoped that patient care and outcomes may improve with more specialised and less traumatic endovenous treatments. 24 However, patients seem to be broadly satisfied with either conventional or endovenous surgery in the short term, and long-term satisfaction appears to be more tied into vein recurrence or return of symptoms.19,25 Just as larger improvements in AVVQ are understood to relate to a higher perception of treatment success, satisfaction is also more likely to be increased in those with stronger AVVQ improvements. Improving reported satisfaction and perceived treatment success will therefore respond to techniques and methods which can enhance QoL improvements following vein treatment.
Third, the fact that most of the PROMs and hospital characteristics measured actually do not relate to QoL improvement is intriguing. Although older patients present for treatment with a typically worse AVVQ and appear to experience a greater benefit from treatment, age does not apparently influence the eventual improvement in AVVQ score once other patient factors are controlled. It is also counterintuitive that complications do not affect QoL improvement. The impact of complications on QoL appears to be either limited or short lived with little bearing on the final AVVQ score. Whilst problems such bleeding and allergy or reaction to drugs can be expected to be transient issues, more complicated issues such as wound problems, additional treatment and readmission do not appear to be a significant drag on typical QoL improvement. Indeed it is known that in the case of additional procedures, it appears that patients “catch up” QoL improvement once residual symptomatic veins are treated promptly, potentially explaining why additional procedures report similar QoL levels rather than signify worse outcomes.26,27 It is also interesting to note that, although private healthcare patients seem to have higher levels of satisfaction and success, private care does not appear to translate into any additional improvement in QoL. Both private and NHS institutions appear to be equally adept at treating varicose veins, suggesting that the differences between hospitals are more likely to reside in general patient care practices common to all types of hospitals rather than activates which are distinct to either NHS or private hospitals.
There are several limitations of this study which should be noted. Patient characteristics recorded by the PROMs are quite limited and ideally should be expanded. The addition of more baseline and follow-up outcomes, such as disease-specific clinical severity measurements such as the CEAP 28 or VCSS 29 classification or pre- or postoperative duplex ultrasonography results, may help explain the observed variance but unfortunately such clinical measurements do not always relate to subsequent QoL improvements.30–32 Operative and follow-up details are also missing. The impact of newer endovenous techniques could have been explored, as could various compression regimes and other postoperative management strategies. General issues related to the difficulty of completing a PROMs questionnaire, especially among older patients, should be noted. Censoring of data for facilities which perform few procedures may obscure the effect of small volume hospitals, especially as these smaller hospitals may preferentially treat less complex cases when compared to larger tertiary centres.
In conclusion, QoL improvement after varicose vein treatment is complicated and much remains to be understood. This large study appears to suggest that QoL improvement following varicose vein treatment depends mostly on the individual patient characteristics with only a small effect owing to the treatment centre where the procedure was performed. Regardless, varicose vein treatment is associated with significant improvements in QoL and methods of best practice need to be recognised and disseminated nationwide.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
