Abstract
Summary
To assess the effectiveness of telehealth used for chronic heart failure (CHF) patients, we searched for peer-reviewed, randomized controlled trials published between 2001 and 2012. A total of 33 studies met the inclusion criteria. There were 26 studies (79%) which concerned tele-monitoring and 7 (21%) which concerned case management or nurse administered telephone-based management. There were 7530 patients in all, with an average age of 69 years. A meta-analysis showed that telehealth programmes had significant overall effectiveness in reducing all-cause mortality (Fixed effect model risk ratio 0.76, 95% CI 0.66 to 0.88), CHF-related hospitalization (Random effect model risk ratio 0.72, 95% CI 0.61 to 0.85) and CHF-related length of stay (Random effect model mean difference -1.41 days, 95% CI -2.43 to -0.39). In addition, telehealth programmes showed significantly greater effectiveness in reducing mortality and hospitalizations among patients with higher New York Heart Association (NYHA) categories. With age and NYHA held constant, recording questionnaire (symptoms) data could reduce the mortality risk by 34% and the risk of CHF-related hospitalization by 15%; adding a pulse (heart rate) detector could reduce the mortality risk by 40% and the risk of CHF-related hospitalization by 43%. Finally, telehealth programmes showed a tapering effect on mortality reduction: the longer the follow-up period, the less effective they were on decreasing mortality. In conclusion, telehealth programmes demonstrated clinical effectiveness in patients with CHF compared with usual care.
Introduction
Chronic heart failure (CHF) occurs when the heart is unable to provide sufficient pump action to distribute blood flow to meet the needs of the body. CHF can cause a number of symptoms including fatigue, weight gain, shortness of breath, oedema, dizziness and syncope.1 CHF results in significant medical attention and high hospital costs. In the US, there are more than a million hospitalizations per year for CHF as a primary diagnosis and 3.6 million per year for CHF as a primary or secondary diagnosis.2 Approximately 50% of CHF patients are re-hospitalized within 6 months of discharge, a trend that is expected to rise in parallel with the ageing population.3,4 Ten million people are estimated to suffer from CHF in Europe and 4–7 million in the US.5 In 2010, the estimated total cost of CHF was $39 billion in the US.6
Exacerbations of CHF signs and symptoms may indicate a worsening clinical status and necessitate medical attention, otherwise decompensation and hospitalization may happen which increase the cost of treatment. If patients had the ability to know more about their illness, recognize changes in signs and symptoms, and could access a healthcare provider promptly the incidence of decompensation and subsequent hospitalization could be reduced.7
Telemedicine, based on telecommunication to monitor patients and transmit data related to patient health status,8 has been suggested as beneficial, because patients’ signs and symptoms can be assessed remotely and promptly by healthcare providers. Therefore, deterioration can be quickly detected to prevent mortality and re-hospitalization.9 However, the extent of the benefit from telehealth is still unclear. Although most research has shown positive outcomes, some studies have found neutral or even negative results. To our knowledge, no prior meta-analyses9–11 have investigated the impact of patient characteristics and/or which physiological variables are monitored on the clinical effectiveness using a meta-regression approach. We have therefore studied the relation between the clinical outcome and covariates such as duration of tele-monitoring, patient characteristics and the particular physiological variables being monitored.
Methods
We searched in PubMed, Cochrane Review, European Journal of Heart Failure, International Journal of Cardiology and Journal of the American Medical Association for trials that examined the efficacy of telehealth in CHF patients from 2001 to 2012. Telehealth (remote patient monitoring) for CHF patients began developing in the mid 1990s12 and there were few reports of randomized trials before 2001.13 We chose a ten-year period starting from 1 January 2001.
The keywords used in the search were: tele-monitoring, home monitoring, home based solution, telehealth, remote patient monitoring, disease management, medication monitoring, congestive heart failure, chronic heart failure and heart failure. Only randomized controlled trials (RCT) were included that reported at least one of the following outcomes: all-cause mortality, CHF hospitalization or CHF length of stay (LOS). The selection process is shown in Figure 1. Two authors reviewed the articles to ensure that they met the inclusion criteria. After the selection process was complete, each person separately extracted the information from the chosen articles. The results were consolidated and the discrepancies were resolved by a third author.
Study search strategy
For each article, we collected the following information: year of publication, place of study, total number of patients included in the trial, numbers of patients in intervention and control groups, mean duration of follow-up, age, sex, New York Heart Association (NYHA) functional class and types of physiological data recorded by telehealth (e.g. symptoms, bodyweight, blood pressure, electrocardiogram, heart rate, medication adherence, urine output and oxygen saturation). Only a few articles reported any CHF-caused deaths so this was not included.
Statistical analysis
The primary end point of the present study was a comparison of (1) the average difference in CHF-related LOS in days and (2) the cumulative incidence of events (number of patients with events/total number of patients per arm) between usual care and telehealth for each of the outcomes considered: all-cause mortality and CHF-related hospitalization.
The effect size used to compare mortality and CHF hospitalization was relative risk or risk ratio (RR). The effect size used to compare CHF-related LOS was the mean difference (MD), because all studies reported LOS in the same scale (days). The RR and the 95% confidence interval (CI) for mortality and CHF hospitalization in each study were calculated. Individual RRs were then pooled according to the fixed effect (FE) model, Mantel-Haenszel fixed-effect (MH) model, and random effect (RE) model.14 Restricted Maximum Likelihood (REML) was used by default because it was approximately unbiased and quite efficient.15
Meta-regression is a tool used in meta-analysis to examine the effect of moderator variables on study effect size using regression-based techniques. The goal is to explore which variables (e.g. patient characteristics and monitoring devices) contribute more to the overall effectiveness of telehealth. Most meta-analyses are conducted using either the fixed effect model or the random effect model. Under the fixed effect model we assume that there is an overall true effect size among the studies in the analysis, and differences in observed effects are due to sampling error. The random effect model allows the true effect to vary from study to study16 The fixed effect model has lower estimated standard error and higher power to detect significance. However the fixed effect model should not be chosen when heterogeneity exists among different studies. Statistical heterogeneity was evaluated by the Cochran Q test and measured by the I-squared statistic. Ignoring heterogeneity could increase Type I error and lead to inaccurate estimations. When the I-squared statistic was >20% we considered the overall effect sizes from random effect models to be preferable.10 The presence of any publication bias for each outcome was examined by funnel plots. The metafor package in R17 was used for all computations.
In summary we used empirical studies to suggest the possible covariants for the meta-analysis. For instance, due to the complexity of the literature sources, trials from different studies included different patient population, intervention approaches and study durations. Empirical studies have shown that higher mortality rate occurred among patients with worse symptoms and older ages.18,19 In addition, some evidence also suggested that the mortality rate was different after 30 days and 1 year duration.20 Therefore it would be interesting to explore whether patients with different backgrounds shared the same telehealth effectiveness. In the meta-regression, we extracted the average age of patients in a given study. For NYHA, the distribution of the patients with different NYHA was used to estimate the study NYHA value, which was defined by a weighted mean. If the NYHA distributions were not available in a study then we assumed that the patients were uniformly distributed.
Results
A total of 33 papers met the inclusion criteria, see Table 1. There were 26 studies (79%) which concerned tele-monitoring and 7 (21%) which concerned case management or nurse administered telephone-based management. The sample sizes varied from 20 to 502 patients (7530 in total) and the average age was 69 years. In most studies (85%) the follow-up period was 6–12 months, while in 2 studies participants were followed up for 24 months and in another 3 studies for less than 6 months.
Study characteristics
The baseline trial characteristics were similar among the three outcome groups, see Table 2. Study publication dates were almost equally distributed during the ten year period, and most research took place in Europe or the US (Figure 2 and 3). In most of these studies, the CHF diagnosis had already been established. The patients had had one or more CHF-related hospital admissions in the previous year before the study was conducted. This criterion excluded low-risk patients. The standard of CHF care in the home refers to tests on the left ventricle of the heart, an ACE inhibitor, instructions on how to care for patients at home or advice on how to stop smoking.21 Tele-monitoring devices were used to collect several types of physiological data (Figure 4). While all studies had recorded scales (bodyweight, BP, or both), none included a fall detector. More than a half of the studies recorded symptoms and pulse (heart rate) but less than 10% detected patients’ SpO2 or urine output. Finally, 27 papers (82%) reported all-cause mortality, 23 (70%) papers reported CHF-related hospitalization and 10 (31%) reported the CHF-related LOS (Table 2).
Publications Countries of publications Variables monitored in the tele-monitoring programmes


Baseline characteristics
Meta-analysis
The meta-analysis showed that telehealth was associated with a significantly lower risk of deaths (RR 0.76, 95% CI 0.66 to 0.88, P = 0.001) compared with usual care (Figure 5). No significant heterogeneity between studies was detected according to the Cochran Q test (P = 0.49) so the fixed model was used (Figure 5). Studies were distributed symmetrically around the mean effect size based on visual inspection on the funnel plots in Figure 8, which indicated that the sampling error was random, i.e. no publication bias was observed. Meanwhile, positive effects on CHF hospitalization were found (RR 0.72, 95% CI 0.61 to 0.85, P <0.001) according to the random effect model because significant heterogeneity (66%, P < 0.001) was present (Figure 6 and Table 3). In addition, the telehealth group had shorter CHF-related LOS (MD -1.4 days, 95% CI -2.4 to -0.4, P = 0.007) with extremely high heterogeneity among studies (71%, P < 0.001), but still without losing the significance in the random effect model (Figure 7 and Table 3). No publication bias was found on CHF hospitalization or CHF LOS according to the symmetric funnel plots in Figure 8.
Forest plot for all-cause mortality Forest plot for CHF hospitalization Forest plot for CHF LOS Publication bias for the three outcomes



Meta-analysis summaries
I-squared <20% indicated small heterogeneity
Q test was not significant so that no significant heterogeneity was presented; fixed effect model was able to be used
I-squared >20% indicated high heterogeneity
Q test was significant so that there was significant heterogeneity among studies; random effect model had to be used
In a sensitivity analysis, there was similar effectiveness of tele-monitoring and telephone-assisted case management, see Table 4. However, case-management did not have significantly better effects on reducing mortality or CHF-related LOS compared with usual care, but did have a significantly reduced rate on CHF hospitalization (RR: 0.66, P<0.001).
Sensitivity analysis
In summary, telehealth had a significant overall effect on reducing all-cause mortality, CHF hospitalization and CHF LOS. There was a mean decrease in patient mortality of 24%, CHF hospitalization of 28% and CHF LOS of 1.4 days. To our knowledge, the present study is the first meta-analysis which attempts to find the relationship between effectiveness of telehealth programmes and the types of physiological information recorded.
All-cause mortality
Residual heterogeneity was tested to see if the effect sizes of studies were identical. The Q-value (Q = 18.0) indicated that there was no significant residual heterogeneity after the influence of duration was taken into consideration for mortality. (The Q-value is a measure of weighted squared deviations to test residual heterogeneity in meta-analysis.16) The fixed effect model was therefore used. The regression model of the mortality risk ratio was: exp(-0.69 + 0.03x), where x was the study duration in months.
According to the model the 95% CI of the regression coefficient was 0.0087 to 0.0539 (P = 0.007). Therefore it was significant. An interpretation could be that the log relative risk of mortality increased significantly when the study duration increased, in other words, the longer the duration, the less effective telehealth was. The RR for duration x was exp(-0.69 + 0.03x), and so the first month's RR could reach 0.52. This suggests that telehealth programmes decreased patient mortality by 48% for the first month compared with usual care.
The increasing trend of mortality RR and the decreasing trend of effect in a one-year telehealth period based on the results of fixed effect regression model are shown in Figure 9.
Variation of all-cause mortality effectiveness in one year
CHF hospitalization
The test for residual heterogeneity had Q = 60.6 (P<0.001), so that residual heterogeneity was significant. Duration did not explain the heterogeneity in the dataset. The random effect model for RR was exp(-0.41 + 0.0002x), where x indicated study duration in months. The random effect model provided non-significant results for the regression coefficient. Thus we concluded that there was no significant difference in CHF hospitalization due to the different follow-up durations. Therefore it was appropriate for us to use overall RR as the RR given any duration for CHF hospitalization.
CHF LOS
The test for residual heterogeneity had Q = 34.4 (P<0.001) so that residual heterogeneity remained significant after considering the duration when modelling CHF LOS. Similarly the significant residual sums of squares indicated that duration did not explain all of the heterogeneity in the dataset. As a result, the random effect model was appropriate. The random effect model of MD was -1.37–0.01x, where x was the study follow-up duration in months. However, it did not provide a significant result for the regression coefficient. Thus there was no significant difference in CHF LOS among different follow-up durations. We were able to use a constant effect size (the overall MD) as a reduction for CHF LOS given any follow up duration. The meta-regression results are summarised in Table 5.
Meta-regression on follow-up duration
Age, NYHA and variables monitored
We applied the fixed effect model for mortality, but the random effect models to analyse CHF hospitalization and LOS based on the heterogeneity among the studies. The test for residual heterogeneity of meta-regression models on mortality was not significant. However residual heterogeneity did exist for meta-regression models on CHF hospitalization and LOS. Only the meta-regression models with at least one significant predictor are listed in Table 6. Age was the only significant covariate for CHF hospitalization but not for mortality or CHF LOS. Telehealth was less effective in older people. NYHA was a significant covariate in predicting mortality and CHF hospitalization. The results indicated that the higher the NYHA, the lower the risk ratio. Telehealth had a larger effectiveness in reducing mortality and CHF hospitalization when patients had higher NYHA categories. In addition, recording questionnaires (symptoms) or pulse (heart ratio) information significantly decreased the risk ratio for mortality and CHF hospitalization. It was surprising that ECG had significant negative effectiveness on CHF hospitalization, which might be the result of data bias or some clinical reason. There was no significant covariate for CHF LOS.
Meta-regression models with significant predictors
Predictors: A, age N, NYHA E, detected ECG in telehealth or not (1 = yes, 0 = no) M, detected Medication in telehealth or not S, detected Symptoms in telehealth or not P, detected Pulse in telehealth or not
significant at P<0.05
In summary, after controlling for age and NYHA, adding a questionnaire (symptoms) could significantly reduce all-cause mortality by 34% and CHF hospitalization by 15%; adding a pulse (heart rate) detector could significantly reduce all-cause mortality by 40% and CHF hospitalization by 43%, see Table 7.
Summary of meta-regression on age, NYHA and variables monitored
Calculated by exp(-0.42)
Calculated by exp(-0.51)
Calculated by exp(0.54)
Calculated by exp(-0.16)
Calculated by exp(-0.57)
Discussion
The present study demonstrates that telehealth significantly reduces all-cause mortality by an average of 24%, CHF-related hospitalization by 28% and CHF-related LOS by 1.4 days. The meta-regression shows that the reduction of all-cause mortality was even more pronounced during the early months of follow-up. A larger effect on all-cause mortality and CHF hospitalization was observed for patients in the higher NYHA categories. In addition, the benefit was greater when symptoms or heart rate were recorded by telehealth.
With the inclusion of the latest published telehealth RCTs for CHF patients, we investigated the effect of telehealth on three treatment outcomes: all-cause mortality, CHF-related hospitalization and CHF-related LOS. Three types of meta-analysis were employed: FE, MH (a special type of FE) and RE (REML). The appropriate method was selected based on the heterogeneity among the trials. For example, RE (REML) was used to model CHF-related hospitalization and CHF-related LOS; while all-cause mortality was modelled by MH and FE. The different meta-analysis methods allowed a fair comparison between our results and those published in previous meta-analyses: we verified that the results produced by the same method using the same set of trials were the same. In addition, all three meta-analysis methods yielded consistent evidence on the clinical effectiveness of telehealth programmes, which reduced the risk of bias induced by the method itself. There did not appear to be a significant effect on effectiveness depending on the geography of the publication. The results confirmed, extended and updated previous systematic meta-analyses.1,9,10,22
Moreover, our meta-regression analysis examined the relationships between clinical effectiveness and trial durations using meta-regression models. These showed that the trial duration negatively influenced the benefit on all-cause mortality but had no significant effect on the CHF-related hospitalization or LOS. The lack of significance in the latter case might be explained by papers with documented outcome on hospitalization and LOS having very similar trial durations, so they did not generate meaningful regression coefficients.
Our meta-regression analysis also attempted to answer questions such as which physiological variables monitored would be more effective. For instance, we found that adding questionnaires (symptom monitoring) or a pulse detector significantly enhanced the benefits of telehealth with respect to all-cause mortality and CHF hospitalization. Although the results showed that adding ECG had a negative effectiveness, this might have been because patients equipped with ECG suffered from more serious CHF. These results may be helpful in designing a telehealth programme to produce the greatest benefits. However, due to lack of statistical power for certain meta-regressions we are not able to draw a general conclusion. More evidence is needed to ascertain the correlations in certain covariates. Future work could include more well-designed cohort studies to increase sample size and possibly higher statistical power to detect significant differences.23
