Abstract
Objectives
To test the effects of adding text messages to weekly email communications on recipients’ total physical activity (leisure-time; workplace; domestic and garden; and active transportation) in employees of universities and colleges in the UK.
Methods
A randomised trial with two study groups (email only or email plus text messaging for 12 weeks) was implemented at five workplaces. Data were collected at baseline, immediately after, and four weeks after the intervention. Intervention effects on physical activity were evaluated using latent growth modelling.
Results
Total physical activity decreased over time in both groups but the decrease was non-significant. The only significant difference between groups was found for workplace physical activity, with the group receiving emails and text messages having a linear decrease of 2.81 Metabolic Equivalent h/week (β = −0.31, p = 0.035) compared to the email only group.
Conclusions
Sending employees two additional text messages resulted in less physical activity. Further investigation is needed to understand whether text messaging may play a beneficial role in promoting physical activity in workplace settings.
Introduction
Public health organizations across the globe advocate promoting health and physical activity in the workplace. Information and communication technologies, such as mobile phone, email and the Internet, have been utilised for promoting health in many settings including workplaces, and shown positive results. Email has shown to be feasible to implement and accepted by employees, 1 and has demonstrated improvements in self-efficacy, intentions, and behaviours related to physical activity and nutrition. 2 Mobile phone text messages or short messaging service (SMS) has been associated with positive effects on a variety of health behaviours, 3 improved health care outcomes, 4 disease prevention and management,5,6 physical activity7,8 and weight loss.9,10 A recent meta-analysis of 11 physical activity interventions using mobile devices 11 found that eight used SMS to promote physical activity and five reported physical activity outcomes. One of the studies 12 was conducted with teachers in primary schools in Hong Kong and used pedometers to measure step counts. No other SMS for physical activity studies have been reported in worksite settings.
The purpose of this study was to test the effects of adding weekly SMS communication to weekly email communication on physical activity of employees of academic workplaces in the UK.
Methods
Participants and procedures
Participants were academic staff of five universities and colleges in the UK. The study was approved by the local Medical School Ethics Committee. Workplaces were provided the intervention free of charge and were asked to promote it amongst their staff through email and printed posters provided to them by the researchers. During a series of six recruitment and enrolment periods, between September 2009 and April 2010, interested participants were invited to visit the study website to obtain information about the study, procedures and eligibility requirements. Participants were excluded if they reported physical impairments that prevented them from undertaking physical activity, or required medical supervision. After informed consent was supplied, participants completed a baseline assessment and provided their email address and mobile phone number.
Random assignment to one of two study groups was performed by computer-generated randomisation. Control group members were sent one personalised email per week for 12 consecutive weeks. The intervention group received the same personalised email as the control group, plus two standard SMS reminders per week for 12 consecutive weeks. Enrolment procedures and participant allocation are shown in Figure 1.
13
CONSORT diagram of participation flow through the MoveM8 trial. PA: physical activity.
Intervention
Message content was based on the Theory of Planned Behaviour. Formative research conducted with the target population helped to refine the message content and establish message delivery timing. Email content was validated using a web-based Delphi approach with experts in physical activity and the Theory of Planned Behaviour. Each of the 12 email messages addressed a specific theoretical construct and aimed to motivate participants to engage in regular physical activity. Twenty-four SMS messages were designed to reinforce the email messages (i.e. two SMS for every email message). Personalised emails included a greeting line with the participants’ name (e.g. ‘Dear John…’). Standard SMS reminders included a generic greeting line (e.g. ‘Hello!’ or ‘Hi M8!’). Emails were delivered at 11:00 am on Wednesdays. Text messages were sent at 11:00 am on Fridays and at 14:30 am on Mondays.
Measures
Demographic and background characteristics included age, sex, education, perceived health status, height and weight (used to calculate Body Mass Index).
Physical activity was assessed using the International Physical Activity Questionnaire long-form (IPAQ-L). 14 This collects information about the intensity, frequency and duration of daily physical activities over a seven-day period in four domains: leisure-time physical activity (LTPA), workplace physical activity (WPA), domestic and garden physical activity (DGPA), and active transportation physical activity (ATPA), as well as total physical activity (TPA), which is the sum of the domains.
Outcome physical activity variables for each domain were calculated following established guidelines. 15 Time spent in moderate, vigorous and walking activities in each domain was used to calculate total time per week (min/week) and multiplied by the metabolic equivalent. 16 TPA score was calculated as the sum of all four domains. The resulting variables were winsorized, with extreme cases identified using the outlier labelling rule. 17 Finally, the physical activity outcome variables were rescaled to Metabolic Equivalent (MET) h/week by dividing the MET-min/week by 60.
Data analysis
Intervention effects were measured by comparing data collected at three time-points: baseline (Time 0), immediate post-intervention (i.e. 12 weeks post-baseline) (Time 1) and one month post-intervention (i.e. 16 weeks after baseline) (Time 2).
Intervention effects were measured using latent growth modelling (LGM) with Mplus v6.12. Unlike ANOVA, MANOVA or ANCOVA for repeated measures, LGM can test for inter-individual differences in various developmental trajectories of variables over time. 18 LGM has been used in studies using physical activity longitudinal data19,20 and is a powerful approach for detecting changes over time and between groups even with small samples (i.e. <100). 21
LGM models were estimated using full-information maximum likelihood in combination with a maximum likelihood estimator with robust standard errors to accommodate missing data in Time 1 and Time 2 surveys. LGM can handle large amounts of missing data through full-information maximum likelihood as efficiently as multiple imputation. 22 To improve the estimation process, relevant ‘auxiliary variables’ that were correlated with missingness were added to the model. 23 The procedure is described below.
LGM in a structural equation modelling framework represents each measurement as observed variable in function of two latent factors (intercept and slope). The intercept represents the initial status (intra-individual mean values at baseline), and the slope represents the linear change over time (intra-individual difference over time). LGM accounts for measurement error in each time point and on latent factors, and produces statistical indexes of model fit, 24 which indicate the extent to which the data fit linear change functions in initial status and change. Statistical significance is tested with critical ratios (i.e. z-scores of parameter estimates divided by their standard errors).
The LGM models tested linear change functions in TPA and in the physical activity domains across three time points. Factor loadings of slope were fixed at Time 0 (0), Time 1 (1) and Time 2 (1.33), to reflect non-equidistant assessments. First, a preliminary test of baseline unconditional models (i.e. with only the outcome variables under study) was conducted with the full sample in order to determine model fit and to estimate the trajectories of growth for each variable. Then, to explore whether the intervention had an effect on change trajectories of the studied variables, a Multiple Indicators and Multiple Causes (MIMIC) LGM model was estimated. 21 Group membership was coded email only =0; email plus SMS = 1. Group differences in intercept and slope result in significant path coefficients between the dummy intervention variable and the intercept and slope factors. This approach is appropriate when the sample size is small and one wants to test intervention effects while controlling for other background factors or covariates.21,25 Background factors including sex, age, body mass index (BMI), perceived health status and education were specified in a final conditional model in addition to the intervention.
Model fit was assessed with goodness-of-fit indices 26 including the chi-square measure of absolute fit, which should be non-significant, the Comparative Fit Index, which should range from 0.90 to 0.95, respectively, indicating acceptable and good fit, and the standardised root mean residual, with values below 0.05 indicating close fit. 26 The sample size provided adequate statistical power for detecting significant changes in all unconditional LGM models. 21
Results
Initially, 331 people enrolled in the programme and were randomized to the study conditions. A total of 195 did not return Time 1 questionnaires (58.9%), 207 did not complete Time 2 questionnaires (62.5%), and 151 did not complete both Time 1 and Time 2 questionnaires (45.6%). Cases were included if they completed the baseline and at least one of the two follow-up questionnaires. A further 22 cases were excluded because of unrealistically high values for daily physical activities (i.e. more than 16 h/day). This resulted in 158 cases in the study.
Sample characteristics
Sample descriptive statistics.
Notes: aPhysical activity (PA) categories are based on total PA estimates and defined by the ‘Guidelines for Data Processing and Analysis of the International Physical Activity Questionnaire (IPAQ) – Short and Long Forms’ (IPAQ Research Committee, 2005): Low = does not meet the recommended levels or is not included in the other two categories; Moderate = at least five days of moderate PA for 30 min/day, or at least five days of walking for 30 min/day, or three days of vigorous PA for at least 20 min/day, or five days of a combination of activities for a minimum of 600 METs; High = at least three days of vigorous for a minimum of 1500 METs, or seven days of a combination of activities for a minimum of 3000 METs.15 MET: Metabolic Equivalent.
Unconditional growth models
Descriptive statistics for PA variables (MET-h/week) across time and linear change factor (slope).
Notes: TPA: Total physical activity; WPA: workplace physical activity; LTPA: leisure-time physical activity; DGPA: domestic and garden physical activity; ATPA: active transportation physical activity; MET: Metabolic Equivalent.
d= Cohen’s d, calculated as the difference in means between the first and the last assessment, divided by the pooled standard deviation. 25 All measures are expressed in MET-h/week.
Significant difference between groups, p < 0.05.
Intervention effects on physical activity
The MIMIC models with the intervention predicting the intercept and slope factors of the physical activity outcome variables achieved acceptable fit with the data (CFI ≥ 0.957, SRMR ≤ 0.032). Table 3 contains the estimated parameters for MIMIC models testing intervention effects and for the MIMIC models adjusted for age, sex, BMI, health status and education as covariates, with effect sizes (Cohen’s d), calculated as the difference in means from the first and the last assessment, divided by the pooled standard deviation.
25
Figure 2 shows the estimated means for each PA variable in intervention and control groups. TPA decreased (i.e. negative linear slope) in both groups, but the decrease was non-significant (BSlope = −3.76 MET-h/week, β = −0.27, p = 0.213) and it was not associated with significant intervention effects (i.e. intercept-SMS group coefficient for slope: BSlope-group = −4.57 MET-h/week, β = −0.10, p = 0.266). Significant decreases over time were observed in DGPA (BSlope = −3.68 MET-h/week, β = −0.34, p = 0.038) and in ATPA (BSlope = −2.37 MET-h/week, β = −0.30, p = 0.046), with an overall small effect size. Significant difference between groups was found in the WPA domain, where the intervention group (email plus SMS) experienced a linear decrease of 2.81 MET-h/week (β = −0.31, p = 0.035) compared to the email group.
Total, workplace, leisure-time, domestic and garden and active transportation physical activities measured by the IPAQ-L (means ± SE) in intervention and control groups. MET: Metabolic Equivalent. Selected parameter estimates for the MIMIC model testing intervention effects, and predicting intercept and slope factors with covariates. Notes: a = p < 0.05; b = p < 0.001. Model A = MIMIC LGM with intervention as covariate predicting intercept and slope factors; Model B = MIMIC LGM with intervention and background factors as covariates predicting intercept and slope factors. TPA: = Total physical activity; WPA: workplace physical activity; LTPA: leisure-time physical activity; DGPA: domestic and garden physical activity; ATPA: active transportation physical activity. B: unstandardized coefficient; SE: standard error of the unstandardized coefficient; B 95% CI: 95% confidence interval for the unstandardized coefficient; β: standardized coefficient, BMI: body mass index.
The MIMIC intervention effect models controlling for background factors showed small significant direct effects of background factors on initial levels and change in the physical activity outcome variables. Differences in initial status and change between the email and email plus SMS groups became non-significant in TPA and all the physical activity domains except for WPA. When confounders were added to the model, the change over time in WPA remained significant, with intervention group (email plus SMS) showing a significant decrease over time by 3.02 MET-h/week (β = −0.27, p = 0.029). No other significant differences between groups were found. There were no significant effects of background factors on initial levels of total PA, whereas change in TPA was positively associated with health status (BSlope-health status = 5.67, β = −0.20, p = 0.029): Among the PA domains, the initial levels of PA were lower in LTPA (BIntercept-age = −0.26, β = −0.21, p = 0.033) and higher in DGPA (BIntercept-age = 0.53, β = 0.44, p < 0.001) among older participants, were higher in DGPA for females (BIntercept-gender = 7.48, β = 0.19, p = 0.026), and were lower in ATPA for employees with higher health status (BIntercept-health status = −2.55, β = −0.20, p = 0.038). Finally, change over time in DGPA was significantly lower in males compared to females (BSlope-gender = −6.58, β = −0.60, p = 0.031). The effect sizes of the differences between the first and last assessment were overall small (d ≤ 0.30) and similar for both groups (Table 2).
Discussion
Main findings
The purpose of this study was to examine the effects of adding weekly SMS communication to weekly email communication on the physical activity in a sample of employees at academic workplaces in the UK. Unlike in Plotnikoff et al.’s study, 2 the intervention did not translate into significant increases in physical activity. Employees who participated and received email plus SMS, decreased their TPA, though the decrease was non-significant. While significant decreases over time in physical activity in domestic and garden and active transportation domains and a non-significant decrease in workplace physical activity were found, leisure time activity balanced the decrease with a small non-significant increase.
It should be noted that both the intervention and control groups showed high levels of physical activity at baseline (according to IPAQ guidelines), hence the intervention might have been successful in maintaining, rather than increasing, physical activity among an already active population. While the decrease in workplace physical activity for the email plus SMS group was significant, it was associated with small effects. The differences between groups in all physical activity variables were small, which is consistent with the workplace physical activity literature. 28
Employees receiving emails only showed smaller linear decreases in TPA compared to the intervention group. This resulted from the summative effect of small linear increases in WPA and LTPA, and slight linear decreases in ATPA and DGPA. An overall increase in WPA for the email only group is consistent with Plotnikoff et al. 2 in which workplace activity increased from Time 1 to Time 2 in an email group. The negative results for WPA in the SMS group were the direct opposite of our expectations. More research is needed to understand why the additional SMS was associated with a reduction of PA levels and in particular in the workplace domain. Too frequent SMS contact or too many messages per week could have been perceived negatively by some recipients. Was it because of the content or the medium? Was it because employees received the messages on their personal mobile phones? Was it because SMS were perceived as too intrusive?
Limitations
One limitation of this study was the recruitment and number of participants, which was compounded by attrition and non-response. Low participation is commonplace in workplace physical activity interventions, 29 and in some technology and web-based physical activity intervention studies. 30 Attrition reduced the power of the study. In addition, the participants already had moderate to high levels of physical activity. Future studies should try to attract those who are least active and may benefit the most from increased physical activity. Finally, the study did not include a true control group, although previous research has already demonstrated that email intervention is more effective than no intervention.1,2
Implications
There is support for using email in worksite physical activity interventions. However, it would be pre-mature to conclude that SMS should be avoided. Further investigation is needed to understand if text messaging may play a beneficial role in promoting physical activity in workplace settings.
Footnotes
Funding
This research was conducted with support of the Foundation for Research and Development, Università della Svizzera italiana.
Conflict of interest
All authors declare that they have no competing interests.
