The Telehealth Satisfaction Scale: Reliability,Validity,and Satisfaction with Telehealth in a Rural Memory Clinic Population

Abstract

Introduction: Patient satisfaction is a key aspect of quality of care and can inform continuous quality improvement. Of the few studies that have reported on patient satisfaction with telehealth in programs aimed at individuals with memory problems, none has reported on the psychometric properties of the user satisfaction scales used. Materials and Methods: We evaluated the construct validity and internal consistency reliability of the Telehealth Satisfaction Scale (TeSS), a 10-item scale adapted for use in a rural and remote memory clinic (RRMC). The RRMC is a one-stop interprofessional clinic for rural and remote seniors with suspected dementia, located in a tertiary-care hospital. Telehealth videoconferencing is used for preclinic assessment and for follow-up. Patients and caregivers completed the TeSS after each telehealth appointment. With data from 223 patients, exploratory factor analysis was conducted using the principal components analysis extraction method. Results: The eigenvalue for the first factor (5.2) was greater than 1 and much larger than the second eigenvalue (0.92), supporting a one-factor solution that was confirmed by the scree plot. The total variance explained by factor 1 was 52.1%. Factor loadings (range, 0.54–0.84) were above recommended cutoffs. The TeSS items demonstrated high internal consistency reliability (Cronbach's alpha=0.90). Satisfaction scores on the TeSS items ranged from 3.43 to 3.72 on a 4-point Likert scale, indicating high satisfaction with telehealth. Conclusions: The study findings demonstrate high user satisfaction with telehealth in a rural memory clinic and the sound psychometric properties of the TeSS in this population.

Introduction

Recent international reports have highlighted the growing global prevalence and incidence of dementia and the urgent need for strategies to improve the care and support of individuals with dementia and their informal caregivers.^1,2 A 2012 World Health Organization report, “Dementia: A Public Health Priority,” estimated a worldwide prevalence of 35.6 million, which is projected to double every 20 years.² In Canada, the report “Rising Tide: The Impact of Dementia on Canadian Society”³ forecasts a doubling of dementia prevalence in Canada by 2038. Rural areas are disproportionately affected because of the higher proportion of older adults⁴ and the geographic challenges in accessing necessary services. Systematic reviews of informal dementia care⁵ and formal services for dementia⁶ in rural and remote areas identified many rural-specific barriers, such as time, travel, cost, and lack of access to services and educational opportunities.

The quality, delivery, and efficiency of healthcare services are being transformed by telehealth technology. Telehealth, or telemedicine, refers to the use of telecommunications and information technologies to provide healthcare services across distances.⁷ Satisfaction with telemedicine is an important research focus because it is a critical aspect of quality of care and health outcomes,⁸ and assessing acceptability of services is in line with the growing emphasis on patient-reported outcomes.⁹ The majority of studies examining patient satisfaction with telehealth have been conducted using surveys. In a review of 93 studies of patient satisfaction with telehealth, the most frequently measured dimensions were professional–patient interaction, patient experience, and technical aspects.¹⁰ Reviews of patient satisfaction studies^8,10,11 have consistently identified significant methodological weaknesses in much of the research, including small sample sizes, convenience samples, absence of a definition of satisfaction, and lack of reliable and valid tools.

Several studies of patient satisfaction with telehealth in diabetes care^12
–14 and general medical settings¹⁵ have reported satisfactory psychometric properties of questionnaires. Of the few studies that have reported on patient satisfaction with telehealth in programs aimed at individuals with memory problems,^16
–18 none has reported on the psychometric properties of the user satisfaction scales used. For example, a study exploring the feasibility of telemedicine in a rural memory disorder clinic¹⁶ used a 19-item questionnaire to assess patient satisfaction in a sample of 99 patients. Responses to the 10 items with the highest average rating are reported, but no information about the scale's reliability and validity is provided. Barton et al.¹⁷ gathered informal feedback on satisfaction with telehealth from 15 patients in a memory disorders clinic. but no standardized measure was used. An evaluation of a telemedicine-delivered cognitive intervention for older persons with memory problems¹⁸ used an 11-item user satisfaction questionnaire, but the sample was small (n=11), and no information about the scale items or psychometric properties was reported. Given the limited data on the reliability and validity of user satisfaction scales, particularly within the context of healthcare services for individuals with memory problems and their caregivers, the aim of the current study is to evaluate the psychometric properties of the Telehealth Satisfaction Scale (TeSS) in a memory clinic serving a rural and remote population and to report on satisfaction with telehealth from the perspective of clinic patients and caregivers.

Materials and Methods

This research is part of a larger on-going research program involving the development and evaluation of a rural and remote memory clinic (RRMC) that incorporates telehealth videoconferencing with a one-stop interdisciplinary assessment in a tertiary-care center. The goal of the clinic is to provide a comprehensive, streamlined assessment of dementia and to reduce repeated travel over long distances. One objective of the research was to determine the acceptability of telehealth for preclinic assessment and follow-up appointments. We have previously reported on provider and patient/caregiver satisfaction with the use of telehealth in the clinic,¹⁹ the reliability of cognitive assessments administered in-person and by telehealth,²⁰ and the development and evaluation of a telehealth videoconferenced support group for spouses of RRMC patients diagnosed with atypical early-onset dementias.²¹ Details about the RRMC development and evaluation²² and interdisciplinary approach²³ are reported elsewhere.

Setting

This research was conducted in the western Canadian Prairie province of Saskatchewan (population, 1,072,082; area, 651,035 km²; population/km², 1.88).²⁴ In 2011, 39.1% of the population was classified as rural and small town (population less than 10,000).²⁵ Saskatchewan census data from 2011 show a higher proportion of older adults over 65 years of age living in towns (21.3%), villages (20.1%), and recreational villages (25.8%), compared with cities (14.0%).²⁵ The RRMC is located on the University of Saskatchewan campus in the city of Saskatoon (population, 246,300), which is the referral center for the middle and northern areas of the province. Telehealth services in Saskatchewan are provided through a provincial network initiated in 1999 and now encompassing 229 devices in 144 communities. Telehealth Saskatchewan services are located in community-based hospitals or clinics, and at each site a trained health professional provides technical and clinical support. High-performance videoconferencing equipment is used at all sites. Real-time connections are made across a province-wide broadband Internet protocol network dedicated to health, executive government, and education-based connections. The 768 kilobits/s baseline speed, enhanced with quality of service technology to protect the high quality of video images and sound, provides secure priority queuing for telehealth applications.

Participants

The target population for the RRMC is noninstitutionalized individuals in Saskatchewan who are referred to the clinic because of concern about a memory disorder. Eligible patients must live more than 100 km from the two major centers in Saskatchewan (rural location) or in one of the three northern health regions (remote location). Patients referred to the RRMC are first seen via telehealth from their local telehealth center, located in a hospital or health center. Local telehealth coordinators facilitate all sessions, including managing equipment and assisting with administration of testing materials. During a 30-min preclinic assessment the clinic nurse and neuropsychologist interview the patient and family about the referring problem and provide information about the clinic visit. This information is used to tailor the subsequent full-day interdisciplinary assessment that is conducted a few weeks later in Saskatoon by a neurologist, neuropsychology team, physical therapist, nurse, and dietitian. To evaluate telehealth in the clinic, a single-case design²⁶ was used, with patients randomly assigned to either telehealth or in-person appointment for their first follow-up assessment and then alternating between the two modes for the 6-week, 12-week, and 6-month follow-ups.²² At 1 year and annually, the patient and family are seen face to face for follow-up by the full team. Immediately following the preclinic telehealth assessment and each follow-up telehealth appointment, patients and their caregivers complete the TeSS. The psychometric evaluation reported in this article used data from the preclinic assessment, to control for potential differences in satisfaction due to familiarity with telehealth over time. The study received ethical approval from the University of Saskatchewan behavioral ethics review board.

The TeSS

The 10-item TeSS was adapted from a 12-item instrument used in previous telehealth studies in Saskatchewan. The scale was initially used as part of a national study to evaluate the use of telehealth applications in improving specialist access by residents of isolated northern First Nations communities,²⁷ and it was later used in a pediatric surgery clinic²⁸ and amputee clinic.²⁹ We replaced the term “specialist” in the original scale with “Memory Clinic Team.”

For the analysis reported in this article, two items were excluded from the original 12-item scale prior to conducting factor analysis. The first item, “How satisfied were you with the length of time to get this appointment?,” was excluded based on the rationale that specialist appointment wait times are a function of the healthcare system rather than the telehealth system. The second item, “How satisfied were you with your overall treatment experience at using telehealth?,” was excluded on the basis that it was an overall measure of satisfaction rather than a measure of satisfaction with a particular aspect of the telehealth experience.

Scale items are rated on a 4-point Likert scale (1=poor, 2=fair, 3=good, and 4=excellent). The total score on the 10-item TeSS can range from 10 to 40, with higher scores indicating higher satisfaction.

The original scale was described as being developed to assess “satisfaction with the telemedicine service and the quality of specialist care,”²⁹ although no psychometric evaluation was reported, and the theoretical framework for scale development was not described. Rather, satisfaction items appear to have been chosen based on face validity.³⁰ Our examination of the scale items suggested the scale's original authors were attempting to measure the following two constructs: professional–patient interaction and system/technical factors. They did not, however, examine its actual construct validity.

Data Analysis

Psychometric analyses were carried out to examine the construct validity of the TeSS and its internal consistency reliability. Factor analysis allows for the evaluation of construct validity (the internal structure of a scale) by demonstrating the degree to which scale items reflect particular constructs within the scale.³⁰ In addition, the procedure may be used to determine the number of dimensions within a single scale. Given a unidimensional scale, a single score may be calculated, whereas a multidimensional scale may require scores to be calculated for each subscale.³⁰ We then used the principal components analysis extraction method followed by varimax rotation to conduct an exploratory factor analyses on the 10-item TeSS. Case mean imputation of missing data was used where fewer than 25% of the items were missing (i.e., two or fewer items); if more than two items in the 10-item scale were missing, the scale for that patient was excluded.

Data were analyzed using SPSS software (version 20 for Macintosh; SPSS, Inc., Chicago, IL). Frequencies, mean, range, and standard deviation (SD) were used to describe the sociodemographic and clinical characteristics of patients, and mean scores were calculated for the 10 TeSS items. Support for the use of factor analysis was evaluated with the Kaiser–Meyer–Olkin measure and Bartlett's test of sphericity. The Kaiser–Meyer–Olkin measure of sampling adequacy varies from 0 to 1 and indicates the magnitude of the difference between zero-order correlations and partial correlations between pairs of variables, with measures of 0.80 and higher indicating that variables share a common factor and that factor analysis is warranted.³¹ The evaluation of the TeSS also included the percentage of variance accounted for by the scale, as well as internal consistency reliability as assessed by Cronbach's alpha.³¹ Cronbach's alpha values can range from 0 to 1, with high alpha values indicating that the scale as a whole is measuring just one attribute.³²

Results

Demographic and Clinical Data

Of the 318 patients seen in the RRMC study between March 2004 and July 2011 (Data Release 5, 2012), 65 patients had missing data (i.e., were not able to attend preclinic assessment, the questionnaire was not completed, or the questionnaire was not returned by the telehealth coordinator), and 26 patients completed preclinic assessment by means other than telehealth (e.g., by telephone or in-person) or were not required to complete a preclinic assessment before their clinic day (i.e., clinic-day appointments became available on short notice because of cancellations by other patients). Of the 227 patients or their family members who completed the TeSS, 223 completed eight or more of the 10 TeSS items included in the factor analysis and were included in the present study.

Table 1 presents the demographic and clinical characteristics of the 223 patients included in the present study. Most of the clinic patients were male (57.4%), and the average patient age was 71.5 years (range, 41–91 years; SD=11.0 years). The average education level of patients was below high school graduation at 10.8 years (range, 3–20 years; SD=3.3 years), and most patients (72.6%) spoke primarily English in their home. Significant comorbidity was common in this sample, with 73.5% of patients reporting five or more chronic conditions. After assessment at the clinic, 71.3% of patients were diagnosed with mild cognitive impairment, Alzheimer's disease, or another related dementia. A majority (57.8%) of the patients lived in communities classified as no, weak, or moderate Metropolitan Influenced Zones (see the footnote of Table 1). The average distance to the RRMC site in Saskatoon was 260.9 km (range, 103–595 km; SD=102.3 km). The one-way travel saved by telehealth assessment was substantial, at 227.9 km (range, 34–594 km; SD=106.5 km).

Table 1.

Characteristics of Rural and Remote Memory Clinic Patients (n=223)

	N	%
Gender
Male	128	57.4
Female	95	42.6
Age (mean, range, SD)^a	71.5 (41–91, 11.0)
<65	52	23.3
65–74	46	20.6
75–84	81	36.3
≥85	21	9.4
Missing	23	10.3
Marital status
Married/common-law	131	58.7
Widowed/separated/divorced	50	22.4
Never married	4	1.8
Missing	38	17.0
Education (mean, range, SD)	10.8 (3–20, 3.3)
Less than high school graduation	100	44.8
High school graduation	19	8.5
Beyond high school graduation	65	29.1
Missing	39	17.5
Language spoken most often at time
English	162	72.6
Other than English	10	4.5
Missing	51	22.9
Place of residence^b
Strong MIZ	94	42.1
Moderate MIZ	36	16.1
Weak MIZ	71	31.8
No MIZ	22	9.9
Chronic conditions
No chronic conditions	2	0.9
1–2	21	9.4
3–4	50	22.4
5 or more chronic conditions	114	51.1
Missing	36	16.1
Diagnosis
Alzheimer's disease	85	38.1
Mild cognitive impairment	25	11.2
Related dementia^c	49	22.0
Dementia not diagnosed	40	17.9
Missing	24	10.8
Distance (km) (mean, range, SD)
To telehealth site	33.0 (1–150, 42.1)
To Memory Clinic site	260.9 (103–595, 102.3)
One-way saved by telehealth	227.9 (34–594, 106.5)

At clinic day.

In strong Metropolitan Influenced Zone (MIZ) communities, 30% or more of the workforce commutes for work to a census metropolitan area (CMA) (≥100,000 population) or to a census agglomeration (CA) (≥10,000); moderate MIZ communities, 5–29% of the workforce commutes to a CMA/CA; weak MIZ, <5% commute to a CMA/CA; and no MIZ, none of the workforce commutes to a CMA/CA.³⁴

Vascular dementia, dementia with Lewy bodies, frontotemporal dementia, dementia of multiple etiologies, vascular cognitive impairment, Parkinson's disease, Huntington's disease, normal pressure hydrocephalus, dementia due to other general medical conditions, cognitive impairment not otherwise specified.

SD, standard deviation.

Satisfaction with Telehealth

The 10 items in the TeSS are shown in Table 2. Patients and caregivers expressed a high degree of satisfaction with their telehealth preclinic assessment. Average scores ranged from 3.43 (SD=0.52) for the length of time with the RRMC team to 3.72 for the courtesy, respect, sensitivity, and friendliness of the RRMC team. The majority of scores on the scale items averaged higher than 3.5, indicating a rating of “good” to “excellent” satisfaction.

Table 2.

Responses to the 10-Item Telehealth Satisfaction Scale (n=223)

ITEM NUMBER	STATEMENT—HOW SATISFIED WERE YOU WITH:	EXCELLENT	GOOD	POOR/FAIR	MEAN (SD)
1	The voice quality of the equipment	121 (54.3)	92 (41.3)	10 (4.5)	3.50 (0.58)
2	The visual quality of the equipment	135 (60.5)	86 (38.6)	2 (0.6)	3.60 (0.51)
3	Your personal comfort in using the telehealth system	107 (48.0)	108 (48.4)	8 (3.6)	3.44 (0.57)
4	The ease of getting to the telehealth department	109 (48.9)	105 (47.1)	9 (4.0)	3.45 (0.57)
5	The length of time with the Memory Clinic team	98 (43.9)	122 (54.7)	3 (1.3)	3.43 (0.52)
6	The explanation of your treatment by the Memory Clinic team	116 (52.0)	105 (47.1)	2 (0.9)	3.51 (0.52)
7	The thoroughness, carefulness, and skillfulness of the Memory Clinic team	134 (60.1)	87 (39.0)	2 (0.9)	3.59 (0.51)
8	The courtesy, respect, sensitivity, and friendliness of the Memory Clinic team	161 (72.2)	61 (27.4)	1 (0.4)	3.72 (0.46)
9	How well your privacy was respected	150 (67.3)	72 (32.3)	1 (0.4)	3.67 (0.48)
10	How well the staff answered your questions about the equipment	141 (63.2)	80 (35.9)	2 (0.9)	3.62 (0.50)

Data are number (%).

SD, standard deviation.

Factor Analysis

The number of patients in this sample (n=223) is greater than the recommended minimum of 100–200 respondents for principal components analysis.³¹ The Kaiser–Meyer–Olkin measure (0.90) indicated strong relationships between the variables. With data from 223 patients, factor analysis was conducted using the principal components analysis extraction method with varimax rotation on the 10-item TeSS (Table 3). Bartlett's test of sphericity was significant (<0.001), providing support for the use of factor analysis as an appropriate procedure with these data.

Table 3.

Factor Analysis of the 10-Item Telehealth Satisfaction Scale (n=223)

ITEM NUMBER	STATEMENT	FACTOR 1 LOADINGS
9	How well your privacy was respected	0.79
8	The courtesy, respect, sensitivity, and friendliness of the Memory Clinic team	0.78
7	The thoroughness, carefulness, and skillfulness of the Memory Clinic team	0.77
6	The explanation of your treatment by the Memory Clinic team	0.76
10	How well the staff answered your questions about the equipment	0.75
2	The visual quality of the equipment	0.72
5	The length of time with the Memory Clinic team	0.71
1	The voice quality of the equipment	0.70
3	Your personal comfort in using the telehealth system	0.68
4	The ease of getting to the telehealth department	0.54
% variance		52.12
Eigenvalue		2.7
Cronbach's alpha		0.90
Sum mean (range, SD)		35.5 (28–40, 3.75)

Factor analysis was performed using the principal components analysis extraction method and varimax rotation.

SD, standard deviation.

Eigenvalues produced by the factor analysis procedure represent the amount of variance captured by each component or factor. In this study, the eigenvalues provided evidence for a one-factor solution, including the large difference between the eigenvalue for the first factor (5.2) and the second factor (0.92) and the “eigenvalue greater than one” rule for determining the number of factors.³⁰ The scree plot confirmed a sharp drop in eigenvalues for subsequent factors, supporting the one-factor structure. Factor loadings for all items (range, 0.54–0.84) were greater than the recommended cutoff of 0.20–0.35,³¹ indicating that the scale items loaded onto only one factor and that factor structure was strong. The total variance explained by factor 1 was 52.1%. The lowest factor loadings were for items related to the ease of getting to the telehealth department (0.54) and personal comfort using the telehealth system (0.68). Overall, the scale items demonstrated high internal consistency reliability, as indicated by the Cronbach's alpha score of 0.90.

Separate analyses were also conducted with two proposed five-item subscales identified in the scale. The Cronbach's alpha score was 0.78 for the system/technical items (1, 2, 3, 4, and 10) and 0.86 for the patient–provider interaction items (5, 6, 7, 8, and 9), suggesting that these subscales also have acceptable internal consistency, but details of these analyses are not reported because the 10-item scale was shown to be unidimensional.

Discussion

Advancing our knowledge about satisfaction with telehealth services requires standardized measures that have been tested for reliability and validity and that can be applied across fields and assess multiple dimensions of satisfaction.⁸ In this study, the 10-item TeSS demonstrated strong factor structure and excellent internal consistency reliability in a population of rural patients and caregivers accessing services at a memory clinic. The psychometric evaluation provides evidence that the TeSS items are highly correlated and exhibit a unidimensional internal structure. Using attributes of primary healthcare identified by Lévesque et al.,³³ the clustering of all scale items into one factor suggest that the construct of satisfaction with telehealth includes dimensions of interpersonal communication (items 5, 6, and 10), respectfulness (items 8 and 9), whole-person care (item 3), and technical quality of care (items 1, 2, and 7). The factor loading for item 4, regarding ease of getting to the telehealth department (0.54), was lower than for other items but still well above recommended cutoffs.³¹

Compared with earlier studies examining satisfaction with telemedicine in memory clinic settings,^16
–18 this study includes a larger sample size (n=223 versus 11, 15, and 99, respectively) and provides evidence of scale reliability and validity. Results from our previous analyses of telehealth in the RRMC provided additional evidence for the validity of the TeSS.¹⁹ We found that patients who had discontinued follow-up at 6 months had significantly lower TeSS scores than those who continued at 6 months. To further explore predictors of discontinuing follow-up, we conducted a univariate logistic regression analysis of preclinic assessment TeSS scores and other study variables, in which lower satisfaction with telehealth (lower TeSS scores) was a significant predictor of discontinuing, in addition to longer distance to telehealth, older patient age, and lower caregiver burden. These earlier analyses provide support for the discriminant validity of the TeSS and, together with the current results, support the use of the TeSS in future studies of interventions that involve team-based telehealth service delivery similar to the RRMC.

The findings from this study also indicate high satisfaction with telehealth by memory clinic patients and caregivers, providing support for the use of telehealth to increase access to specialized dementia services for those living in rural and remote settings. As reported in our earlier study of satisfaction with telehealth,¹⁹ patients and families reported reduced travel and stress, greater convenience, and the high quality of care provided via telehealth as reasons for their high satisfaction. These identified benefits of telehealth are not surprising given the high level of comorbidity in the current study (71.3% reporting five or more chronic conditions), which may make travel difficult, and the long distances to travel to the tertiary center where the clinic is located (over 260 km one way).

The high satisfaction reported in the current study is consistent with the few existing studies examining satisfaction with telehealth among patients with memory problems. Azad et al.¹⁶ did not report overall satisfaction scores, but 92% of participants were satisfied with the session, and 95% would use videoconferencing again. The informal feedback collected by Barton et al.¹⁷ indicated patient and provider satisfaction with the neurological and cognitive assessment conducted via telehealth. Poon et al.¹⁸ evaluted a 12-session cognitive assessment and intervention program delivered by videoconferencing or face to face. An 11-item user satisfaction scale was administered to the videoconference group (n=11). The items were not described, but the authors reported that 90% were satisfied with the audio and video quality.

Reviews of satisfaction with telehealth have suggested that high satisfaction levels may represent ceiling effects due to self-selection of those with higher satisfaction and instrument design that limits variation, as well as participants' reluctance to criticize a needed service.¹⁰ We have reported previous analyses of satistfaction with telehealth by RRMC patients and caregivers that included continuing patients and those who discontinued.¹⁹ The study identified four predictors of discontinuing follow-up, including low satisfaction with telehealth, indicating there is variation in the satisfaction data and that the scale has predictive value.

There are several limitations to the study. Because patients and families completed the TeSS together following each telehealth appointment, we are not able to assess differences in satisfaction between patients and caregivers. Findings regarding satisfaction with telehealth may not be generalizable to other settings that do not have the same well-managed, coordinated telehealth network as exists in Saskatchewan, where trained professional staff are present to provide support to users. When the RRMC was implemented in 2004, the telehealth equipment was not as user-friendly as is the current technology. We did not expect patients and families to manage the equipment independently, particularly in a memory clinic context, so this type of usability was not evaluated in the TeSS. In a more recent study evaluating a videoconferenced support group for spouses of RRMC patients with atypical and early-onset dementias, participants received training from telehealth support staff and subsequently navigated the equipment without on-site supervision.²¹ The data used for the psychometric analysis reported in this article were from the first telehealth encounter; thus the reported satisfaction could reflect a positive bias due to novelty.¹¹ In earlier research, we have examined satisfaction with telehealth over time and found no difference in satisfaction from preclinic to 6-month follow-up appointments among continuing patients, but low satisfaction was a predictor of discontinuing follow-up when both groups were included.¹⁹

Strengths of the current study include the large sample size relative to much of the existing research assessing the psychometric properties of telehealth satisfaction questionnaires, the relatively homogeneous sample of memory clinic patients, and the long-term nature of the clinic intervention. Many satisfaction studies are conducted in artificial contexts with nonrepresentative patient samples,¹¹ whereas the current study involved remotely delivered telehealth appointments conducted though the provincial telehealth system. The study findings should therefore be more readily translatable to settings where telehealth is used in routine practice.

In conclusion, the psychometric analyses reported in this article provide evidence for the construct validity and internal consistency reliability of the TeSS in a rural memory clinic population. These data demonstrating the psychometric properties of the 10-item TeSS are important and support use of the TeSS as a measure of satisfaction in future telehealth-based clinical research.

Footnotes

Acknowledgments

This work was supported by a Canadian Institutes of Health Research (CIHR) New Emerging Team grant and an Applied Chair in Health Services and Policy Research funded by CIHR and the Saskatchewan Health Research Foundation. In-kind support was provided by the Saskatchewan Telehealth Network.

Disclosure Statement

No competing financial interests exist.

References

Alzheimer Disease International. World Alzheimer Report 2013: Journey of Caring: An Analysis of Long-Term Care for Dementia. 2013. Available at www.alz.co.uk/research/world-report-2013 (last accessed December 2, 2013 ).

World Health Organization. Dementia: A Public Health Priority. 2012. Available at www.who.int/mental_health/publications/dementia_report_2012/en/ (last accessed December 2, 2013 ).

Dudgeon

. Rising Tide: The Impact of Dementia on Canadian Society. 2010. Available at www.alzheimer.ca/∼/media/Files/national/Advocacy/ASC_Rising_Tide_Full_Report_e.ashx (last accessed December 4, 2013 ).

Dandy

, Bollman

. Seniors in rural Canada. Rural and small town Canada analysis bulletin. Ottawa: Statistics Canada, 2008.

Innes

, Morgan

, Kosteniuk

. Informal dementia care in rural and remote settings: A systematic review. Maturitas, 2011; 68:34–46.

Morgan

, Innes

, Kosteniuk

. Dementia care in rural and remote settings: A systematic review of formal or paid care. Maturitas, 2011; 68:17–33.

Auditor General of Scotland. A Review of Telehealth in Scotland. October 2011. Available at www.audit-scotland.gov.uk/docs/health/2011/nr_111013_telehealth.pdf (last accessed December 4, 2013 ).

Whitten

, Love

. Patient and provider satisfaction with the use of telemedicine: Overview and rationale for cautious enthusiasm. J Postgrad Med, 2005; 51:294–300.

Cartwright

. Effect of telehealth on quality of life and psychological outcomes over 12 months. BMJ, 2013; 346:f653.

10.

Williams

, May

, Esmail

. Limitations of patient satisfaction studies in telehealthcare: A systematic review of the literature. Telemed J E Health, 2001; 7:293–316.

11.

Mair

, Whitten

. Systematic review of studies of patient satisfaction with telemedicine. BMJ, 2000; 320:1517–1520.

12.

Bakken

, Grullon-Figueroa

, Izquierdo

, et al. Development, validation, and use of English and Spanish versions of the Telemedicine Satisfaction and Usefulness Questionnaire. J Am Med Inform Assoc, 2006; 13:660–667.

13.

Buysse

, Coorevits

, Van Maele

, et al. Introducing telemonitoring for diabetic patients: Development of a telemonitoring “Health Effect and Readiness” questionnaire. Int J Med Inform, 2010; 79:576–584.

14.

Yip

, Chang

, Chan

, MacKenzie

. Development of the telemedicine satisfaction questionnaire to evaluate patient satisfaction with telemedicine: A preliminary study. J Telemed Telecare, 2003; 9:46–50.

15.

Agha

, Schapira

, Laud

, et al. Patient satisfaction with physician-patient communication during telemedicine. Telemed J E Health, 2009; 15:830–839.

16.

Azad

, Amos

, Milne

, Power

. Telemedicine in a rural memory disorder clinic: Remote management of patients with dementia. Can Geriatr J, 2012; 15:96–100.

17.

Barton

, Morris

, Rothlind

, Yaffe

. Video-telemedicine in a memory disorders clinic: Evaluation and management of rural elders with cognitive impairment. Telemed J E Health, 2011; 17:789–793.

18.

Poon

, Hui

, Dai

, et al. Cognitive intervention for community-dwelling older persons with memory problems: Telemedicine versus face-to-face treatment. Int J Geriatr Psychiatry, 2005; 20:285–286.

19.

Morgan

, Crossley

, Kirk

, et al. Evaluation of telehealth for pre-clinic assessment and follow-up in an interprofessional rural and remote memory clinic. J Appl Gerontol, 2011; 30:304–331.

20.

McEachern

, Kirk

, Morgan

, et al. Reliability of the MMSE administered in-person and by telehealth. Can J Neurol Sci, 2008; 35:643–646.

21.

O'Connell

, Crossley

, Cammer

, et al. Development and evaluation of a telehealth video conferenced support group for rural spouses of persons diagnosed with atypical early-onset dementias. Dementia (London), 2014; 13:382–395.

22.

Morgan

, Crossley

, Kirk

, et al. Improving access to dementia care: Development and evaluation of a Rural and Remote Memory Clinic. Aging Ment Health, 2009; 13:17–30.

23.

Crossley

, Morgan

, Lanting

, et al. Interdisciplinary research and interprofessional collaborative care in a memory clinic for rural and northern residents of Western Canada: A unique training ground for clinical psychology graduate students. Austr Psychol, 2008; 43:231–238.

24.

Government of Saskatchewan. Saskatchewan Fact Sheet July 2012. 2012. Available at http://tinyurl.com/m3pfaho (last accessed December 1, 2013 ).

25.

Elliot

. The age distribution of the Saskatchewan population. Sask Trends Monitor, 2012; 24:2–10.

26.

Shadish

, Cook

, Campbell

. Experiemental and quasi-experimental design for generalized causal inference. Belmont, CA: Wadsworth Cengage Learning, 2002.

27.

Health Canada. Community services in the 21 st century: First Nations and Inuit telehealth services. Final Report National First Nations Telehealth Research Project HTF-NA402, 1998–2001. Ottawa: Publications, Health Canada, 2001.

28.

Miller

, Levesque

. Telehealth provides effective pediatric surgery care to remote locations. J Pediatr Surg, 2002; 37:752–754.

29.

Linassi

, Shan

. User satisfaction with a telemedicine amputee clinic in Saskatchewan. J Telemed Telecare, 2005; 11:414–418.

30.

Furr

, Bacharach

, eds. Psychometrics: An introduction. Thousand Oaks, CA: Sage Publications, 2008.

31.

Kellar

, Kelvin

, eds. Munro's statistical methods for health care research, 6th ed. Philadelphia: Wolters Kluwer–Lippincott Williams & Wilkins, 2013.

32.

Waltz

, Stickland

, Lenz

. Measurement in nursing research, 2nd ed. Philadelphia: F.A. Davis, 1991.

33.

Lévesque

, Haggerty

, Burge

, et al. Canadian experts' views on the importance of attributes within professional and community-oriented primary healthcare models. Healthc Policy, 2011; 7:21–30.

34.

Statistics Canada. Census Dictionary: Census year 2011. 2012. Catalogue no. 98-301-X2011001, ISBN 978-1-100-19623-7. Available at www12.statcan.ca/census-recensement/2011/ref/dict/98-301-X2011001-eng.pdf (last accessed September 16, 2014 ).