Comparison of Mail and Telephone in Assessing Patient Experiences in Receiving Care from Medical Group Practices

Abstract

The medical group survey from the CAHPS® (formerly Consumer Assessment of Health Plans Study) project, G-CAHPS, focuses on patient experiences in receiving care from their medical group practice. We compared mail and telephone responses to the GCAHPS survey in a sample of 880 patients fromfour physician groups. Patients were randomly assigned to mode. Analyses included comparison of response rates, missing data, internal consistency reliability of six multiitem scales, and mean scores. A total of 537 phone completes and 343 mail completes were obtained (54% response rate). There were no significant differences in internal consistency by mode. In addition, there was only one significant mode difference in item and composite means by mode of administration after adjusting for case-mix differences. This study indicates that mail and telephone modes of data collection for the G-CAHPS survey produce similar results.

Keywords

mode effects CAHPS mail administration telephone administration

Get full access to this article

View all access options for this article.

References

Burroughs, T. E. , Waterman, B. M. , Cira, J. C. , Desikan, R. , & Dunagan, W. C. (2001). Patient satisfaction measurement strategies: A comparison of phone and mail methods. Journal on Quality Improvement, 27(7), 349-361.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences(2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

Dillman, D. A. (2000). Mail and Internet surveys(2nd ed.). New York: John Wiley.

Feldt, L. S. , Woodruff, K. J. , & Salih, F. A. (1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11, 93-103.

Fowler, F. J. , Gallagher, P. M. ,& Nederend, S. (1999). Comparing telephone and mail responses to the CAHPS survey instrument. Medical Care, 37(3), MS41-MS49.

Fowler, J. F. , Gallagher, P. M. , Stringfellow, V. L. , Zaslavsky, A. M. , Thompson, J. W. ,& Cleary, P. D. (2002). Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Medical Care, 40(3), 190-200.

Fowler, F. J. , Roman, A. M. , & Di, Z. X. (1998). Mode effects in a survey of Medicare prostate surgery patients. Public Opinion Quarterly, 62(1), 29-46.

Harris, L. E. , Weinberger, M. , & Tierney, W. M. (1997). Assessing inner-city patients' hospital experiences: Acontrolled trial of telephone interviews versus mailed surveys. Medical Care, 1, 70-76.

Hays, R. D. , & Ware, J. E. (1986). My medical care is better than yours. Medical Care, 24(6), 519-524.

10.

Hochberg, Y. (1998). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802.

11.

McHorney, C. A. , Kosinski, M. , & Ware, J. E. (1994). Comparisons of the costs and quality of norms for the SF-36 Health Survey collected by mail versus telephone interview: Results from a national study. Medical Care, 32(6), 551-567.

12.

Perkins, J. J. , & Sanson-Fisher, R. W. (1998). An examination of self-and telephoneadministered modes of administration for the Australian SF-36. Journal of Clinical Epidemiology, 51(11), 969-973.

13.

Solomon, L. , Hays, R. D. , Zaslavsky, A. , & Cleary, P. D. (2005). Psychometric properties of the Group-Level Consumer Assessment of Health Plans Study (G-CAHPS) instrument. Medical Care, 43(1), 53-60.

14.

Turner, C. F. , Lessler, J. T. , & Devore, J. (1992). Effects of mode of administration and wording on reporting of drug use. In C. F. Turner , J. T. Lessler ,& J. C. Gfoerer (Eds.), Survey measurement of drug use: Methodological studies(pp. 177-220). Washington, DC: Government Printing Office.

15.

Walker, A. H. & Restuccia, J. D. (1984). Obtaining information on patient satisfaction with hospital care: Mail versus telephone. Health Services Research, 19(3), 291-306.

16.

Weidmer, B. , Brown, J. ,& Garcia, L. (1999). Translating theCAHPS1.0 survey instruments into Spanish. Medical Care, 37(3), MS89-MS96.