Measuring Numeracy without a Math Test: Development of the Subjective Numeracy Scale

Abstract

Background. Basic numeracy skills are necessary before patients can understand the risks of medical treatments. Previous research has used objective measures, similar to mathematics tests, to evaluate numeracy. Objectives. To design a subjective measure (i.e., self-assessment) of quantitative ability that distinguishes low- and high-numerate individuals yet is less aversive, quicker to administer, and more useable for telephone and Internet surveys than existing numeracy measures. Research Design. Paper-and-pencil questionnaires. Subjects. The general public (N = 703) surveyed at 2 hospitals. Measures. Forty-nine subjective numeracy questions were compared to measures of objective numeracy. Results. An 8-item measure, the Subjective Numeracy Scale (SNS), was developed through several rounds of testing. Four items measure people's beliefs about their skill in performing various mathematical operations, and 4 measure people's preferences regarding the presentation of numerical information. The SNS was significantly correlated with Lipkus and others' objective numeracy scale (correlations: 0.63—0.68) yet was completed in less time (24 s/item v. 31 s/item, P < 0.05) and was perceived as less stressful (1.62 v. 2.69, P < 0.01) and less frustrating (1.92 v. 2.88, P < 0.01). Fifty percent of participants who completed the SNS volunteered to participate in another study, whereas only 8% of those who completed the Lipkus and others scale similarly volunteered (odds ratio = 11.00, 95% confidence interval = 2.14—56.65). Conclusions. The SNS correlates well with mathematical test measures of objective numeracy but can be administered in less time and with less burden. In addition, it is much more likely to leave participants willing to participate in additional research and shows much lower rates of missing or incomplete data.

Keywords

numeracy risk communication decision making literacy measurement. (Med Decis Making 2007 27:672—680)

Get full access to this article

View all access options for this article.

References

Kirsch IS , Jungeblut A. , Jenkins L. , Kolstad A. Adult literacy in America: a first look at the results of the National Adult Literacy Survey (NCES 93275). Washington, DC: US Department of Education; 1993.

Baker DW , Parker RM , Williams MV , Clark WS Health literacy and the risk of hospital admission. J Gen Intern Med. 1998; 13(12):791—8.

Baker DW , Parker RM , Williams MV , Clark WS , Nurss J. The relationship of patient reading ability to self-reported health and use of health services. Am J Public Health. 1997 ;87(6):1027—30.

Baker DW , Gazmararian JA , Williams MV , et al. Health literacy and use of outpatient physician services by Medicare managed care enrollees. J Gen Intern Med. 2004;19(3):215—20.

Baker DW , Gazmararian JA , Williams MV , et al. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health. 2002;92(8):1278—83.

Schwartz LM , Woloshin S. , Black WC , Welch HG The role of numeracy in understanding the benefit of screening mammography . Ann Intern Med. 1997;127(11):966—72.

Woloshin S. , Schwartz LM , Moncur M. , Gabriel S. , Tosteson AN Assessing values for health: numeracy matters. Med Decis Making. 2001;21(5):382—90.

Woloshin S. , Schwartz LM , Byram S. , Fischhoff B. , Welch HG A new scale for assessing perceptions of chance: a validation study. Med Decis Making. 2000;20(3):298—307.

Black WC , Nease RF , Tosteson A. Perceptions of risk and screening effectiveness in women younger than 50 years of age. J Natl Cancer Inst. 1995;87(10):720—731.

10.

Schapira MM , Davids SL , McAuliffe TL , Nattinger AB Agreement between scales in the measurement of breast cancer risk perceptions. Risk Anal. 2004;24(3):665—73.

11.

Lipkus IM , Samsa G. , Rimer BK General performance on a numeracy scale among highly educated samples. Med Decis Making. 2001;21(1):37—44.

12.

Baker DW , Williams MV , Parker RM , Gazmararian JA , Nurss J. Development of a brief test to measure functional health literacy. Patient Educ Couns. 1999;38(1):33—42.

13.

Parker RM , Baker DW , Williams MV , Nurss J. The test of functional health literacy in adults: a new instrument for measuring patients' literacy skills. J Gen Intern Med. 1995;10(10):537—41.

14.

Williams MV , Baker DW , Parker RM , Nurss JR Relationship of functional health literacy to patients' knowledge of their chronic disease: a study of patients with hypertension and diabetes. Arch Intern Med. 1998;158(2):166—72.

15.

Gazmararian JA , Williams MV , Peel J. , Baker DW Health literacy and knowledge of chronic disease . Patient Educ Couns. 2003;51(3):267—75.

16.

Scott TL , Gazmararian JA , Williams MV , Baker DW Health literacy and preventive health care use among Medicare enrollees in a managed care organization. Med Care. 2002 ;40(5):395—404.

17.

SAS Statistical Software, Inc. [computer program]. Version 8.0. Cary, NC: SAS Institute ; 2000.

18.

Pedhazur EJ Multiple Regression in Behavioral Research. 3rd ed. Orlando, FL: Harcourt Brace; 1997.

19.

Zikmund-Fisher BJ , Smith DM , Ubel PA , Fagerlin A. Validation of the Subjective Numeracy Scale (SNS): effects of low numeracy on comprehension of risk communications and utility elicitations. Med Decis Making. 2007 ;27:663—71.