Natural Frequencies Do Not Foster Public Understanding of Medical Test Results

Abstract

Major organizations recommend presenting medical test results in terms of natural frequencies, rather than single-event probabilities. The evidence, however, is that natural frequency presentations benefit at most one-fifth of samples of health service users and patients. Only one study reported a substantial benefit of these presentations. Here, we replicate that study, testing online survey respondents. Study 1 attributed the previously reported benefit of natural frequencies to a scoring artifact. Study 2 showed that natural frequencies may elicit evaluations that conflict with the normatively correct one, potentially hindering informed decision making. Ironically, these evaluations occurred less often when respondents reasoned about single-event probabilities. These results suggest caution in promoting natural frequencies as the best way to communicate medical test data to health service users and patients.

Keywords

natural frequencies single-event probability test result understanding diagnostic reasoning,numeracy

Get full access to this article

View all access options for this article.

References

Casscells

Schoenberger

Graboys

Interpretation by physicians of clinical laboratory results. N Engl J Med. 1978;299:999–1000.

Eddy

DM.

Probabilistic reasoning in clinical medicine: problems and opportunities. In: Kahneman

Slovic

Tversky

eds. Judgment under Uncertainty: Heuristics and Biases. New York: Cambridge University Press. 1998. p 249–67.

Gigerenzer

Hoffrage

How to improve Bayesian reasoning without instruction: frequency formats. Psychol Rev. 1995;102:684–704.

Akl

Oxman

Herrin

. Using alternative statistical formats for presenting risks and risk reductions. Cochrane Database Syst Rev. 2011;(4):CD006776.

Elwyn

O’Connor

Stacey

. International patient decision aids standards (IPDAS) collaboration. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333:417.

Hoffrage

Gigerenzer

Using natural frequencies to improve diagnostic inferences. Acad Med. 1998;73:538–40.

Girotto

Gonzalez

Solving probabilistic and statistical problems: a matter of information structure and question form. Cognition. 2001;78:247–76.

Bramwell

West

Salmon

Health professionals’ and service users’ interpretation of screening test results: experimental study. BMJ. 2006;333:284–6.

Garcia-Retamero

Hoffrage

Visual representation of statistical information improves diagnostic inferences in doctors and their patients. Soc Sci Med. 2013;83:27–33.

10.

Galesic

Gigerenzer

Straubinger

Natural frequencies help older adult and people with low numeracy to evaluate medical screening tests. Med Decis Making. 2009;29:368–71.

11.

Pighin

Gonzalez

Savadori

Girotto

Improving public interpretation of probabilistic test results: distributive evaluations. Med Decis Making. 2015;35:12–15.

12.

Paolacci

Chandler

Ipeirotis

PG.

Running experiments on Amazon Mechanical Turk. Judgm Decis Making. 2010;5:411–19.

13.

Lipkus

Samsa

Rimer

BK.

General performance on a numeracy scale among highly educated samples. Med Decis Making. 2001;21:37–44.

14.

Hahnemann

Vejerslev

LO.

Accuracy of cytogenetic findings of chorionic villus sampling (CVS)—diagnostic consequences of CVS mosaicism and non-mosaic discrepancy in centres contributing to Eucromic* 1986–1992. Prenat Diagn. 1997;17:801–20.

15.

Cooper

Farid

Does the Sun revolve around the Earth? A comparison between the general public and online survey respondents in basic scientific knowledge. Public Underst Sci. 2014 Oct 16 (Epub ahead of print; DOI: 10.1177/0963662514554354).

16.

Woloshin

Schwartz

LM.

Communicating data about the benefits and harms of treatment: a randomized trial. Ann Intern Med. 2011;155:87–97.

17.

Gigerenzer

What are natural frequencies?

BMJ. 2011;343:d6386.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.07 MB