Are Reliability,Reproducibility and Validity the Correct Terms to Assess the Correctness of Dietary Studies?

Abstract

Nutritional studies often use the terms reliability, reproducibility and validity to indicate the correctness of the study. These terms do not appear to have a universal meaning to all researchers. The components of a dietary study are the input, the data collection instrument and the compiled data. Frequently the data collection questionnaire/tool/instrument is tested for reliability, reproducibility or validity.

The data collection questionnaire/tool/instrument is simply a structure, a vehicle for gathering data. An argument is presented that demonstrates the reasons that such a structure cannot be tested for reliability, reproducibility or validity. The logical approach to the use of the terms reliability, reproducibility and validity is presented. Reliability refers to the input component of the study, reproducibility may or may not lead to strengthening the study and validity refers to the truthfulness of the database generated. Validity must be derived from reliable and reproducible data.

Get full access to this article

View all access options for this article.

References

American Psychological Association, Committee to Develop Standards (1985). Standards for educational and psychological testing, Washington, D.C.: Author.

Angbratt

Moller

(1999). Questionnaire about calcium intake: can we trust the answers? Osteoporosis International, 9(3), 220–225.

Beaton

G.H

(1994). Approaches to analysis of dietary data: Relationship between planned analysis and choice of methodology. American Journal of Clinical Nutrition, 59 (suppl.), 253S–261.

Field

A.E.

Peterson

K.E.

Gortmaker

S.L.

Chung

Rockett

Fox

M. K.

Colditz

G.A.

(1999). Reproducibility and validity of a food frequency questionnaire among fourth to seventh grader inner-city school children: implications of age and day-to-day variation in dietary intake. Public Health Nutrition, 2(3), 293–300.

Food Market Commentary (1991). Agriculture Canada, 13, 1.

Hankin

J.H.

(1992). Dietary intake methodology. In Research: successful approaches ( Monsen

E.R.

, ed.), pp. 173–194. Chicago: The American Dietetic Association.

Joachim

(1997). Supply and demand a framework for explaining variability in dietary intake and its impact in data. Nutrition and Health, 11, 289–299.

Joachim

(1998). Sources of variability in the reproducibility of food frequency questionnaires. Nutrition and Health, 12, 181–188.

Joachim

(1999). The relationship between habits of food consumption and reported reactions to food in people with inflammatory bowel disease- testing the limits. Nutrition and Health, 13, 69–83.

10.

Kohls

R.L.

Uhl

J.N.

(1990). Marketing Agricultural Products, 7th ed. Macmillan Publishing: New York.

11.

Liebman

(1992). The changing American diet. In Nutrition 92/93 ( Cook Fuller

C.C.

, ed.). 5th ed. Dushkin Publishing Group: Guilford, Cn.

12.

Loether

H.J.

McTavish

D.G.

(1993). Descriptive and Inferential Statistics. 4th ed. Allyn and Bacon: Toronto.

13.

Metcalf

Swinburn

Scragg

Dryson

(1997). Reproducibility and validity of a food frequency questionnaire in European and Polynesian New Zealanders. Ethnicity and Health, 2(4), 297–308.

14.

Subar

A.F.

Frey

C.M.

Harlan

L.C.

Kahle

(1994). Differences in reported food frequency by season of the questionnaire administration. The 1987 national health interview survey. Epidemiology, 2, 226–233.

15.

Swan

P.D.

Spitler

D.L.

Whiddon

Evans

B.W.

Wells

M.F.

(1997). Assessment of lifetime patterns of dairy food intake and physical activity. Nutrition and Health, 11(4), 255–270.

16.

Takatsuka

Kurisu

Nagata

Owaki

Kawakami

Shimizu

(1997). Validation of a simplified diet history. Journal of Epidemiology, 7(1), 33–41.

17.

Talbot

L.A.

(1995). Principles and Practice of Nursing Research. Mosby: St. Louis.

18.

Tarasuk

Beaton

G.H.

(1991). The nature and individuality of within subject variation in energy intake. American Journal of Clinical Nutrition, 54, 464–470.

19.

Tarasuk

Beaton

G.H.

(1992). Day to day variation in energy and nutrient intake: evidence of individuality in eating behavior? Appetite, 18, 43–54.

20.

Willett

W.C.

(1990). Nature of variation in diet. In Nutritional Epidemiology Monographs in Epidemiology and Biostatistics ( MacMahon

, ed.) pp. 34–51. Oxford University Press: London.

21.

Willett

W.C.

(1998). Reproducibility and validity of food-frequency questionnaires. In Nutritional Epidemiology Monographs in Epidemiology and Biostatistics. 2nd ed. ( Kelsey

Marmot

Stolley

Vessey

, eds.) pp 101–147. Oxford University Press: London.

22.

Woods

N.F.

Catanzaro

(1988). Nursing Research Theory and Practice. Mosby: St. Louis.