Ratings of the Effectiveness of Warnings on Consumer Paint Stripper Products

Abstract

Accidental inhalation of vapors from paint stripper products containing methylene chloride has resulted in injuries and deaths. Warnings on paint stripper products may play a role in reducing the number and severity of injuries resulting from using them. Warning labels consistent with Federal Hazardous Substances Act (FHSA) and American National Standards Institute (ANSI) Z535.4 formatting were evaluated by 159 university students and by 173 Amazon Mechanical Turk (MTurk) workers. Results indicated that both groups rated the ANSI-formatted warnings as more effective (more likely to be noticed, read, understood, and followed) than the FHSA-formatted warnings, providing support for both use of crowdsourcing as a reliable and valid source for study participants to evaluate warnings, as well as for updating FHSA labeling requirements to include evidence-based guidelines on warning effectiveness. Implications for future research are discussed.

References

Adams

Bochner

Bilik

(1998). The effectiveness of warning signs in hazardous work places: Cognitive and social determinants. Applied Ergonomics, 29, 247–254.

Adams

A.S.

Edworthy

(1995). Quantifying and predicting the effects of basic text display variables on the perceived urgency of warning labels: Tradeoffs involving font size, border weight and colour. Ergonomics, 38, 2221-2237.

ANSI Z535.4 (2011), American National Standard for Product Safety Signs and Labels. New York: American National Standards Institute.

ANSI Z400.1/Z129.1 (2010). The American National Standard for Hazardous Workplace Chemicals–Hazard Evaluation and Safety Data Sheet and Precautionary Labeling Preparation. New York: American National Standards Institute.

Braun

C. C.

Sansing

Kennedy

R. S.

Silver

N. C.

(1994). Signal word and color specifications for product warnings: An isoperformance application. Proceedings of the Human Factors and Ergonomics Society, 38, 1104–1108.

Braun

C.C.

Silver

N.C.

(1995). Interaction of signal word and colour on warning labels: Differences in perceived hazard and behavioural compliance. Ergonomics, 38(11), 2207-2220.

CPSC (2012). Code of Federal Regulations, Title 16, Chapter II, Subchapter C Federal Hazardous Substance Act Regulations, Part 1500: Hazardous Substances and Articles; Administration and Enforcement Regulations.

California Department of Health Services (2006). Methylene Chloride Fact Sheet. Richmond, CA: Author. Retrieved from https://www.cdph.ca.gov/programs/hesis/Documents/methylenechloride.pdf.

Chapanis

(1994). Hazards associated with three signal words and four colours on warning signs. Ergonomics, 37, 265–275.

10.

Chester

Rosenman

K.D.

Grimes

G.R.

Fagan

Castillo

D.N.

(2012). Fatal exposure to methylene chloride among bathtub refinishers — United States, 2000–2011. Morbidity and Mortality Weekly Report (MMWR), 61(7), 119-122.

11.

Chien

Lewis

Hergeth

Semnani-Azad

Sycara

(2015). Cross-country validation of a cultural scale in measuring trust in automation. Proceedings of the Human Factors and Ergonomics Society, 59, 686-690.

12.

Crump

M.J.C.

McDonnell

J.V.

Gureckis

T.M.

(2013). Evaluating Amazon’s Mechanical Turk as a tool for experimental behavioral research. PLoS ONE 8(3): e57410. doi:10.1371/journal.pone.0057410.

13.

DeJoy

D.M.

(1989). Consumer product warnings: Review and analysis of effectiveness research. Proceedings of the Human Factors and Ergonomics Society, 33, 936-940.

14.

Desaulniers

D.R.

(1987). Layout, organization, and the effectiveness of consumer product warnings. Proceedings of the Human Factors and Ergonomics Society, 31, 56-60.

15.

FHSA (2011). Federal Hazardous Substances Act. Pub. L. 86–613, 74 Stat. 372–81 (15 U.S.C. 1261–74).

16.

Frantz

J.P.

(1993). Effect of location and presentation format on attention to and compliance with product warnings and instructions. Journal of Safety Research, 24, 131–154.

17.

Frantz

J.P.

Young

S.L.

Rhoades

T.P.

Wisniewski

E.C.

(2005). Predicted versus actual response to warning signs and labels: Examining the role of ANSI Z535 features. Proceedings of the Human Factors and Ergonomics Society, 49, 1785-1789.

18.

Godfrey

S.S.

Laughery

K.R.

Young

S.L.

Vaubel

K.P.

Brelsford

J.W.

Laughery

K.A.

Horn

(1991). The new alcohol warning labels: How noticeable are they? Proceedings of the Human Factors and Ergonomics Society, 35, 446-450.

19.

Germine

Nakayama

Duchaine

B.C.

Chabris

C.F.

Chatterjee

Wilmer

J.B.

(2012). Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin Rev., 19(5), 847-857.

20.

Gosling

Vazire

Srivastava

John

(2004). Should we trust Web-based studies? A comparative analysis of six preconceptions about Internet questionnaires. American Psychologist, 59, 93–104.

21.

Heer

Bostock

(2010). Crowdsourcing graphical perception: Using Mechanical Turk to assess visualization design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 203–212). New York, NY: Association for Computing Machinery.

22.

Hopkins

J.S.

(2015). Breathing death: This chemical is found in most hardware stores and kills suddenly. Why has the EPA done nothing? Slate.com, Sept. 21. Retrieved from http://www.slate.com/articles/news_and_politics/politics/2015/09/methylene_chloride_is_a_deadly_chemical_found_in_paint_thinners_why_has.html.

23.

Jaynes

L. S.

Boles

D. B.

(1990). The effect of symbols on warning compliance. Proceedings of the Human Factors and Ergonomics Society, 34, 984–987.

24.

Kalsher

M.J.

Williams

K.J.

(2006). Behavioral compliance: Theory, methodology, and results. In Wogalter

M.S.

(Ed.), Handbook of Warnings (pp. 313-331). Mahwah, N.J.: LEA

25.

Kelley

C.M.

McLaughlin

A.C.

(2012). Differences in feedback use for correct and incorrect responses. Proceedings of the Human Factors and Ergonomics Society, 56, 2427-2431.

26.

Kim

M.S.

Hunter

J.E.

(1993). Relationships among attitudes, behavioral intentions, and behavior: A meta-analysis of past research: II. Communication Research, 20, 331-364.

27.

Kittur

Chi

E. H.

Suh

(2008). Crowdsourcing user studies with Mechanical Turk. In CHI ’08 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 453-456. New York: ACM.

28.

Krantz

J.H.

Dalal

(2000). Validity of Web-based psychological research. In Birnbaum

M.H.

(Ed.), Psychological Experiments on the Internet (pp. 35-60). Orlando, FL: Academic Press.

29.

Kraut

Olson

Banaji

Bruckman

Cohen

Couper

(2004). Psychological research online: Report of Board of Scientific Affairs’ Advisory Group on the Conduct of Research on the Internet. American Psychologist, 59, 105–117.

30.

Laughery

K.R.

Paige

D.L.

Laughery

B.R.

Wogalter

M.S.

Kalsher

M.J.

Leonard

S.D.

(2002). Guidelines for warnings design: Do they matter? Proceedings of the Human Factors and Ergonomics Society, 46, 1708-1712.

31.

Laughery

K. R.

Sr. Stanush

J. A.

(1989). Effects of warning explicitness on product perceptions. Proceedings of the Human Factors and Ergonomics Society, 33, 431–435.

32.

Laughery

K. R.

Sr. Vaubel

K. P.

Young

S. L.

Brelsford

J. W.

Jr. Rowe

A. L.

(1993). Explicitness of consequence information in warnings. Safety Science, 16, 597–613.

33.

Lee

M.P

Carswell

C.M.

Seidelman

Sublette

(2014). HF/E issues with environmental control in a new energy-efficient building. Ergonomics in Design, 22(4), 8-14.

34.

Mason

Suri

(2012). Conducting behavioral research on Amazon’s Mechanical Turk. Behavior Research Methods, 44(1), 1-23.

35.

Morrow

D.G.

Leirer

V.O.

Andrassy

J.M.

Hier

C.M.

Menard

W.E.

(1998). The influence of list format and category headers on age differences in understanding medication instructions. Experimental Aging Research, 24, 231-256.

36.

Nemire

Vigilante

W.J.

Jr. (2015). A call for updating the FHSA regulations with warnings research and to match ANSI Z535.4. Proceedings of the Human Factors and Ergonomics Society, 59, 1471-1475.

37.

Otsubo

S. M.

(1988). A behavioral study of warning labels for consumer products: Perceived danger and use of pictographs. Proceedings of the Human Factors and Ergonomics Society, 32, 536–540.

38.

Pollack-Nelson

(1995). Analysis of methylene chloride product labeling. Ergonomics, 38(11), 2176-2187.

39.

Riley

D.M.

Fischhoff

(2000). An integrative approach for label evaluation and design. In Proceedings of the IEA 2000/HFES 2000 Congress (4-778 - 4-781). Santa Monica, CA: Human Factors and Ergonomics Society.

40.

Rogers

W. A.

Lamson

Rousseau

G. K.

(2000). Warning research: An integrative perspective. Human Factors, 42, 102-139.

41.

Silver

N.C.

Braun

C.C.

(1999). Behavior. In Wogalter

M.S.

DeJoy

D.M.

Laughery

K.R.

(Eds.), Warnings and Risk Communication (pp. 245-262). London: Taylor & Francis.

42.

Smith-Jackson

T.L.

(2006a). Receiver characteristics. In Wogalter

M.S.

(Ed.), Handbook of Warnings (pp. 335-344). Mahwah, N.J.: LEA.

43.

Smith-Jackson

T.L.

(2006b). Culture and warnings. In Wogalter

M.S.

(Ed.), Handbook of Warnings (pp. 363-371). Mahwah, N.J.: LEA.

44.

Sublette

M. A.

Carswell

C. M.

Seidelman

(2012). A first look at identifying strategies people use in making predictions about task demand. Proceedings of the Human Factors and Ergonomics Society, 56, 1867–1871.

45.

Weber

S. J.

Cook

T. D.

(1972). Subject effects in laboratory research: An examination of subject roles, demand characteristics, and valid inference. Psychological Bulletin, 77(4), 273-295.

46.

Wogalter

M.S.

Begley

P.B.

Scancorelli

L.F.

Brelsford

J.W.

(1997). Effectiveness of elevator service signs: Measurement of perceived understandability, willingness to comply, and behaviour. Applied Ergonomics, 28, 181-187.

47.

Wogalter

M.S.

Conzola

V.C.

Smith-Jackson

T.L.

(2002). Research- based guidelines for warning design and evaluation. Applied Ergonomics 33, 219–230.

48.

Wogalter

M.S.

Godfrey

S.S.

Fontenelle

G.A.

Desaulniers

D.R.

Rothstein

P.R.

Laughery

K.R.

Sr. (1987). Effectiveness of warnings. Human Factors, 29, 599–612.

49.

Wogalter

M.S.

Kalsher

M.J.

Racicot

B.M.

(1992). The influence of location and pictorials on behavior compliance to warnings. Proceedings of the Human Factors and Ergonomics Society, 36, 1029–1033.

50.

Wogalter

M.S.

Rashid

(1998). A border surrounding warning sign text affects looking behavior: A field observational study. Proceedings of the Human Factors and Ergonomics Society, 42, 1628.

51.

Young

(1991). Increasing the noticeability of warnings: Effects of pictorial, color, signal icon and border. Proceedings of the Human Factors and Ergonomics Society, 35, 580-584.