Negative or positive left or right? The influence of attribute label position on IAT effects in picture-word IATs and word IATs

Abstract

The Implicit Association Test (IAT) is a widely used measure of implicit attitudes. Despite its application in various fields, the malleability of the IAT by different methodological factors has been shown frequently. In this article, we focus on two factors that potentially influence the IAT effect, but which have received either inconsistent or no support so far: the IAT version (i.e., picture-word IAT vs. word IAT) and the position of the attribute labels on the screen (i.e., the positive or negative label on the left side). In two experiments, we used the original flower-insect IAT to systematically analyse the effects of the position of attribute labels (i.e., the assignment of the positive or the negative attribute label to the left screen position) and the block order of compatible (e.g., flower and positive) and incompatible blocks (e.g., flower and negative) as between-subjects factors. Reliable IAT effects were observed for the picture-word IAT and the word IAT when calculating the IAT effect as a difference in the response times as well as when computing the recommended D Score as IAT outcome. Smaller IAT effects occurred in the picture-word IAT than in the word IAT, supporting existing literature. In addition, an effect of the position of the attribute labels on the screen was found in both experiments, resulting in larger IAT effects when the negative attribute label was positioned on the left. This effect also appeared when calculating the D Score. The study highlights the importance of methodical factors for the IAT outcome.

Keywords

Implicit Association Test IAT effect picture-word IAT stimulus material IAT version

Get full access to this article

View all access options for this article.

References

Andrews

J. A.

Hampson

S. E.

Greenwald

A. G.

Gordon

Widdop

(2010). Using the Implicit Association Test to assess children’s implicit attitudes toward smoking. Journal of Applied Social Psychology, 40(9), 2387–2406. https://doi.org/10.1111/j.1559-1816.2010.00663.x

Back

M. D.

Schmukle

S. C.

Egloff

(2009). Predicting actual behavior from the explicit and implicit self-concept of personality. Journal of Personality and Social Psychology, 97(3), 533–548. https://doi.org/10.1037/a0016229

Binnekamp

(2019). Picture this: Comparing a picture-only and word-picture race bias IAT [Master thesis]. https://hdl.handle.net/1887/77691

Bluemke

Fiedler

(2009). Base rate effects on the IAT. Consciousness and Cognition, 18(4), 1029–1038. https://doi.org/10.1016/j.concog.2009.07.010

Bluemke

Friese

(2006). Do features of stimuli influence IAT effects? Journal of Experimental Social Psychology, 42(2), 163–176. https://doi.org/10.1016/j.jesp.2005.03.004

Calanchini

Sherman

J. W.

Klauer

K. C.

Lai

C. K.

(2014). Attitudinal and non-attitudinal components of IAT performance. Personality and Social Psychology Bulletin, 40(10), 1285–1296. https://doi.org/10.1177/0146167214540723

Casasanto

(2009). Embodiment of abstract concepts: Good and bad in right- and left-handers. Journal of Experimental Psychology-General, 138(3), 351–367. https://doi.org/10.1037/a0015854

Chang

B. P. I.

Mitchell

C. J.

(2011). Discriminating between the effects of valence and salience in the Implicit Association Test. Quarterly Journal of Experimental Psychology, 64(11), 2251–2275. https://doi.org/10.1080/17470218.2011.586782

Cipora

Patro

Nuerk

H.-C.

(2018). Spatial influences on spatial-numerical associations. In Hubbard

(Ed.), Spatial biases in perception and cognition (pp. 41–59). Cambridge University Press.

10.

Dasgupta

McGhee

D. E.

Greenwald

A. G.

Banaji

M. R.

(2000). Automatic preference for white Americans: Eliminating the familiarity explanation. Journal of Experimental Social Psychology, 36(3), 316–328. https://doi.org/10.1006/jesp.1999.1418

11.

Degner

Wentura

Gniewosz

Noack

(2007). Hostility-related prejudice against Turks in adolescents: Masked affective priming allows for a differentiation of automatic prejudice. Basic and Applied Social Psychology, 29(3), 245–256.

12.

Dehaene

Bossini

Giraux

(1993). The Mental Representation of Parity and Number Magnitude. Journal of Experimental Psychology-General, 122(3), 371–396. https://doi.org/Doi 10.1037/0096-3445.122.3.371

13.

De Houwer

. (2001). A structural and process analysis of the Implicit Association Test. Journal of Experimental Social Psychology, 37(6), 443–451. https://doi.org/10.1006/jesp.2000.1464

14.

De Houwer

. (2003). The extrinsic affective Simon task. Experimental Psychology, 50(2), 77–85. https://doi.org/10.1026//1618-3169.50.2.77

15.

De Houwer

Hermans

. (1994). Differences in the affective processing of words and pictures. Cognition & Emotion, 8(1), 1–20. https://doi.org/10.1080/02699939408408925

16.

De Houwer

Hermans

Eelen

. (1998). Affective Simon effects using facial expressions as affective stimuli. Zeitschrift Für Experimentelle Psychologie, 45(2), 88–98. http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=9677856

17.

Eder

A. B.

Rothermund

De Houwer

(2013). Affective compatibility between stimuli and response goals: A primer for a new implicit measure of attitudes. PLOS ONE, 8(11), Article e79210. https://doi.org/10.1371/journal.pone.0079210

18.

Epstein

(1979). Stability of behavior: 1. on predicting most of the people much of the time. Journal of Personality and Social Psychology, 37(7), 1097–1126. https://doi.org/10.1037/0022-3514.37.7.1097

19.

Falk

E. B.

Berkman

E. T.

Whalen

Lieberman

M. D.

(2011). Neural activity during health messaging predicts reductions in smoking above and beyond self-report. Health Psychology, 30(2), 177–185.

20.

Fazio

R. H.

Jackson

J. R.

Dunton

B. C.

Williams

C.J.

(1995). Variability in automatic activation as an unobtrusive measure of racial attitudes: A bona fide pipeline? Journal of Personality and Social Psychology, 69(6), 1013–1027. https://doi.org/10.1037/0022-3514.69.6.1013

21.

Ferguson

Bibby

P. A.

(2002). Predicting future blood donor returns: Past behavior, intentions, and observer effects. Health Psychology, 21(5), 513–518.

22.

Fiedler

Messner

Bluemke

(2006). Unresolved problems with the “I,” the “A,” and the “T”: A logical and psychometric critique of the Implicit Association Test (IAT). European Review of Social Psychology, 17, 74–147. https://doi.org/10.1080/10463280600681248

23.

FitzGerald

Hurst

(2017). Implicit bias in healthcare professionals: A systematic review. BMC Medical Ethics, 18, Article 19. https://doi.org/10.1186/s12910-017-0179-8

24.

Foroni

Bel-Bahar

(2010). Picture-IAT versus Word-IAT: Level of stimulus representation influences on the IAT. European Journal of Social Psychology, 40(2), 321–337. https://doi.org/10.1002/ejsp.626

25.

Gabrieli

J. D. E.

Ghosh

S. S.

Whitfield-Gabrieli

(2015). Prediction as a humanitarian and pragmatic contribution from human cognitive neuroscience. Neuron, 85, 11–26.

26.

Gast

Rothermund

(2010). When old and frail is not the same: Dissociating category and stimulus effects in four implicit attitude measurement methods. Quarterly Journal of Experimental Psychology, 63(3), 479–498. https://doi.org/10.1080/17470210903049963

27.

Gawronski

(2002). What does the Implicit Association Test measure? A test of the convergent and discriminant validity of prejudice-related IATs. Experimental Psychology, 49(3), 171–180. https://doi.org/10.1027//1618-3169.49.3.171

28.

Glasman

L. R.

Albarracin

(2006). Forming attitudes that predict future behavior: A meta-analysis of the attitude-behavior relation. Psychological Bulletin, 132(5), 778–822. https://doi.org/10.1037/0033-2909.132.5.778

29.

Gordon

R. A.

(1987). Social desirability bias: A demonstration and technique for its reduction. Teaching of Psychology, 14(1), 40–42. https://doi.org/10.1207/s15328023top1401_11

30.

Govan

C. L.

Williams

K. D.

(2004). Changing the affective valence of the stimulus items influences the IAT by re-defining the category labels. Journal of Experimental Social Psychology, 40(3), 357–365. https://doi.org/10.1016/j.jesp.2003.07.002

31.

Greenwald

A. G.

Banaji

M. R.

Nosek

B. A.

(2015). Statistically small effects of the Implicit Association Test can have societally large effects. Journal of Personality and Social Psychology, 108(4), 553–561. https://doi.org/10.1037/pspa0000016

32.

Greenwald

A. G.

McGhee

D. E.

Schwartz

J. L. K.

(1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74(6), 1464–1480. https://doi.org/10.1037/0022-3514.74.6.1464

33.

Greenwald

A. G.

Nosek

B. A.

(2001). Health of the Implicit Association Test at age 3. Zeitschrift Fur Experimentelle Psychologie, 48(2), 85–93. https://www.ncbi.nlm.nih.gov/pubmed/11392985

34.

Greenwald

A. G.

Nosek

B. A.

Banaji

M. R.

(2003). Understanding and using the Implicit Association Test: I. an improved scoring algorithm. Journal of Personality and Social Psychology, 85(2), 197–216. https://doi.org/10.1037/h0087889

35.

Haider

A. H.

Sexton

Sriram

Cooper

L. A.

Efron

D. T.

Swoboda

Villegas

C. V.

Haut

E. R.

Bonds

Pronovost

P. J.

Lipsett

P. A.

Freischlag

J. A.

Cornwell

E. E.

(2011). Association of unconscious race and social class bias with vignette-based clinical assessments by medical students. JAMA: Journal of the American Medical Association, 306(9), 942–951. https://doi.org/10.1001/jama.2011.1248

36.

Hofmann

Gawronski

Gschwendner

Schmitt

(2005). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin, 31(10), 1369–1385. https://doi.org/10.1177/0146167205275613

37.

Huijding

de Jong

P. J.

Wiers

R. W.

Verkooijen

(2005). Implicit and explicit attitudes toward smoking in a smoking and a nonsmoking setting. Addictive Behaviors, 30(5), 949–961. https://doi.org/10.1016/j.addbeh.2004.09.014

38.

James

(2017). The stability of implicit racial bias in police officers. Police Quarterly, 21(1), 30–52.

39.

Kensinger

E. A.

Schacter

D. L.

(2006). Processing emotional pictures and words: Effects of valence and arousal. Cognitive Affective & Behavioral Neuroscience, 6(2), 110–126. https://doi.org/10.3758/Cabn.6.2.110

40.

Kim

D. Y.

(2003). Voluntary controllability of the Implicit Association Test (IAT). Social Psychology Quarterly, 66(1), 83–96. https://doi.org/10.2307/3090143

41.

Kinoshita

Peek-O’Leary

(2006). Two bases of the compatibility effect in the Implicit Association Test (IAT). Quarterly Journal of Experimental Psychology, 59(12), 2102–2120. https://doi.org/10.1080/17470210500451141

42.

Klauer

K. C.

Mierke

(2005). Task-set inertia, attitude accessibility, and compatibility-order effects: New evidence for a task-set switching account of the Implicit Association Test effect. Personality and Social Psychology Bulletin, 31(2), 208–217. https://doi.org/10.1177/0146167204271416

43.

Klauer

K. C.

Schmitz

Teige-Mocigemba

Voss

(2010). Understanding the role of executive control in the Implicit Association Test: Why flexible people have small IAT effects. Quarterly Journal of Experimental Psychology, 63(3), 595–619. https://doi.org/10.1080/17470210903076826

44.

Klauer

K. C.

Voss

Schmitz

Teige-Mocigemba

(2007). Process components of the implicit association test: A diffusion-model analysis. Journal of Personality and Social Psychology, 93(3), 353–368. https://doi.org/10.1037/0022-3514.93.3.353

45.

Kraus

S. J.

(1995). Attitudes and the prediction of behavior: A metaanalysis of the empirical literature. Personality and Social Psychology Bulletin, 21(1), 58–75. https://doi.org/10.1177/0146167295211007

46.

Luo

Q. A.

Nakic

Wheatley

Richell

Martin

Blair

R. J. R.

(2006). The neural basis of implicit moral attitude—An IAT study using event-related fMRI. Neuroimage, 30(4), 1449–1457. https://doi.org/10.1016/j.neuroimage.2005.11.005

47.

Lyle

K. B.

Roediger

H. L.

McCabe

D. P.

(2008). Handedness is related to memory via hemispheric interaction: Evidence from paired associate recall and source memory tasks. Neuropsychology, 22(4), 523–530. https://doi.org/10.1037/0894-4105.22.4.523

48.

Maison

Greenwald

A. G.

Bruin

R. H.

(2004). Predictive validity of the Implicit Association Test in studies on brands, consumer attitudes and behavior. Journal of Consumer Psychology, 14(4), 405–415.

49.

Meissner

Grigutsch

L. A.

Koranyi

Müller

Rothermund

(2019). Predicting behavior with implicit measures: Disillusioning findings, reasonable explanations, and sophisticated solutions. Frontiers in Psychology, 10, Article 2483. https://doi.org/10.3389/fpsyg.2019.02483

50.

Meissner

Rothermund

(2013). Estimating the contributions of associations and recoding in the Implicit Association Test: The ReAL model for the IAT. Journal of Personality and Social Psychology, 104(1), 45–69. https://doi.org/10.1037/a0030734

51.

Meissner

Rothermund

(2015). A thousand words are worth more than a picture? The effects of stimulus modality on the Implicit Association Test. Social Psychological and Personality Science, 6(7), 740–748. https://doi.org/10.1177/1948550615580381

52.

Messner

Vosgerau

(2009). Order effects in the IAT. Advances in Consumer Research, 36, 38–40.

53.

Murdaugh

D. L.

Cox

J. E.

Cook

E. W.

III Weller

R. E.

(2012). FMRI reactivity to high-calorie food pictures predicts short- and long-term outcome in a weight-loss program. Neuroimage, 59(3), 2709–2721.

54.

Nederhof

A. J.

(1985). Methods of coping with social desirability bias: A review. European Journal of Social Psychology, 15(3), 263–280. https://doi.org/10.1002/ejsp.2420150303

55.

Nosek

B. A.

Banaji

M. R.

Greenwald

A. G.

(2002). Harvesting implicit group attitudes and beliefs from a demonstration web site. Group Dynamics: Theory, Research, and Practice, 6(1), 101–115. https://doi.org/10.1037//1089-2699.6.1.101

56.

Nosek

B. A.

Greenwald

A. G.

Banaji

M. R.

(2007). The Implicit Association Test at age 7: A methodological and conceptual review. In Bargh

J. A.

(Ed.), Automatic processes in social thinking and behavior (pp. 265–292). Psychology Press.

57.

Nuerk

H. C.

Iversen

Willmes

(2004). Notational modulation of the SNARC and the MARC (linguistic markedness of response codes) effect. Quarterly Journal of Experimental Psychology. A: Human Experimental Psychology, 57(5), 835–863. https://doi.org/10.1080/02724980343000512

58.

Oldfield

R. C.

(1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9(1), 97–113. http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=5146491

59.

Oliver

Kemps

(2018). Motivational and implicit processes contribute to incidental physical activity. British Journal of Health Psychology, 23(4), 820–842. https://doi.org/10.1111/bjhp.12318

60.

Ottaway

S. A.

Hayden

D. C.

Oakes

M. A.

(2001). Implicit attitudes and racism: Effects of word familiarity and frequency on the Implicit Association Test. Social Cognition, 19(2), 97–144. https://doi.org/10.1521/soco.19.2.97.20706

61.

Peeters

Koning

Monshouwer

Vollebergh

W. A. M.

Wiers

R. W.

(2016). Context effects of alcohol availability at home: Implicit alcohol associations and the prediction of adolescents’ drinking behavior. Journal of Studies on Alcohol and Drugs, 77(5), 749–756. https://doi.org/10.15288/jsad.2016.77.749

62.

Proctor

R. W.

Cho

Y. S.

(2006). Polarity correspondence: A general principle for performance of speeded binary classification tasks. Psychological Bulletin, 132(3), 416–442. https://doi.org/10.1037/0033-2909.132.3.416

63.

Proctor

R. W.

Xiong

A. P.

(2015). Polarity Correspondence as a General Compatibility Principle. Current Directions in Psychological Science, 24(6), 446–451. https://doi.org/10.1177/0963721415607305

64.

Quellette

J. A.

Wood

(1998). Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior. Psychological Bulletin, 124(1), 54–74.

65.

Raccuia

(2016). Single-Target Implicit Association Tests (ST-IAT) predict voting behavior of decided and undecided voters in Swiss referendums. PLOS ONE, 11(10), Article e0163872. https://doi.org/10.1371/journal.pone.0163872

66.

Raut

K. R.

(2020). Past behaviour, financial literacy and investment decision-making process of individual investors. International Journal of Emerging Markets, 15(6), 1243–1263.

67.

R Core Team. (2012). R: A language and environment for statistical computing. R Foundation for Statistical Computing.

68.

Richetin

Perugini

Prestwich

O’Gorman

(2007). The IAT as a predictor of food choice: The case of fruits versus snacks. International Journal of Psychology, 42(3), 166–173. https://doi.org/10.1080/00207590601067078

69.

Ritter

Vater

Rusch

Schroder-Abe

Schutz

Fydrich

Lammers

C. H.

Roepke

(2014). Shame in patients with narcissistic personality disorder. Psychiatry Research, 215(2), 429–437. https://doi.org/10.1016/j.psychres.2013.11.019

70.

Roccato

Zogmaister

(2010). Predicting the vote through implicit and explicit attitudes: A field research. Political Psychology, 31(2), 249–274. https://doi.org/10.1111/j.1467-9221.2009.00751.x

71.

Rohner

Ewers

(2016). Trying to separate the wheat from the chaff: Construct- and faking-related variance on the Implicit Association Test (IAT). Behavior Research Methods, 48(1), 243–258. https://doi.org/10.3758/s13428-015-0568-1

72.

Rohner

Schroder-Abe

Schutz

(2013). What do fakers actually do to fake the IAT? An investigation of faking strategies under different faking conditions. Journal of Research in Personality, 47(4), 330–338. https://doi.org/10.1016/j.jrp.2013.02.009

73.

Rothermund

Grigutsch

L. A.

Jusepeitis

Koranyi

Meissner

Müller

Urban

Wentura

(2020). Research with implicit measures: Suggestions for a new agenda of sub-personal psychology Chair of General Psychology. Social Cognition, 38, S243–S263.

74.

Rothermund

Teige-Mocigemba

Gast

Wentura

(2009). Minimizing the influence of recoding in the Implicit Association Test: The Recoding-Free Implicit Association Test (IAT-RF). Quarterly Journal of Experimental Psychology, 62(1), 84–98. https://doi.org/10.1080/17470210701822975

75.

Rothermund

Wentura

(2001). Figure-ground asymmetries in the Implicit Association Test (IAT). Zeitschrift Für Experimentelle Psychologie, 48(2), 94–106. https://doi.org/10.1026//0949-3946.48.2.94

76.

Schroeder

P. A.

Nuerk

H.-C.

Plewnia

(2017). Switching between multiple codes of SNARC-like associations: Two conceptual replication attempts with anodal tDCS in sham-controlled cross-over design. Frontiers in Neuroscience, 11, Article 654. https://doi.org/10.3389/fnins.2017.00654

77.

Songa

Russo

(2018). IAT, consumer behaviour and the moderating role of decision-making style: An empirical study on food products. Food Quality and Preference, 64, 205–220. https://doi.org/10.1016/j.foodqual.2017.09.006

78.

Steffens

M. C.

(2004). Is the Implicit Association Test immune to faking? Experimental Psychology, 51(3), 165–179. https://doi.org/10.1027/1618-3169.51.3.165

79.

Steffens

M. C.

Plewe

(2001). Items’ cross-category associations as a confounding factor in the Implicit Association Test. Zeitschrift Für Experimentelle Psychologie, 48(2), 123–134.

80.

Storage

(n.d.). IAT scoring made easy: An automated R script to analyse Implicit Association Test output. https://rpubs.com/dstorage/IAT

81.

Teige-Mocigemba

Klauer

K. C.

Rothermund

(2008). Minimizing method-specific variance in the IAT: A single block IAT. European Journal of Psychological Assessment, 24(4), 237–245. https://doi.org/10.1027/1015-5759.24.4.237

82.

Teige-Mocigemba

Klauer

K. C.

Sherman

J. W.

(2010). Practical guide to Implicit Association Tests and related tasks. In Gawronski

Payne

B. K.

(Eds.), Handbook of implicit social cognition: Measurement, theory, and applications (pp. 117–139). Guilford Press.

83.

Tukey

J. W.

(1977). Exploratory data analysis. Addison-Wesley.

84.

Vorberg

Mattler

Heinecke

Schmidt

Schwarzbach

(2004). Invariant time course of priming with and without awareness. In Kaernbach

Schroger

Müller

(Eds.), Psychophysics beyond sensation: Laws and invariants of human cognition (pp. 271–288). Lawrence Erlbaum Associates Publishers.

85.

Waller

Lampman

Lupfer-Johnson

(2012). Assessing bias against overweight individuals among nursing and psychology students: An Implicit Association Test. Journal of Clinical Nursing, 21(23–24), 3504–3512. https://doi.org/10.1111/j.1365-2702.2012.04226.x

86.

Wang

Geng

L. N.

Schultz

P. W.

Zhou

K. X.

(2019). Mindfulness increases the belief in climate change: The mediating role of connectedness with nature. Environment and Behavior, 51(1), 3–23. https://doi.org/10.1177/0013916517738036

87.

Werner

von Collani

(2003). Exercise effects in the Implicit Association Test (IAT). http://psydok.psycharchives.de/jspui/handle/20.500.11780/81?mode=full

88.

Willmes

Iversen

(1995). On the internal representation of number parity. Paper presented at the Spring annual meeting of the British Neuropsychological Society, London.

89.

Wittenbrink

Judd

C. M.

Park

(2001). Spontaneous prejudice in context: Variability in automatically activated attitudes. Journal of Personality and Social Psychology, 81(5), 815–827. https://doi.org/10.1037//0022-3514.81.5.815

90.

World Medical Association. (2013). World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA: Journal of the American Medical Association, 310(20), 2191–2194. https://doi.org/10.1001/jama.2013.281053

91.

Yamaguchi

Beattie

(2020). The role of explicit categorization in the Implicit Association Test. Journal of Experimental Psychology-General, 149(5), 809–827. https://doi.org/10.1037/xge0000685