We investigated the frame of reference involved in audio – visual (AV) fusion over space. This multisensory phenomenon refers to the perception of unity resulting from visual and auditory stimuli despite their potential spatial disparity. The extent of this illusion depends on the eccentricity in azimuth of the bimodal stimulus (Godfroy et al, 2003 Perception32 1233–1245). In a previous study, conducted in a luminous environment, Roumes et al 2004 (Perception33 Supplement, 142) have shown that variation of AV fusion is gaze-dependent. Here we examine the contribution of ego- or allocentric visual cues by conducting the experiment in total darkness. Auditory and visual stimuli were displayed in synchrony with various spatial disparities. Subjects had to judge their unity (‘fusion’ or ‘no fusion’). Results showed that AV fusion in darkness remains gaze-dependent despite the lack of any allocentric cues and confirmed the hypothesis that the reference frame of the bimodal space is neither head-centred nor eye-centred.
Get full access to this article
View all access options for this article.
References
1.
AndersenR A, 1997“Multimodal integration for the representation of space in the posterior parietal cortex”Philosophical Transactions of the Royal Society of London B3521421–1428
2.
BertelsonPRadeauM, 1981“Cross-modal bias and perceptual fusion with auditory – visual spatial discordance”Perception & Psychophysics29578–584
3.
BlauertJ, 1983Spatial Hearing. The Psychophysics of Human Sound Localization (London: MIT Press)
4.
BridgemanBPeerySAnandS, 1997“Interaction of cognitive and sensorimotor maps of visual space”Perception & Psychophysics59456–469
5.
CorneilB DVan WanrooijMMunozD PVan OpstalA J, 2002“Auditory – visual interactions subserving goal-directed saccades in a complex scene”Journal of Neurophysiology88438–454
6.
DassonvillePBridgemanBKaur BalaJThiemPSampanesA, 2004“The induced Roelofs effect: two visual systems or the shift of a single reference frame?”Vision Research44603–611
7.
GibsonJ J, 1966The Senses Considered as Perceptual Systems (Westport, CT: Greenwood Press)
8.
GodfroyMRoumesCDauchyP, 2003“Spatial variations of visual – auditory fusion areas”Perception321233–1245
9.
GoossensH H L MVan OpstalA J, 1999“Influence of head position on the spatial representation of acoustic targets”Journal of Neurophysiology812720–2736
10.
GrohJ MWerner-ReissU, 2002“Visual and auditory integration”, in Encyclopedia of the Human Brainvolume 4, Ed. RamachandranV S (San Diego, CA: Academic Press) pp 739–752
11.
JackC EThurlowW R, 1973“Effect of degree of visual association and angle of displacement on the ventriloquism effect”Perceptual and Motor Skills37967–979
12.
JayM FSparksD L, 1984“Auditory receptive fields in primate superior colliculus shift with changes in eye position”Nature309345–347
13.
LewaldJEhrensteinW H, 1996“Auditory – visual shift in localization depending on gaze direction”NeuroReport71929–1932
14.
MiddlebrooksJ CGreenD M, 1991“Sound localization by human listeners”Annual Review of Psychology42135–159
15.
OldfieldS RParkerS P A, 1984“Acuity of sound localization: a topography of auditory spaces. I. Normal hearing conditions”Perception13581–600
16.
PaillardJ, 1991“Motor and representational framing of space”, in Brain and Space Ed. PaillardJ (Oxford: Oxford University Press) pp 163–182
17.
PedersenJ AJørgensenT, 2005“Localization performance of real and virtual sound sources”, in RTO-MP-HFM-123 (Neuilly-sur-Seine, France)
RoumesCHartnagelDGodfroyM, 2004“Visual – auditory fusion and frames of reference”Perception33Supplement, 142 (abstract)
20.
SchlackASterbing-D'AngeloS JHartungKHoffmannK-PBremmerF, 2005“Multisensory space representations in the macaque ventral intraparietal area”Journal of Neuroscience254616–4625
21.
ShethB RShimojoS, 2004“Extrinsic cues suppress the encoding of intrinsic cues”Journal of Cognitive Neuroscience16339–350
22.
SlutskyD ARecanzoneG H, 2001“Temporal and spatial dependency of the ventriloquism effect”NeuroReport127–10
23.
SteinB EMeredithA M, 1993The Merging of the Senses (Cambridge, MA: MIT Press)
24.
StricanneBAndersenR AMazzoniP, 1996“Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP”Journal of Neurophysiology762071–2076
WelchR BWarrenD H, 1980“Immediate perceptual response to intersensory discrepancy”Psychological Bulletin88638–667
27.
WelchR BWarrenD H, 1986“Intersensory interactions”, in Handbook of Perception and Human Performance. Sensory Processes and Perception Eds BoffKKaufmanLThomasJ (New York: Wiley Interscience) pp 25-1–25-36
28.
Werner-ReissUKellyK ATrauseA SUnderhillA MGrohJ, 2003“Eye position affects activity in the primary auditory cortex of primates”Current Biology13554–562
29.
WitkinH AAschS E, 1948“Studies in space orientation. IV. Further experiments on perception of the upright with displaced visual fields”Journal of Experimental Psychology38762–782
