We examined whether and how sounds influence visually induced illusory self-motion (vection). Visual stimuli were presented for 40 s. They were made radially, expanding or contracting visual motion field and luminance-defined gratings drifting in a vertical or horizontal direction. Auditory stimuli were presented with the visual stimuli in most conditions; we employed sounds that increased or decreased in intensity, or ascended or descended in frequency. As a result, the sound which increased in intensity facilitated forward vection, and the sound which ascended/descended in frequency facilitated upward/downward vection. The perceptual plausibility of the sound for the corresponding self-motion seemed an important factor of enhancing vection.
AngelakiD ECullenK E, 2008“Vestibular system: The many facets of a multimodal sense”Annual Review of Neuroscience31125–150
3.
AshAPalmisanoSKimJ, 2011“Vection in depth during consistent and inconsistent multisensory stimulation”Perception40155–174
4.
BednyMKonkleTPelphreyKSaxeRPascual-LeoneA, 2010“Sensitive period for a multimodal response in human visual motion area MT/MST”Current Biology201900–1906
5.
BerthozAPavardBYoungL R, 1975“Perception of linear horizontal self-motion induced by peripheral vision (linear vection). Basic characteristics and visual-vestibular interactions”Experimental Brain Research23471–489
6.
BonatoFBubkaA, 2006“Chromaticity, spatial complexity, and self-motion perception”Perception3553–64
BrandtTDichgansJKoenigE, 1973“Differential effects of central versus peripheral vision on egocentric and exocentric motion perception”Experimental Brain Research16476–491
9.
BrandtTWistE RDichgansJ, 1975“Foreground and background in dynamic spatial orientation”Perception & Psychophysics17497–503
10.
DichgansJBrandtT, 1978“Visual-vestibular interaction: Effects on self-motion perception and postural control”, in Handbook of Sensory PhysiologyVolume 8 Eds HeldRLeibowitzH WTueberH L, (Berlin: Springer) pp 755–804
11.
FischerM HKornmüllerA E, 1930“Optokinetisch ausgelöste Bewegungswahrnehmungen und optokinetischer Nystagmus”Journal of Psychological Neurology41273–308
12.
GibsonJ J, 1966The Senses Considered as Perceptual Systems (Boston, MA: Houghton Mifflin)
13.
GoriMMazzilliGSandiniGBurrD, 2011“Cross-sensory facilitation reveals neural interactions between visual and tactile motion in humans”Frontiers in Psychology2 Article 55, 1–9
14.
GuYAngelakiD EDeAngelisG C, 2008“Neural correlates of multisensory cue integration in macaque MSTd”Nature Neuroscience111201–1210
15.
HeldRDichigansJBauerJ, 1975“Characteristics of moving visual scenes influencing spatial orientation”Vision Research15357–365
16.
HidakaSManakaYTeramotoWSugitaYMiyauchiRGyobaJSuzukiYIwayaY, 2009“Alternation of sound location induces visual motion perception of a static object”PLoS ONE4e8188
17.
HowardI PHeckmannT, 1989“Circular vection as a function of the relative sizes, distances, and positions of two competing visual displays”Perception18657–665
18.
ItoHShibataI, 2005“Self-motionperception from expanding and contracting optical flows overlapped with binocular disparity”Vision Research45397–402
19.
JohanssonG, 1977“Studies on visual perception of locomotion”Perception6365–376
20.
KimJPalmisanoS, 2010“Visually mediated eye movements regulate the capture of optic flow in self-motion perception”Experimental Brain Research202355–361
21.
KitagawaNIchiharaS, 2002“Hearing visual motion in depth”Nature416172–174
22.
LécuyerAVidalMJolyOMegardCBerthozA, 2004“Can haptic feedback improve the perception of self-motion in virtual reality?”, inHaptic Interfaces for Virtual Environment and Teleoperator Systems Haptics′04 Proceedings, 12th International Symposium, pp 208–215
23.
LeibowitzH WPostR BRodemerC SWadlingtonW LLundyR M, 1980“Roll vection analysis of suggestion-induced visual field narrowing”Attention, Perception, & Psychophysics28173–176
24.
LepecqJ CGiannopuluIBaudonniereP M, 1995“Cognitive effects on visually induced body motion in children”Perception24435–449
25.
LewickiM S, 2002“Efficient coding of natural sounds”Nature Neuroscience5356–363
26.
McGurkHMacDonaldJ, 1976“Hearing lips and seeing voices”Nature264746–748
NakamuraS, 2010“Additional oscillation can facilitate visually induced self-motion perception: The effects of its coherence and amplitude gradient”Perception39320–329
29.
NakamuraSSenoTItoHSunagaS, 2010“Coherent modulation of stimulus colour can affect visually induced self-motion perception”Perception391579–1590
30.
OhmiMHowardI P, 1988“Effect of stationary objects on illusory forward self-motion induced by a looming display”Perception175–12
31.
OhmiMHowardI PLandoltJ P, 1987“Circular vection as a function of foreground-background relationships”Perception1617–22
32.
OnimaruSSatoTKitazakiM, 2010“Veridical walking inhibits vection perception”Journal of Vision10860 (abstract)
PalmisanoSAllisonR SPekinF, 2008“Accelerating self-motion displays produce more compelling vection in depth”Perception3722–33
35.
PalmisanoSChanA Y C, 2004“Jitter and size effects on vection are robust to experimental instructions and demands”Perception33987–1000
36.
PrattC C, 1930“The spatial character of high and low tones”Journal of Experimental Psychology13278–285
37.
RieckeB EFeuereissenDRieserJ J, 2008“Auditory self-motion illusions (‘circular vection’) can be facilitated by vibrations and the potential for actual motion”, inACM APGV 2008 Conference Proceedings
38.
RieckeB ESchulte-PelkumJCaniardFBülthoffH H, 2005“Influence of auditory cues on the visually-induced self-motion illusion (circular vection) in virtual reality”, in Proceedings of 8th Annual Workshop Presence 2005 (New York: ACM) pp 49–57
39.
RieckeB EValjamaeASchulte-PelkumJ, 2009“Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality”ACM Transactions on Applied Perception (TAP)6 2 Article 7
40.
RieserJ JPickH LAshmeadD HGaringA E, 1995“Calibration of human locomotion and models of perceptual-motor organization”Journal of Experimental Psychology: Human Perception and Performance21480–497
41.
RusconiEKwanBGiordanoB LUmiltaCButterworthB, 2006“Spatial representation of pitch height: The SMARC effect”Cognition99113–129
42.
SadaghianiSMaierJ XNoppeneyU, 2009“Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing”Journal of Neuroscience296490–6499
43.
SakuraiKKuboderaTGrovePSakamotoSSuzukiY, 2010“Multi-modally perceived direction of self-motion from orthogonally directed visual and vestibular stimulation”Journal of Vision10866 (abstract)
44.
SenoTItoHSunagaS, 2009“The object and background hypothesis for vection”Vision Research492973–2982
45.
SenoTItoHSunagaS, 2010a“Vection aftereffects from expanding/contracting stimuli”Seeing & Perceiving23273–294
SenoTItoHSunagaSNakamuraS, 2010b“Temporonasal motion projected on the nasal retina underlies expansion–contraction asymmetry in vection”Vision Research501131–1139
49.
SenoTNakamuraSItoHSunagaS, 2010c“Static visual components without depth modulation alter the strength of vection”Vision Research501972–1981
50.
SenoTOgawaMItoHSunagaS, 2011c“Consistent air flow to the face facilitates vection”Perception401237–1240
51.
SenoTSunagaSItoH, 2010d“Inhibition of vection by red”Attention, Perception, & Psychophysics721642–1653
52.
ShamsLKamitaniYShimojoS, 2000“What you see is what you hear”Nature408788
53.
Soto-FaracoSLyonsJGazzanigaMSpenceCKingstoneA, 2002“The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities”Cognitive Brain Research14139–146
54.
TelfordLSpratleyJFrostB J, 1992“Linear vection in the central visual field facilitated by kinetic depth cues”Perception21337–349
55.
VäljamäeA, 2009“Auditorily-induced illusory self-motion: A review”Brain Research Review61240–255
56.
WrightW G, 2009“Linear vection in virtual environments can be strengthened by discordant inertial input”31st Annual International Conference of the IEEE (EMBS) pp 1157–1160
57.
WuergerS MHofbauerMMeyerG F, 2003“The integration of auditory and visual motion signals at threshold”Perception & Psychophysics651188–1196
