In this study we explore how soundscapes can be used as navigational aids in virtual environments and empirically investigate the correlation between immersiveness in virtual environments and spatial abilities when soundscapes are used as landmarks for wayfinding. We attempt to advance knowledge regarding auditory cues contributing to enhanced immersive and navigational experience in virtual environments. Findings are likely to be utilized in effective design for physical environments and wayfinding.
AdamsR JHannafordB (1999) “Stable haptic interaction with virtual environments”. IEEE Transactions on Robotics and Automation15: 465–474
2.
AheadiADixonPGloverS (2010) “A limiting feature of the Mozart effect: listening enhances mental rotation abilities in non-musicians but not musicians”. Psychology of Music38: 107–117
3.
BalakrishnanBSundarS S (2011) “Where am I? How can I get there? Impact of navigability and narrative transportation on spatial presence”. Human–Computer Interaction26: 161–204
4.
BañosR MBotellaCAlcañizMLiañoVGuerreroBReyB (2004) “Immersion and emotion: their impact on the sense of presence”. CyberPsychology and Behavior7: 734–741
5.
Bargar R, Choi I, Das S, Goudeseune C, 1994, “Model based interactive sound for an immersive virtual environment”, in Proceedings of the International Computer Music Conference 1994 pp 471-474
6.
BegaultD R (1994) 3-D Sound for Virtual Reality and Multimedia, Boston, MA: AP Professional
7.
BerndtAHartmannKRöberNMasuchM (2006) “Composition and arrangement techniques for music in interactive immersive environments”. Audio Mostly2006: 53–59
8.
BlauertJ (1997) Spatial Hearing: the Psychophysics of Human Sound Localization, Cambridge, MA: MIT Press
9.
BrewsterS A (1998) “Using nonspeech sounds to provide navigation cues”. ACM Transactions on Computer-Human Interaction5: 224–259
10.
BrockmyerJ HFoxC MCurtissK AMcBroomEBurkhartK MPidruznyJ N (2009) “The development of the game engagement questionnaire: a measure of engagement in video game-playing”. Journal of Experimental Social Psychology45: 624–634
11.
BrownECairnsP (2004) “A grounded investigation of game immersion”. CHI'04 Extended Abstracts on Human Factors in Computing Systems, New York: ACM Press, pp. 1297–1300
12.
CarrollJ B (1993) Human Cognitive Abilities: A Survey of Factor-analytic Studies, Cambridge: Cambridge University Press
13.
ChabrisC F (1999) “Prelude or requiem for the ‘Mozart effect’?”. Nature400(6747): 826–827
14.
Chandrasekera T, Yoon S-Y, D'Souza N T, 2010, “The effect of soundscapes on immersive experience in virtual environments” Proceedings of the15th Biannual Conference of the Design Communication Association 8–11 September, Bozeman, Montana
15.
ChaseW G (1986) “Visual information processing”. In: BoffK RKaufmanLThomasJ-P (eds) Hanbook of Perception and Human Performance, Volume II: Cognitive Processes and Performance, New York: John Wiley, pp. 28–71
Cohen M, Fernando O N N, Nagai T, Shimizu K, 2006, “Back-seat driver: spatial sound for vehicular way-finding and situation awareness”, in Proceedings of the Japan–China Joint Workshop on Frontier of Computer Science and Technology (IEEE Computer Society, Los Alamitos, CA) pp 109–115
18.
DaviesW JAdamsM DBruceN SCainRCarlyleACusackPHallD AHumeK IIrwinAJenningsP (2013) “Perception of soundscapes: an interdisciplinary approach”. Applied Acoustics14: 224–231
19.
DedeC (2009) “Immersive interfaces for engagement and learning”. Science323: 66–69
20.
DeVellisR F (1991) Scale Development: Theory and Applications, Newbury Park, CA: Sage
21.
Dodiya J, Alexandrov V N, 2008, “Use of auditory cues for wayfinding assistance in virtual environment: music aids route decision”, in Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (ACM, New York) pp 171–174
22.
DraperJ VKaberD BUsherJ M (1998) “Telepresence”. Human Factors: The Journal of the Human Factors and Ergonomics Society40: 354–375
23.
Ermi L, Mäyrä F, 2005, “Fundamental components of the gameplay experience: analysing immersion”, in Changing Views—Worlds in Play: Selected Papers of the 2005 Digital Games Research Association's 2nd International Conference Eds S de Castell, J Jensen, pp 15–17
24.
EvansG WSmithCPezdekK (1982) “Cognitive maps and urban form”. Journal of the American Planning Association48: 232–244
25.
Finney N, Janer J, 2010, “Soundscape generation for virtual environments using community-provided audio databases”, W3C Workshop—Augmented Reality on the Web, Barcelona, 15–16 June, http://www.w3.org/2010/06/w3car/soundscape_generation.pdf
26.
GarciaJ M (2006) “From heartland values to killing prostitutes: an overview of sound in the video game Grand Theft Auto Liberty City Stories”. Audio Mostly2006: 22–25
27.
GearyD C (1996) “Sexual selection and sex differences in mathematical abilities”. Behavioral and Brain Sciences19: 229–246
28.
GolledgeR GStinsonR J (1997) Spatial Behavior: A Geographic Perspective, New York: Guilford Press
29.
GuntherRKazmanRMacGregorC (2004) “Using 3D sound as a navigational aid in virtual environments”. Behaviour and Information Technology23: 435–446
30.
HegartyMWallerD (2004) “A dissociation between mental rotation and perspective-taking spatial abilities”. Intelligence32: 175–191
31.
HendrixCBarfieldW (1996) “Presence within virtual environments as a function of visual display parameters”. Presence: Teleoperators and Virtual Environments5: 274–289
32.
HetlandL (2000) “Listening to music enhances spatial-temporal reasoning: evidence for the ‘Mozart Effect’ ”. Journal of Aesthetic Education34(3/4): 105–148
33.
JennettCCoxA LCairnsPDhopareeSEppsATijsTWaltonA (2008) “Measuring and defining the experience of immersion in games”. International Journal of Human–Computer Studies66: 641–661
34.
JørgensenK (2006) “On the functional aspects of computer game audio”. Audio Mostly2006: 48–52
35.
Kallinen K, Salminen M, Ravaja N, Kedzior R, Sääksjärvi M, 2007, “Presence and emotion in computer game players during 1st person vs 3rd person playing view: evidence from self-report, eye-tracking, and facial muscle activity data” PRESENCE 2007 Proceedings of the 10th International Workshop on Presence 25–27 October, Barcelona pp 187–190
36.
KaufmanS B (2007) “Sex differences in mental rotation and spatial visualization ability: can they be accounted for by differences in working memory capacity?”. Intelligence35: 211–223
37.
Komninos A, Barrie P, Stefanis V, Plessas A, 2012, “Urban exploration using audio scents”, in Proceedings of the 14th International Conference on Human–Computer Interaction with Mobile Devices and Services Companion (ACM, New York) pp 349–358
38.
LevineO HMourantR R (1996) “Effect of visual display parameters on driving performance in a virtual environments driving simulator”. Proceedings of the Human Factors and Ergonomics Society Annual Meeting40: 1136–1140
39.
LombardMDittonT (1997) “At the heart of it all: the concept of presence”. Journal of Computer-Mediated Communication3(2): article 1
40.
LoomisJ MGolledgeR GKlatzkyR L (1998) “Navigation system for the blind: auditory display modes and guidance”. Presence7: 193–203
41.
LynchK (1960) The Image of the City, Cambridge, MA: MIT Press
42.
McGeeM G (1979) “Human spatial abilities: psychometric studies and environmental, genetic, hormonal, and neurological influences”. Psychological Bulletin86: 889–918
43.
MaguireE AFrithC DBurgessNDonnettJ GO'KeefeJ (1998) “Knowing where things are: parahippocampal involvement in encoding object locations in virtual large-scale space”. Journal of Cognitive Neuroscience10: 61–76
44.
MerabetL BSánchezJ (2009) “Audio-based navigation using virtual environments: combining technology and neuroscience”. AER Journal: Research and Practice in Visual Impairment and Blindness2(3): 128–137
45.
MiyakeAFriedmanN PRettingerD AShahPHegartyM (2001) “How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis”. Journal of Experimental Psychology: General130: 621–640
46.
MoffatD CKieglerK (2006) “Investigating the effects of music on emotions in games”. Audio Mostly2006: 37–41
47.
Naef M, Staadt O, Gross M, 2002, “Spatialized audio rendering for immersive virtual environments”, in Proceedings of the ACM Symposium on Virtual Reality Software and Technology (ACM, New York) pp 65–72
48.
Niessen M, Cance C, Dubois D, 2010, “Categories for soundscape: toward a hybrid classification”, in INTER-NOISE and NOISE-CON 2010 Congress and Conference Proceedings (Institute of Noise Control Engineering, Reston, VA) pp 5816–5829
49.
PassiniR (1984) Wayfinding in Architecture, New York: Van Nostrand Reinhold
50.
PorteousJ DMastinJ F (1985) “Soundscape”. Journal of Architectural and Planning Research2: 169–186
51.
RauscherF HShawG LKyK N (1993) “Music and spatial task performance”. Nature365(6447): 611
52.
Robertson G, Czerwinski M, Van Dantzich M, 1997, “Immersion in desktop virtual reality”, in Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (ACM, New York) pp 11–19
53.
Sanchez-VivesM VSlaterM (2005) “From presence to consciousness through virtual reality”. Nature Reviews Neuroscience6: 332–339
54.
ShepardRMetzlerJ (1971) “Mental rotation of three-dimensional objects”. Science171(3972): 701–703
55.
SingerM JWitmerB G (1999) “On selecting the right yardstick”. Presence8: 566–573
56.
SlaterMUsohMSteedA (1994) “Depth of presence in virtual environments”. Presence3: 130–144
57.
SteckS DMallotH A (2000) “The role of global and local landmarks in virtual environment navigation”. Presence: Teleoperators nd Virtual Environments9: 69–83
58.
StumpfHEliotJ (1999) “A structural analysis of visual spatial ability in academically talented students”. Learning and Individual Differences11: 137–151
59.
Sturman D J, Zeltzer D, Pieper S, 1989, “Hands-on interaction with virtual environments” Proceedings of the 2nd Annual ACM SIGGRAPH Symposium on User Interface Software and Technology (ACM, New York) pp 19–24
60.
Tardieu J, Susini P, Poisson F, 2004, “Soundscape design in train stations: perceptual study of soundscapes” Proceedings of the CFA/DAGA'04 (Joint French/German Acoustical Societies Meeting). Strasbourg2 961-962
61.
ThompsonW FSchellenbergE GHusainG (2001) “Arousal, mood, and the Mozart effect”. Psychological Science12: 248–251
62.
ThurstoneL L (1938) “Primary mental abilities”. Psychometric Monographs 1, Chicago, IL: University of Chicago Press, pp. 121
63.
TruaxB (2001) “Handbook of acoustic ecology (CD-ROM version)”. Computer Music Journal25: 93–94
64.
TsingosNGalloEDrettakisG (2004) “Perceptual audio rendering of complex virtual environments”. ACM Transactions on Graphics23: 249–258
65.
VäljamäeALarssonPVästfjällDKleinerM (2009) “Auditory landmarks enhance circular vection in multimodal virtual reality”. Journal of the Audio Engineering Society57: 111–120
66.
VernonP E (1950) The Structure of Human Abilities, London: Methuen
67.
Vinson N G, 1999, “Design guidelines for landmarks to support navigation in virtual environments”, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, New York), pp 278–285
68.
Walker B N, Lindsay J, 2003, “Effect of beacon sounds on navigation performance in a virtual reality environment” Proceedings of 9th International Conference on Auditory Display ICAD2003 Boston 204–207
69.
WitmerB GSingerM J (1998) “Measuring presence in virtual environments: a presence questionnaire”. Presence7: 225–240
70.
ZhangMKangJ (2007) “Towards the evaluation, description, and creation of soundscapes in urban open spaces”. Environment And Planning B: Planning and Design34: 68–86
