The present study investigated the influence of 3D multimodal visualization and learning rehearsal on memory recall. Participants (N = 175 college students ranging from 21 to 25 years) were assigned to different training conditions and rehearsal processes to learn a list of 14 terms associated with construction of a wood-frame house. They then completed a memory test determining their cognitive ability to free recall the definitions of the 14 studied terms immediately after training and rehearsal. The audiovisual modality training condition was associated with the highest accuracy, and the visual- and auditory-modality conditions with lower accuracy rates. The no-training condition indicated little learning acquisition. A statistically significant increase in performance accuracy for the audiovisual condition as a function of rehearsal suggested the relative importance of rehearsal strategies in 3D observational learning. Findings revealed the potential application of integrating virtual reality and cognitive sciences to enhance learning and teaching effectiveness.
AmediA.JacobsonG.HendlerT.MalachR.ZoharyE. (2002) Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex, 12, 1202–1212.
3.
AmediA.MalachR.HendlerT.PeledS.ZoharyE. (2001) Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience, 4, 324–330.
4.
AshcraftM. H.RadvanskyG. A. (2010) Cognition. (5th ed.) Upper Saddle River, NJ: Prentice Hall, Pearson.
5.
BaddeleyA. (1992) Working memory. Science, 255, 556–559.
6.
BaddeleyA. (2003) Working memory: Looking back and looking forward. Nature Reviews Neuroscience, 4, 829–839.
7.
BaddeleyA. (2010) Working memory. Current Biology, 20, 136–140.
8.
BetrancourtM. (2005) The animation and interactivity principles in multimedia learning. In MayerR. E. (Ed.), Cambridge handbook of multimedia learning. New York: Cambridge Univer. Press. Pp. 287–296.
9.
BierbaumA.JustC.HartlingP.MeinertK.BakerA.Cruz-NeiraC. (2001) VR Juggler: A virtual platform for virtual reality application development. Proceedings of the IEEE Virtual Reality 2001. Pp. 89–96.
10.
ChandlerP. (2004) The crucial role of cognitive processes in the design of dynamic visualizations. Learning and Instruction, 14, 353–357.
11.
DayS. B.GoldstoneR. L. (2013) The import of knowledge export: Connecting findings and theories of transfer of learning. Educational Psychologist, 47(3), 153–176.
12.
DoP. T.HomaD. (2012) Exploring the psychological structure of transformational knowledge in visual and haptic intramodal conditions using multidimensional scaling. Perceptual & Motor Skills: Perception, 115, 443–464.
13.
DoP. T.MorelandJ. R.KorchekD. P. (2010) The influence of multimodal 3D visualizations on learning acquisition. Advances in Visual Computing, Proceedings of the ISVC Symposium 2010, Las Vegas, NV.
14.
EastonR.SrinivasK.GreeneA. (1997) Do vision and haptics share common representations? Implicit and explicit memory within and between modalities. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23, 153–163.
15.
ErnstM. O.BulthoffH. H. (2004) Merging the senses into a robust percept. Trends in Cognitive Sciences, 8, 162–169.
16.
GibsonJ. J. (1966) The senses considered as perceptual systems. Boston, MA: Houghton Mifflin.
17.
GibsonJ. J. (1979) The ecological approach to visual perception. Boston, MA: Houghton Mifflin.
18.
HolzingerA.Kickmeier-RustM.AlbertD. (2009) Dynamic media in computer science education; content complexity and learning performance: Is less more?Educational Technology & Society, 11(1), 279–290.
19.
HolzingerA.Kickmeier-RustM.WassertheurerS.HessingerM. (2009) Learning performance with interactive simulations in medical education: Lessons learned from results of learning complex physiological models with the HAEMOdynamics SIMulator. Computers & Education, 52, 292–301.
20.
HolzingerA.NischelwitzerA.FriedlS.HuB. (2010) Towards life long learning: Three models for ubiquitous applications. Wireless Communications and Mobile Computing, 10, 1350–1365.
21.
KalyugaS.AyresP.ChandlerP.SwellerJ. (2003) The expertise reversal effect. Educational Psychologist, 38, 23–31.
22.
KalyugaS.ChandlerP.SwellerJ. (2000) Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology, 92, 126–136.
23.
KalyugaS.RenklA.PaasF. (2010) Facilitating flexible problem solving: A cognitive load perspective. Educational Psychology Review, 22, 175–186.
24.
KirschnerP. A. (2002) Cognitive load theory: Implications of cognitive load theory on the design of learning. Learning and Instruction, 12(1), 1–10.
25.
KoedingerK. R.RollI. (2012) Learning to think: Cognitive mechanisms of knowledge transfer. In HolyoakK. J.MorrisonR. G. (Eds.), The Oxford handbook of thinking and reasoning. (2nd ed.) New York: Cambridge Univer. Press. Pp. 699–716.
26.
LinnM. C.EylonB. S. (2006) Science education: Integrating views of learning and instruction. In AlexanderP. A.WinneP. H. (Eds.), Handbook of educational psychology. (2nd ed.) Mahwah, NJ: Erlbaum. Pp. 511–544.
27.
LoweR. (2004) Interrogation of a dynamic visualization during learning. Learning and Instruction, 14, 257–274.
28.
MayerR. E. (2005) Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In MayerR. E. (Ed.), Cambridge handbook of multimedia learning. New York: Cambridge Univer. Press. Pp. 183–200.
29.
MayerR.AndersonR. (1992) The instructive animation: Helping students build connections between words and pictures in multimedia learning. Journal of Educational Psychology, 84, 444–452.
30.
MayerR.HeiserJ.LonnS. (2001) Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93, 187–198.
31.
MeissnerB.BognerF. X. (2012) Science teaching based on cognitive load theory: Engaged students, but cognitive deficiencies. Studies in Educational Evaluation, 38, 127–134.
32.
MillarS.Al-AttarZ. (2005) What aspects of vision facilitate haptic processing?Brain and Cognition, 59, 258–268.
33.
MujacicS.DebevcM.KosecP.BloiceM.HolzingerA. (2012) Modeling, design, development and evaluation of a hypervideo presentation for digital systems teaching and learning. Multimedia Tools and Applications, 58, 435–452.
34.
OptaleG.UrgesiC.BusatoV.MarinS.PironL.PriftisK.GamberiniL.CapodieciS.BordinA. (2010) Controlling memory impairment in elderly adults using virtual reality memory training: A randomized controlled pilot study. Neuroreha-bilitation and Neural Repair, 24(4), 348–357.
RizzoA.RegerG.GahmG.DifedeJ.RothbaumB. O. (2009) Virtual reality exposure therapy for combat-related PTSD. Post-Traumatic Stress Disorder: Basic Science and Clinical Practice, 18, 375–399.
37.
SchwanS.GarsoffkyB.HesseF. W. (2000) Do film cuts facilitate the perceptual and cognitive organization of activity sequences?Memory and Cognition, 28, 214–223.
38.
SchwanS.RiemppR. (2004) The cognitive benefits of interactive videos: Learning to tie nautical knots. Learning and Instruction, 14(3), 293–305.
39.
SwellerJ. (2005) Implications for cognitive load theory for multimedia learning. In MayerR. E. (Ed.), Cambridge handbook of multimedia learning. New York: Cambridge Univer. Press. Pp. 19–30.
TomaselloM. (2000) The cultural origins of human cognition. Cambridge, MA: Harvard Univer. Press.
42.
TverskyB.Bauer-MorrisonJ. B.BetrancourtM. (2002) Animation: Can it facilitate?International Journal of Human-Computer Studies, 57, 247–262.
43.
VallarG.Di BettaA. M.SilveriM. C. (1997) The phonological short-term store-rehearsal system: Patterns of impairment and neural correlates. Neuropsychologia, 35, 795–812.
