Investigating Usability,User Preferences,Ergonomics,and Player Performance in StarCraft II

Abstract

The present study investigated several factors hypothesized to affect player performance in a real-time strategy computer game, StarCraft II (SC2). User preferences for certain game settings (e.g., custom hotkey shortcuts) and peripheral equipment (e.g., gaming keyboards, laser mice) were surveyed along with usability perceptions and individual differences. In addition to these self-reports, participants uploaded replays of their perceived strongest SC2 games, offering a snapshot of players’ in-game behavioral data. Results indicated that perceived usability problems and higher neuroticism were linked to poorer performance, but multitasking tendencies and custom hotkeys were predictive of greater performance. Gaming keyboards were related to performance, although a performance benefit is inconclusive. Implications for individual differences, ergonomics, and usability are discussed.

References

Alzahabi

Becker

M. W.

(2013). The association between media multi-tasking, task-switching, and dual-task performance. Journal of Experimental Psychology. Human Perception and Performance, 39(5), 1485–1495. doi:10.1037/a0031208

Belicza

(2015, October 7). Sc2gears. Retrieved from https://sites.google.com/site/sc2gears/

Blizzard Entertainment (2010). SC2. Irvine, CA: Blizzard Entertainment

Boot

W. R.

Kramer

A. K.

Simons

D. J.

Fabiani

Gratton

(2008). The effects of video game playing on attention, memory, and executive control. Acta Psychologica, 129(3), 387-398.

Cain

M. S.

Landau

A. N.

Shimamura

A. P.

(2012). Action video game experience reduces the cost of switching tasks. Attention, Perception, and Psychophysics, 74(4), 641-647.

Castel

A. D.

Pratt

Drummond

(2005). The effects of action video game experience on the time course of inhibition of return and the efficiency of visual search. Acta Psychologica, 119, 217-230.

Cone

B. D.

Irvine

C. E.

Thompson

M. F.

Nguyen

T. D.

(2006). A video game for cyber security training and awareness. Computers & Security, 26, 63-72.

Daskeyboard. (2014, April 10) Are Mechanical Keyboards Better for Gaming? Daskeyboard Blog. Retrieved from http://www.das-keyboard.com/blog/are-mechanical-keyboards-better-for-gaming/

DFC Intelligence. (2014). Global video game industry to reach $96B in 2018. February 12, 2014 REPORT

10.

Dye

M. W. G.

Green

C. S.

Bavelier

(2009). Increasing speed of processing with action video games. Current Directions in Psychological Science, 18(6), 321-326.

11.

Glass

B. D.

Maddox

W. T.

Love

B. C.

(2013). Real-time strategy game training: emergence of a cognitive flexibility trait. PLoS ONE, 8(8), e70350.

12.

Granic

Lobel

Engels

R. C.

(2014). The benefits of playing video games. American Psychologist, 69(1), 66.

13.

Green

C. S.

Bavelier

(2003). Action video game modifies visual selective attention. Nature, 423, 534-537.

14.

Gosling

S. D.

Rentfrow

P. J.

Swann

W. B.

(2003). A very brief measure of the big-five personality domains. Journal of Research in Personality, 37, 504-528

15.

Hambrick

D. Z.

Oswald

F. L.

Darowski

E. S.

Rench

T. A.

Brou

(2010). Predictors of multitasking performance in a synthetic work paradigm, Applied Cognitive Psychology, 24(8), 1149–1167.

16.

IBM Corporation. (2013). IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corporation

17.

Irons

J. L.

Remington

R. W.

McLean

J. P.

(2011). Not so fast: Rethinking the effects of action video games on attentional capacity.Australian Journal of Psychology, 63(4), 224-231.

18.

Kortum

Peres

S. C.

(2014). The relationship between system effective-ness and subjective usability scores using the System Usability Scale. International Journal of Human-Computer Interaction, 30(7), 575-584.

19.

Lewis

J. M.

Trinh

Kirsh

(2011). A corpus analysis of strategy video game play in StarCraft: Brood war. In Proceedings of the 33rd annual Conference of the Cognitive Science Society, 33, 687-692.

20.

Lieberman

M. D.

Rosenthal

(2001). Why introverts can't always tell who likes them: multitasking and nonverbal decoding. Journal of personality and social psychology, 80(2), 294

21.

Lien

M.-C.

Ruthruff

Johnston

J. C.

(2006). Attentional limitations in doing two tasks at once. The search for exceptions. Current Directions in Psychological Science, 15(2), 89–93. doi:10.1111/j.0963-7214.2006.00413.x

22.

Lintern

Kennedy

R. S.

(1984). Video game as a covariate for carrier landing research. Perceptual and Motor Skills, 1984, 58, 167-172

23.

Matthews

(1997). Extraversion, emotion, and performance: A cognitive-adaptive model. In: Matthews

(Ed.), Cognitive science perspectives on personality and emotion (pp. 399-442). Amsterdam: Elsevier.

24.

McCrae

R. R.

Costa

P. T.

(1987). Validation of the Five-Factor Model of personality across instruments and observers. Journal of Personality and Social Psychology, 52(1), 81-90

25.

Morgan

D’Mello

Abbott

Radvansky

Haass

Tamplin

Mello

S. D.

(2013). Individual differences in multitasking ability and adaptability. Human Factors, 55(4), 776–88.

26.

Nielsen

(1994, April). Enhancing the explanatory power of usability heuristics.In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp.152-158). ACM.

27.

Nielsen

Norman

(2015). User Satisfaction vs. Performance Metrics. Retrieved 4 May 2015, from http://www.nngroup.com/articles/satisfac-tion-vs-performance-metrics/

28.

NPD Group (2011). The video game industry is adding 2-17 year-old gamers at a rate higher than that age group’s population growth. [Press Release]. Retrieved from http://www.npdgroup.com/wps/por-31213601283.xml

29.

Ophir

Nass

Wagner

A. D.

(2009). Cognitive control in media multitaskers. Proceedings of the National Academy of Sciences of the United States of America, 106(37), 15583–7. doi:10.1073/pnas.0903620106

30.

Rosser

J. C.

Lynch

P. J.

Cuddihy

Gentile

D. A.

Klonsky

Merrell

(2007). The impact of video games on training surgeons in the 21st century. Archives of Surgery, 142(2), 181-186.

31.

Sanbonmatsu

D. M.

Strayer

D. L.

Medeiros-Ward

Watson

J. M.

(2013). Who multi-tasks and why? Multi-tasking ability, perceived multitasking ability, impulsivity, and sensation seeking. PloS One, 8(1), e54402. doi:10.1371/journal.pone.0054402

32.

Schlickum

M. K.

Hedman

Enochsson

Kjellin

Fellander-Tsai

(2009). Systematic video game training in surgical novices improves performance in virtual reality endoscopic surgical simulators: A prospective randomized study. World Journal of Surgery, 33, 2360-2367.

33.

Szalma

J. L.

(2008). Individual differences in stress reaction. In Hancock

P.A.

Szalma

J.L.

(Eds.), Performance under stress (pp. 323-357). Hamp-shire, UK: Ashgate

34.

Szymura

Nęcka

(1998). Visual selective attention and personality: An experimental verification of three models of extra version. Personality and Individual Differences, 24(5), 713-729.

35.

Thompson

J. J.

Blair

M. R.

Chen

Henrey

A. J.

(2013). Video game telemetry as a critical tool in the study of complex skill learning. PloS One, 8(1) DOI: 10.1371/journal.pone.0075129

36.

Wickens

(2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159-177.