Assessing the User Experience of Video Games: Relationships Between Three Scales

Abstract

With so many video games being released, there is strong competition among developers to create the most successful games. Questionnaires are one tool that can be used to measure aspects of a video game like perceived flow, presence, engagement, and controls. The current study investigated the relationship between several user experience scales and their subscales: UEQ-S, GUESS-24, and the ENJOY for six popular video games. Participants were recruited through Amazon Mechanical Turk (MTurk) and a university online research pool. Scale reliability analysis was conducted to ensure for internal consistency of the scales with Cronbach’s α. The relationships between the scales and subscales were analyzed using Pearson’s product correlations. Overall, the analysis showed a number of significant correlations between the UEQ-S, GUESS-24, and ENJOY. Evidence of uniqueness with each scale was also shown. Recommendations on which scale to use are discussed.

References

Brockmyer

J. H.

Fox

C. M.

Curtiss

K. A.

McBroom

Burkhart

K. M.

Pidruzny

J. N.

(2009). The development of the game engagement questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology, 45(4), 624-634.

Bromley

(2018). Interviewing players. In Brachen

Mirza-Babaei

Nacke

L. E.

(Eds.), Games user research (pp. 163-173). Oxford, UK: Oxford University Press.

Davidson

(2018). A Multi-Dimensional Model of Enjoyment: Development and Validation of an Enjoyment Scale (ENJOY). Dissertations and Theses. 381. https://commons.erau.edu/edt/381.

Denisova

Nordin

A. I.

Cairns

(2016, October). The convergence of player experience questionnaires. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (pp. 33-37). ACM.

Entertainment Software Association. (2018). Essential facts about the computer and video game industry 2018. Retrieved from http://www.theesa.com/wp-content/uploads/2018/05/EF2018_FINAL.pdf.

IJsselsteijn

W. A.

De Kort

Y. A. W.

Poels

(2013). The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven.

Jennett

Cox

A. L.

Cairns

Dhoparee

Epps

Tijs

Walton

(2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66(9), 641-661.

Johnson

Gardner

M. J.

Perry, R (2018). Validation of two game experience scales: The player experience of need satisfaction (PENS) and game experience questionnaire (GEQ). International Journal of Human-Computer Studies, 118, 38-46. https://doi.org/10.1016/j.ijhcs.2018.05.003.

Keebler

J. R.

Smith

D. C.

Shelstad

W. J.

Chaparro

B. S.

Phan

M. H.

(2018). Validation of the GUESS-24: A short version of the game user experience satisfaction scale (GUESS). Manuscript submitted for publication.

10.

Kuchera

(2018, Jan 10). Report: 7,672 games were released on Steam in 2017. Polygon. Retrieved from https://www.polygon.com/2018/1/10/16873446/steam-release-dates-2017.

11.

Laugwitz

Held

Schrepp

(2008, November). Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and Usability Engineering Group (pp. 63-76). Springer, Berlin, Heidelberg.

12.

Law

E. L.

Brühlmann

Mekler

E. D.

(2018). Systematic review and validation of the Game Experience Questionnaire (GEQ)–Implications for citation and reporting practice. PsyArXiv. https://doi.org/10.31234/osf.io/u94qt.

13.

Phan

M. H.

Keebler

J. R.

Chaparro

B. S.

(2016). The development and validation of the game user experience satisfaction scale (GUESS). Human Factors, 58(8), 1217-1247.

14.

Rigby

Ryan

(2007). The player experience of need satisfaction (PENS) model. Immersyve Inc, 1-22.

15.

Schreier

(2017, September). Why video games cost so much to make. Kotaku. Retrieved from https://kotaku.com/why-video-games-cost-so-much-to-make-1818508211.

16.

Schrepp

Hinderks

Thomaschewski

(2017). Design and evaluation of a short version of the user experience questionnaire (UEQ-S). International Journal of Interactive Multimedia and Artificial Intelligence, 4(6), 12.