Human computation games (HCGs) are applications that use games to harness human intelligence to perform various computational tasks. That is, users perform computations as a byproduct of being entertained while playing a game. Such games are increasing in popularity and it is critical to examine how different types of HCG affect players’ perceptions and performance. In addition, understanding their motivational appeal to different players is also important to good HCG design. In the present research, we focus on image tagging HCGs, where users play games to generate keywords for images. Three versions were created: a collaborative HCG which required players to cooperate, a competitive HCG where players worked against each other, and a control non-game manual tagging application. The applications were evaluated to uncover the quality of the tags, users’ perceptions of these variants, and the influence of motivational needs on usage intention. Results suggest that, while participants reported liking the collaborative and competitive HCGs over the control application, those using the latter seemed to generate better quality tags. Further, using the trichotomy of needs theory, we found that an individual’s need for achievement and power influenced intention to use the various applications.
GohDHAngRPChuaAYKLeeCS. Evaluating game genres for tagging images. In: BlanfordAGulliksenJ (eds) Proceedings of the 6th Nordic Conference on Human–Computer Interaction. New York: ACM Press, 2010, pp. 659–662.
2.
von AhnLDabbishL. Labeling images with a computer game. In: Dykstra-EricksonETscheligiM (eds) Proceedings of the 2004 Annual SIGCHI Conference on Human Factors in Computing Systems. New York: ACM Press, 2004, pp. 319–326.
3.
LeeCSGohDHChuaAYKAngRP. Indagator: investigating perceived gratifications of an application that blends mobile content sharing with gameplay. Journal of the American Society for Information Science and Technology2010; 61: 1244–1257.
4.
SiorpaesKHeppM. Games with a purpose for the Semantic Web. IEEE Intelligent Systems2008; 23: 50–60.
5.
von AhnLDabbishL. (2008). Designing games with a purpose. Communications of the ACM2008; 51: 58–67.
6.
VordererPHartmannTKlimmtC. Explaining the enjoyment of playing video games: the role of competition. In: SpencerSN (ed.), Proceedings of the Second International Conference on Computer Games. New York: ACM Press, 2003, pp. 1–9.
7.
HoCJChangTHLeeJCHsuJYJChenKT. KissKissBan: a competitive human computation game for image annotation. In: BennettPChandrasekarRChickeringMIpeirotisPLawEMityaginA. (eds), Proceedings of the 2009 ACM SIGKDD Workshop on Human Computation. New York: ACM Press, 2009, pp. 11–14.
8.
LeeCS. Managing perceived communication failures with affordances of ICTs. Computers in Human Behavior2010; 26: 572–580.
9.
FangXZhaoF. Personality and enjoyment of computer game play. Computers in Industry2010; 61: 342–349.
10.
OlsonCK. Children’s motivations for video game play in the context of normal development. Review of General Psychology2010; 14: 180–187.
11.
PrzybylskiAKRigbyCSRyanRM. A motivational model of video game engagement. Review of General Psychology2010; 14: 154–166.
12.
BartleRA. Designing virtual worlds. Berkeley, CA: New Riders, 2004.
13.
BarnettJCoulsonM. Virtually real: a psychological perspective on massively multiplayer online games. Review of General Psychology2010; 14: 167–179.
14.
YeeN. Motivations for play in online games. Cyberpsychology & Behavior2006; 9: 772–775.
15.
HaIYoonYChoiM. Determinants of adoption of mobile games under mobile broadband wireless access environment. Information & Management2007; 44: 276–286.
16.
BarringtonLTurnbullDO’MalleyDLanckrietG. User-centered design of a social game to tag music. In: BennettPChandrasekarRChickeringMIpeirotisPLawEMityaginA. (eds) Proceedings of the 2009 ACM SIGKDD Workshop on Human Computation. New York: ACM Press, 2009, pp. 7–10.
17.
LawEvon AhnL. Input-agreement: a new mechanism for collecting data using human computation games. In: HinckleyKMorrisMRHudsonSGreenbergS (eds), Proceedings of the 2009 Annual SIGCHI Conference on Human Factors in Computing Systems. New York: ACM Press, pp. 1197–1206.
18.
WalshGGolbeckJ. Curator: a game with a purpose for collection recommendation. In: FitzpatrickGHudsonSEdwardsKRoddenT (eds), Proceedings of the 2010 Annual SIGCHI Conference on Human Factors in Computing Systems. New York: ACM Press, 2010, pp. 2079–2082.
19.
BellMReevesSBrownBSherwoodSMcMillanDFergusonJChalmersM. Eyespy: supporting navigation through play. In: HinckleyKMorrisMRHudsonSGreenbergS (eds) Proceedings of the 2009 Annual SIGCHI Conference on Human Factors in Computing Systems. New York: ACM Press, 2009, pp. 123–132.
20.
HsuCLLuHP. Consumer behaviour in online game communities: a motivational factor perspective. Computers in Human Behaviour2007; 23: 1642–1659.
21.
LuHPLinJCCHsiaoKLChengLT. Information sharing behaviour on blogs in Taiwan: effects of interactivities and gender differences. Journal of Information Science2010; 36: 401–416.
22.
ChampionE. Applying game design theory to virtual heritage environments. In: BlakeEBangayAGainJ (eds) Proceedings of the First International Conference on Computer Graphics and Interactive Techniques. New York: ACM Press, 2003, pp. 273–274.
23.
RavajaNSalminenMSaariTLaarniJHolopainenJJarvinenA. (2004). Emotional response patterns and sense of presence during video games: potential criterion variables for game design. In: RaisamoR (ed.) Proceedings of the Third Nordic Conference on Human–Computer Interaction. New York: ACM Press, 2004, pp. 339–347.
24.
von AhnLLiuRBlumM. Peekaboom: a game for locating objects in images. In: GrinterRRoddenTAokiPCutrellEJeffriesROlsonG (eds) Proceedings of the 2006 Annual SIGCHI Conference on Human Factors in Computing Systems. New York: ACM Press, 2006, pp. 55–64.
25.
RobertsonSVojnovicMWeberI. Rethinking the ESP game. In: HinckleyKMorrisMRHudsonSGreenbergS (eds), Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems. New York: ACM Press, 2009, pp. 3937–3942.
26.
GohDHAngRPLeeCSChuaA. (In press). Fight or unite: investigating genres for human computation games. Journal of the American Society for Information Science and Technology.
27.
CaseySKirmanBRowlandD. The gopher game: a social, mobile, locative game with user generated content and peer review. In: BernhauptRNatkinS (eds) Proceedings of the 2007 International Conference on Advances in Computer Entertainment Technology. New York: ACM Press, 2007, pp. 9–16.
28.
WilliamsDYeeNCaplanSE. Who plays, how much, and why? Debunking the stereotypical gamer profile. Journal of Computer-Mediated Communication2008; 13: 993–1018.
29.
RyanRMRigbyCSPrzybylskiAK. The motivational pull of video games: a self-determination theory approach. Motivation and Emotion2006; 30: 347–364.
30.
ColwellJ. Needs met through computer game play among adolescents. Personality and Individual Differences2007; 43: 2072–2082.
31.
WuJHWangSCTsaiHH. Falling in love with online games: the uses and gratifications perspective. Computers in Human Behavior2010; 26: 1862–1871.
32.
McClellandD. The achieving society. New York: Free Press, 1961.
33.
McClellandD. Human motivation. Cambridge, UK: Cambridge University Press, 1985.
34.
FagensonEA. Mentoring – who needs it? A comparison of protégés and non protégés needs for power, achievement, affiliation, and autonomy. Journal of Vocational Behaviour1992; 41: 48–60.
35.
LynnM. National character and tipping customs: the needs for achievement, affiliation and power as predictors of the prevalence of tipping. Hospitality Management2000; 19: 205–210.
36.
ShockleyKMAllenT. Investigating the missing link in flexible work arrangement utilization: an individual difference perspective. Journal of Vocational Behavior2010; 76: 131–142.
37.
ZubriggenELSturmanTS. Linking motives and emotions: a test of McClelland’s hypotheses. Personality and Social Psychology Bulletin2002; 28: 521–535.
38.
SweetserPWyethP. GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment2005; 3. Available at http://doi.acm.org/10.1145/1077246.1077253.
39.
LazzaroNKeekerK. What’s my method? A game show on games. In: Dykstra-EricksonETscheligiM (eds), Proceedings of the 2004 Conference on Human Factors in Computing Systems Extended Abstracts. New York: ACM Press, 2004, pp. 1093–1094.
40.
QinHRauPPSalvendyG. Effects of different scenarios of game difficulty on player immersion. Interacting with Computers2010; 22: 230–239.
41.
GohDHAngRPTanHC. Strategies for designing effective psychotherapeutic gaming interventions for children and adolescents. Computers in Human Behavior2008; 24: 2217–2235.
42.
MaloneTW. Toward a theory of intrinsically motivating instruction. Cognitive Science1981; 4: 333–369.
43.
BrockmyerJHFoxCMCurtissKAMcBroomEBurkhartKMPidruznyJN. The development of the Game Engagement Questionnaire: a measure of engagement in video game-playing. Journal of Experimental Social Psychology2009; 45: 624–634.
44.
CsikszentmihalyiM. Flow: the psychology of optimal experience. New York: Harper Perennial, 1990.
45.
JennettCCoxALCairnsPDhopareeSEppsATijsTWaltonA. Measuring and defining the experience of immersion in games. International Journal of Human–Computer Studies2008; 66: 641–661.
46.
PagulayanRJKeekerKWixonDRomeroRFullerT. User-centered design in games. In: JackoJSearsA (eds) Handbook for human–computer interaction in interactive systems. Mahwah, NJ: Lawrence Erlbaum Associates, 2002, pp. 883–906.
47.
SteersRMBraunsteinDN. A behaviorally based measure of manifest needs in work settings. Journal of Vocational Behavior1976; 9: 251–266.
48.
MillsMJ. Associations among achievement measures and their collective prediction of work involvement. Personality and Individual Differences2011; 50: 360–364.
49.
SubramaniamNMcManusLMiaL. Enhancing hotel managers’ organizational commitment: an investigation of the impact of structure, need for achievement and participative budgeting. Hospitality Management2002; 21: 303–320.
50.
GohDHChuaALeeCSRazikinK. Resource discovery through social tagging: a classification and content analytic approach. Online Information Review2009; 33: 568–583.
51.
LuCParkJRHuX. User tags versus expert-assigned subject terms: a comparison of LibraryThing tags and Library of Congress Subject Headings. Journal of Information Science2010; 36: 763–779.
52.
GohDHLeeCSChuaAYK. Do games motivate mobile content sharing? In: ChowdhuryGKhooCHunterJ (eds) Proceedings of the 12th International Conference on Asia-Pacific Digital Libraries. Lecture Notes in Computer Science 6102. Berlin: Springer, 2010, pp. 61–70.
53.
LinHF. Effects of extrinsic and intrinsic motivation on employee knowledge sharing intentions. Journal of Information Science2007; 33: 135–149.
