One of the difficulties in creating a team-focused intelligent tutoring system (ITS) is defining the measures used to assess the team’s performance. While the team research literature offers nine C’s of teamwork to consider, e.g., cooperation, communication, etc., it can also be difficult to implement these in real-world practice. This paper reviews the approach used in three team ITSs in which the C’s were used, offering guidance for future implementation of team tutors.
References
1.
AlevenV.McLarenB. M.SewallJ.KoedingerK. R. (2009). A new paradigm for intelligent tutoring systems: Example-tracing tutors. International Journal of Artificial Intelligence in Education, 19(2), 105-154.
2.
BanduraA. (2006). Guide for Constructing Self-Efficacy Scales. In PajaresF.UrdanT. (Eds.), Self-Efficacy Beliefs of Adolescents (307-337). USA: Information Age Publishing.
3.
BlessingS.DevasaniS.GilbertS.SinapovJ. (2015). Using ConceptGrid as an Easy Authoring Technique to Check Natural Language Responses. International Journal of Learning Technology, 10(1), 50-70.
4.
BonnerD.GilbertS.DorneichM. C.WinerE.SinatraA. M.SlavinaA.MacAllisterA.HolubJ. (2016). The Challenges of Building Intelligent Tutoring Systems for Teams. Paper presented at the Human Factors & Ergonomics Society (HFES) Annual Meeting, Washington, D.C.
5.
BonnerD.WaltonJ.DorneichM. C.GilbertS. B.WinerE.SottilareR. A. (2015). The Development of a Testbed to Assess an Intelligent Tutoring System for Teams. In Proceedings of the Workshops at AIED 2015. Madrid, Spain.
6.
ChorneyJ. M.McMurtryC. M.ChambersC. T.BakemanR. (2015). Developing and Modifying Behavioral Coding Schemes in Pediatric Psychology: A Practical Guide. Journal of Pediatric Psychology, 40(1), 154–164. http://doi.org/10.1093/jpepsy/jsu099
7.
LambC.LambJ.StevensR.CarasA. (2014, June). Team Behaviors and Cognitive Cohesion in Complex Situations. In International Conference on Augmented Cognition (pp. 136-147). Springer International Publishing.
8.
OlguínD. O.WaberB. N.KimT.MohanA.AraK.PentlandA. (2009). Sensible Organizations: Technology and Methodology for Automatically Measuring Organizational Behavior. IEEE Transactions on Systems, Man, and Cybernetcis-Part B: Cybernetics, 39(1), 43-55. http://doi.org/10.1109/tsmcb.2008.2006638
9.
PorterC. O.HollenbeckJ. R.IlgenD. R.EllisA. P.WestB. J.MoonH. (2003). Backing up behaviors in teams: the role of personality and legitimacy of need. Journal of Applied Psychology, 88(3), 391.
10.
SalasE.ShufflerM. L.ThayerA. L.BedwellW. L.LazzaraE. H. (2015). Understanding and improving teamwork in organizations: A scientifically based practical guide. Human Resource Management, 54(4), 599-622.
11.
SottilareR. A.BrawnerK. W.GoldbergB. S.HoldenH. K. (2012). The Generalized Intelligent Framework for Tutoring (GIFT). Concept paper released as part of GIFT software documentation. Orlando, FL: US Army Research Laboratory–Human Research & Engineering Directorate (ARL-HRED).
12.
SottilareR. A.BurkeC. S.SalasE.SinatraA. M.JohnstonJ.GilbertS. B. (in press). Designing Adaptive Instruction for Teams: A Meta-Analysis. International Journal for Artificial Intelligence in Education.
13.
WaltonJ.DorneichM. C.GilbertS.BonnerD.WinerE.RayC. (2014). Modality and timing of team feedback: Implications for GIFT. In Generalized Intelligent Framework for Tutoring (GIFT) Users Symposium (GIFTSym2) (pp. 199-207).