Constraint-Directed Performance Measurement for Large Tactical Teams

Abstract

Large tactical teams must demonstrate integrative performance as tens to thousands of operators perform within highly dynamic, complex, and unpredictable environments. The development of methods for capturing integrated performance and the achievement of team goals, while also allowing for and even embracing adaptive performance, is challenging. However, as Distributed Mission Training (DMT) systems continue to mature and are increasingly representative of important training opportunities in the military, diagnostic performance assessment systems are needed to ensure training quality. In this paper, we propose a methodological framework for team performance that is responsive to the performance measurement challenges found within DMT systems. The approach is illustrated within a U.S. Navy research and development program called Debriefing Distributed Simulation-Based Exercises (DDSBE).

Get full access to this article

View all access options for this article.

References

Bergondy

Fowlkes

Gualtieri

Salas

(1998). Key team competencies for navy air wings: A case study. Proceedings of the 20th Annual Interservice Industry Training, Simulation and Education Conference (pp. 835–842).

Brobst

W. D.

Geis

L. A.

Brown

A. C.

(1999). NSAWC Aircrew training study: Methodology and analysis (CRM 98–171) Alexandria, VA: Center for Naval Analysis.

Carolan

T. F.

Bilizarian

(2004). Automated collection and assessment for debriefing distributed simulation-based exercises. Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 2567–2571). Santa Monica, CA: Human Factors and Ergonomics Society.

Fleishman

E. I.

Zaccaro

S. J.

(1992). Toward a taxonomy of team performance functions. In Swezey

R. W.

Salas

Teams: Their Training and Performance. Norwood, NJ: Ablex Publishing Company.

Naikar

Lintern

Sanderson

P. M.

(2002). Cognitive work analysis for air defense applications in Australia. In McNeese

M. D.

Vidulich

M. A.

, Cognitive Systems Engineering in Military Aviation Environments: Avoiding Cogminutia Fragmentosa Human Systems Information Analysis Center. Wright Patterson Air Force Base, Dayton, Ohio.

Salas

Dickinson

T. L.

Converse

S. A.

Tannenbaum

S. I.

(1992). Toward an understanding of team performance and training. In Swezey

R. W.

Salas

Teams: Their training and performance(pp. 3–29). Norwood, NJ: Ablex.

Stretton

M. L.

Wilson

M. S.

(2004). Semi-automated observation and assessment-trainer interaction within a distributed training environment. Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 2572–2576). Santa Monica, CA: Human Factors and Ergonomics Society.

Vicente

K. J.

(1999). Cognitive work analysis: Toward safe, productive, and healthy computer-based work. Mahwah, NJ: Lawrence Erlbaum Associates.

Vicente

K. J.

Rasmussen

(1992). Ecological interface design: Theoretical foundations. IEEE Transactions on Systems, Man and Cybernetics (SMC-22, 589–606).