Development of a Behavioral Marker System to Assess Intensive Care Unit Team Performance

Abstract

Teamwork plays a pivotal role in ensuring the quality and safety of care delivery in the intensive care unit (ICU). The measurement of these skills, therefore, is paramount to quantifying performance, providing developmental feedback, and evaluating the impact of initiatives to improve performance. The purpose of this paper is to detail the development of a theoretically-driven and context-driven approach to the measurement of teamwork skills in critical care.

References

American Institutes for Research. (2010). TeamSTEPPS teamwork perceptions questionnaire (T-TPQ) manual. Washington, DC: American Institutes for Research.

ANTS. (2012). ANTS: A behavioural marker system for rating anaesthetists’ non-technical skills. Retrieved from http://www.abdn.ac.uk/iprc/ants/

Baker

D. P.

Salas

(1992). Principles for measuring teamwork skills. Human Factors, 34(4), 469-475.

Brannick

M.T.

Prince

Salas

(1995). The measurement of team process. Human Factors, 37(3), 641-651.

Buljac-Samardzic

Dekker-van Doorn

C. M.

van Wijngaarden

J. D.

van Wijk

K. P.

(2010). Interventions to improve team effectiveness: A systematic review. Health Policy (Amsterdam, Netherlands), 94(3), 183-195. doi:10.1016/j.healthpol.2009.09.015; 10.1016/j.healthpol.2009.09.015

Burke

C. S.

Stagl

K. C.

Klein

Goodwin

G. F.

Salas

Halpin

S. M.

(2006). What type of leadership behaviors are functional in teams? A meta analysis. The Leadership Quarterly, 17(3), 288-307. doi:10.1016/j.leaqua.2006.02.007

Cannon-Bowers

J. A.

Tannenbaum

S. I.

Salas

Volpe

C. E.

(1995). Defining competencies and establishing team training requirements. In Guzzo

Salas

(Eds.), Team effectiveness and decision making in organizations (pp. 333-380). San Francisco,CA: Jossey-Bass.

Crossley

Marriott

Purdie

Beard

J. D.

(2011). Prospective observational study to evaluate NOTSS (non-technical skills for surgeons) for assessing trainees’ non-technical performance in the operating theatre. The British Journal of Surgery, 98(7), 1010-1020. doi:10.1002/bjs.7478; 10.1002/bjs.7478

Dietz

A.S.

Pronovost

P.J.

Benson

K.N.

Mendez-Tellez

P.A.

Dwyer

Wyskiel

Rosen

M.A.

(2014a). A systematic review of behavioral marker systems in healthcare: What do we know about their attributes, validity, and application? BMJ Quality and Safety, 23(12), 1031-1039. doi:10.1136/bmjqs-2013-002457.

10.

Dietz

A.S.

Pronovost

P.J.

Mendez-Tellez

P.A.

Wyskiel

Marsteller

J.A.

Thompson

D.A.

Rosen

M.A.

(2014b). A systematic review of teamwork in the ICU: What do we know about teamwork, team tasks, and improvement strategies? Journal of Critical Care, 29(6), 908-914. doi: 10.1016/j.jcrc.2014.05.025.

11.

Flanagan

J. C.

(1954). The critical incident technique. Psychological Bulletin, 51(4), 327-358. doi:10.1037/h0061470

12.

Flin

Martin

(2001). Behavioral markers for crew resource management: A review of current practice. The International Journal of Aviation Psychology, 11(1), 95-118.

13.

Hackman

J. R.

(2002). Leading teams: Setting the stage for great performances. Boston, MA: Harvard Business School Publishing Corporation.

14.

LePine

J. A.

Piccolo

R. F.

Jackson

C. L.

Mathieu

J. E.

Saul

J. R.

(2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personnel Psychology, 61, 273-307.

15.

Marks

M. A.

Mathieu

J. E.

Zaccaro

(2001). A temporally based framework and taxonomy of team processes. The Academy of Management Review, 26(3), 356-376. NOTSS. (2012). NOTSS: Non-technical skills for surgeons. Retrieved from http://www.abdn.ac.uk/iprc/notss

16.

Reader

T. W.

Flin

Cuthbertson

B. H.

(2011). Team leadership in the intensive care unit: The perspective of specialists. Critical Care Medicine, 39(7), 1683-1691. doi:10.1097/CCM.0b013e318218a4c7; 10.1097/CCM.0b013e318218a4c7

17.

Reader

T. W.

Flin

Mearns

Cuthbertson

B. H.

(2009). Developing a team performance framework for the intensive care unit. Critical Care Medicine, 37(5), 1787-1793. doi:10.1097/CCM.0b013e31819f0451; 10.1097/CCM.0b013e31819f0451

18.

Salas

Rosen

M. A.

Burke

C. S.

Goodwin

G. F.

(2009). The wisdom of the collectives in organizations: An update of the teamwork competencies. In Salas

Goodwin

G. F.

Burke

C. S.

(Eds.), Team effectiveness in complex organizations (pp. 39-79). New York, NY: Routledge.

19.

Salas

Rosen

M. A.

Burke

C. S.

Nicholson

Howse

W. R.

(2007). Markers for enhancing team cognition in complex environments: The power of team performance diagnosis. Aviation, Space, and Environmental Medicine, 78(5), B77-B85.

20.

Salas

Sims

D. E.

Burke

C. S.

(2005). Is there a “big five" in teamwork? Small Group Research, 36(5), 555-599. doi:10.1177/1046496405277134

21.

Smith-Jentsch

K. A.

Zeisig

R. L.

Acton

McPherson

J. A.

(1998). Team dimensional training: A strategy for guided team self-correction. In Cannon-Bowers

J. A.

Salas

(Eds.), Making decisions under stress: Implications for individual and team training (pp. 271-297). Washington, DC: American Psychological Association.

22.

Wilson

K. A.

Salas

Priest

H. A.

Andrews

(2007). Errors in the heat of battle: Taking a closer look at shared cognition breakdowns through teamwork. Human Factors, 49(2), 243-256.

23.

Zaccaro

S. J.

Rittman

A. L.

Marks

M. A.

(2002). Team leadership. The Leadership Quarterly, 12, 451-483.