Trust in the Team as a Function of Trust in Individual Agents: Scale Validation and Modeling

Abstract

With the growing adoption of autonomous technologies across various domains, an increasing number of studies have explored collaborations between humans and agents working together to achieve shared goals, forming human-agent teams (HATs). While much of the research has focused on dyadic relationships involving a single human and a single agent, the current study examines multi-human multi-agent teams where multiple humans and agents collaborate to achieve team goals. The shift from dyadic to more complex teams makes research topics studied in triadic or larger human-human teams relevant to HATs. Of particular interest in this study is the concept of “trust in team” and its relationships with trustor and trustee characteristics. The study used an adapted version of the Blocks World for Teams (BW4T) testbed, where a team of four (two humans and two agents) performs a collaborative block-moving task. This study first validated the use of the existing interpersonal trust scale and team trust scale for evaluating trust in human/agent teammates and in the team, respectively. The next step involved examining how trust in the team is formed in relation to trust in individual teammates. Additionally, the associations between team trust, communication, and performance were investigated.

Keywords

trust human-agent team human-autonomy interaction human-agent interaction team trust team communication team performance human-agent collaboration teamwork multi-agent

Get full access to this article

View all access options for this article.

References

Bhat

Lyons

J. B.

Shi

Yang

X. J.

(2024a). Evaluating the impact of personalized value alignment in human-robot interaction: Insights into trust and team performance outcomes. Proceedings of the 2024 ACM/IEEE international conference on human-robot interaction (pp. 32–41). ACM/IEEE.

Bhat

Lyons

J. B.

Shi

Yang

X. J.

(2024b). Value alignment and trust in human-robot interaction: Insights from simulation and user study. In Discovering the frontiers of human-robot interaction: Insights and innovations in collaboration, communication, and control (pp. 39–63). Springer.

Chung

Holder

Shah

J. A.

Yang

(2024). Developing a team classification scheme for human-agent teaming. In Proceedings of the human factors and ergonomics society annual meeting. SAGE Publications.

Chung

Yang

X. J.

(2024a). Associations between trust dynamics and personal characteristics. In 2024 IEEE 4th international conference on human-machine systems (ICHMS) (pp. 1–6). IEEE.

Chung

Yang

X. J.

(2024b). Predicting trust dynamics with personal characteristics. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 68, pp. 310–316). SAGE Publications.

Colquitt

J. A.

LePine

J. A.

Zapata

C. P.

Wild

R. E.

(2011). Trust in typical and high-reliability contexts: Building and reacting to trust among firefighters. Academy of Management Journal, 54(5), 999–1015.

Costa

A. C.

(2003). Work team trust and effectiveness. Personnel Review, 32(5), 605–622.

Costa

A. C.

Anderson

(2011). Measuring trust in teams: Development and validation of a multifaceted measure of formative and reflective indicators of team trust. European Journal of Work and Organizational Psychology, 20(1), 119–154.

De Jong

B. A.

Dirks

K. T.

Gillespie

. (2016). Trust and team performance: A meta-analysis of main effects, moderators, and covariates. Journal of Applied Psychology, 101(8), 1134.

10.

Demir

Canan

Cohen

M. C.

(2023). Modeling team interaction and decision-making in agile human–machine teams: Quantum and dynamical systems perspective. IEEE Transactions on Human-Machine Systems, 53(4), 720–730.

11.

Dirks

K. T.

(1999). The effects of interpersonal trust on work group performance. Journal of Applied Psychology, 84(3), 445.

12.

Fulmer

C. A.

Gelfand

M. J.

(2012). At what level (and in whom) we trust: Trust across multiple organizational levels. Journal of Management, 38(4), 1167–1230.

13.

Guo

Yang

X. J.

Shi

(2024). Tip: A trust inference and propagation model in multi-human multi-robot teams. Autonomous Robots, 48(7), 20.

14.

Johnson

C. J.

Demir

McNeese

N. J.

Gorman

J. C.

Wolff

A. T.

Cooke

N. J.

(2023). The impact of training on human–autonomy team communications and trust calibration. Human Factors, 65(7), 1554–1570.

15.

Johnson

Jonker

Van Riemsdijk

Feltovich

P. J.

Bradshaw

J. M.

(2009, November 18–20). Joint activity testbed: Blocks world for teams (BW4T). In Boissier

Hübner

Sichman

Sudeikat

(Eds.), Engineering societies in the agents world X: 10th International Workshop, ESAW 2009, Utrecht, The Netherlands, Proceedings 10 (pp. 254–256). Springer.

16.

Klein

K. J.

Kozlowski

S. W.

(2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In Klein

K. J.

Kozlowski

S. W.

(Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3–90). Jossey-Bass.

17.

Kramer

R. M.

(1999). Trust and distrust in organizations: Emerging perspectives, enduring questions. Annual Review of Psychology, 50(1), 569–598.

18.

Lyons

J. B.

Sycara

Lewis

Capiola

(2021). Human–autonomy teaming: Definitions, debates, and directions. Frontiers in Psychology, 12, Article 702355.

19.

McAllister

D. J.

(1995). Affect-and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of management Journal, 38(1), 24–59.

20.

Meyerson

(1996). Swift trust and temporary groups. In Kramer

R. M.

Tyler

T. R.

(Eds.), Trust in organizations: Frontiers of theory and research (pp. 166–195). SAGE Publications.

21.

O’Neill

McNeese

Barron

Schelble

(2022). Human–autonomy teaming: A review and analysis of the empirical literature. Human Factors, 64(5), 904–938.

22.

PytlikZillig

L. M.

Votruba

A. M.

Fleig-Palmer

M. M.

Lee

Kappmeier

(2024). The perceived influence model of trust: toward a multi-trustee theory. Group & Organization Management, 49(2), 395–428.

23.

Song

Soria Zurita

N.F.

Gyory

J.T.

Zhang

McComb

Cagan

Stump

Martin

Miller

Balon

Yukish

(2022). Decoding the agility of artificial intelligence-assisted human design teams. Design Studies, 79, Article 101094.

24.

Wildman

J. L.

Nguyen

Thayer

A. L.

Robbins-Roth

V. T.

Carroll

Carmody

Ficke

Akib

Addis

(2024). Trust in human-agent teams: A multilevel perspective and future research agenda. Organizational Psychology Review, 14(3), 373–402.