Can You Trust Your Robot?

Abstract

It is proposed that trust is a critical element in the interactive relations between humans and the automated and robotic technology they create. This article presents (a) why trust is an important issue for this type of interaction, (b) a brief history of the development of human-robot trust issues, and (c) guidelines for input by human factors/ergonomics professionals to the design of human-robot systems with emphasis on trust issues. Our work considers trust an ongoing and dynamic dimension as robots evolve from simple tools to active, sentient teammates.

Keywords

trust robot robotic systems automation deception human-machine systems human-robot interaction

Get full access to this article

View all access options for this article.

References

Asimov

(1942, March). Runaround. Astounding Science Fiction, pp. 94–103.

Asimov

(1985). Robots and empire. New York: Doubleday Books.

Bagheri

Jamieson

G. A.

(2004). The impact of context-related reliability on automation failure detection and scanning behavior. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (vol. 1, pp. 212–217). The Hague, Netherlands: IEEE.

Čapek

(1921). R.U.R. (Rossum’s universal robots). London, UK: Penguin.

Chen

J. Y. C.

Barnes

M. J.

Harper-Sciarini

(2010). Supervisory control of multiple robots: Human-performance issues and user-interface design. IEEE Transactions on Systems, Man, and Cynernetics—Part C: Applications and Reviews, 41, 435–454.

Cosenzo

K. A.

Parasuraman

Novak

Barnes

(2006). Implementation of automation for control of robotic systems. Aberdeen Proving Grounds, MD: U.S. Army Research Laboratory.

Cuevas

H. M.

Fiore

S. M.

Caldwell

B. S.

Strater

(2007). Augmenting team cognition in human-automation teams performing in complex operational environments. Aviation, Space, and Environmental Medicine, 78(5, Section 2), B63–B70.

De Solla Price

(1974). Gears from the Greeks: The Antikythera mechanism. A calendar computer from ca. 80 B.C. Transactions of the American Philosophical Society, New Series, 64(7), 1–70.

Desai

Stubbs

Steinfeld

Yanco

(2009, April). Creating trustworthy robots: Lessons and inspirations from automated systems. Paper presented at the AISB Convention: New Frontiers in Human-Robot Interaction, Edinburgh, Scotland.

10.

Firth

(2010, September 11).The real 2001: Scientists teach robots how to trick humans. Daily Mail. Retrieved from http://www.dailymail.co.uk/sciencetech/article-1310788/The-real-2001-Scientists-teach-robots-trick-humans.html#ixzz1Q3PxZZl2

11.

Gerwehr

Glenn

R. W.

(2000). The art of darkness: Deception and urban operations. Santa Monica, CA: RAND.

12.

Groom

(2008). What’s the best role for robot? Cybernetic models of existing and proposed human-robot interaction structures. In Filipe

Andrade-Cetto

Ferrier

(Eds.), Proceedings of the Fifth International Conference on Informatics in Control, Automation, and Robotics (pp. 323–328). Funchal, Madeira, Portugal: INSTICC Press.

13.

Hamilton

J. E.

Hancock

P. A.

(1986). Robotics safety: Exclusion guarding for industrial operations. Journal of Occupational Accidents, 8, 69–78.

14.

Hancock

P. A.

(2009). Mind, machine, and morality. Chichester, UK: Ashgate.

15.

Hancock

P. A.

Billings

D. R.

Oleson

K. E.

Chen

J. Y. C.

DeVisser

Parasuraman

(in press). A meta-analysis of factors impacting trust in human-robot interaction. Human Factors.

16.

Hancock

P. A.

Pepe

A. A.

Murphy

L. L.

(2005). Hedonomics: The power of positive and pleasurable ergonomics. Ergonomics in Design, 13(1), 8–14.

17.

Hoffman

R. R.

Lee

J. D.

Woods

D. D.

Shadbolt

Miller

Bradshaw

J. M.

(2009). The dynamics of trust in cyberdomains. IEEE Intelligent Systems, 24(6), 5–11.

18.

Lee

J. D.

See

K. A.

(2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46, 50–80.

19.

Neerincx

M. A.

(2007). Modelling cognitive and affective load for the design of human-machine collaboration. In Harris

(Ed.), Engineering psychology and cognitive ergonomics, HCII 2007, LNAI 4562 (pp. 568–574). Berlin, Germany: Springer-Verlag.

20.

Parasuraman

Riley

(1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230–253.

21.

Sarter

N. B.

Woods

D. D.

(1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors, 37, 5–19.

22.

Shannon

C. E.

Weaver

(1949). The mathematical theory of information. Chicago: University of Illinois Press.

23.

Sheridan

T. B.

(2002). Humans and automation: System design and research issues. New York/Santa Monica, CA: Wiley/Human Factors and Ergonomics Society.

24.

Uggirila

Gramopadhye

A. K.

Melloy

B. J.

Toler

J. E.

(2004). Measurement of trust in complex and dynamic systems using a quantitative approach. International Journal of Industrial Ergonomics, 34, 175–186.

25.

Wagner

A. R.

(2009). The role of trust and relationships in human-robot social interaction (Doctoral dissertation). Georgia Institute of Technology, Atlanta.

26.

Wagner

A. R.

Arkin

R. C.

(2011). Acting deceptively: Providing robots with the capacity for deception. International Journal of Social Robotics, 3, 5–26.

27.

Wiener

(1963). God and Golem Inc. Boston, MA: MIT Press.