On the potential for human-centered,cognitively inspired AI to bridge the gap between optimism and reality for autonomous robotics in healthcare: a respectful critique

Abstract

Historically, the fields of computer science, cognitive science, and neuroscience have been tightly linked. To date, this collaboration has yielded major advances in how the brain and mind are understood, as well as the ways in which artificial minds can be constructed to serve as new collaborators to humans. Yet there are still significant gaps between the capabilities of state-of-the-art autonomous robots and the expectations developed by real users who are now encountering autonomous robots on the job. We present our views as well as a case study of our evaluation of two autonomous robots intended to aid nurses within hospital settings: Moxi and TUG. Both cobots were originally considered for procurement by our collaborating healthcare system,UHS, at which time our team began the process of trying to systematically vet each option to aid in the decision making process. What we found was a lack of evidence on either platform in academic literature, which led us to analyze user comments on social media. In order to improve the fit of autonomous robots into human environments, research must be conducted and evidence must be shared, and the Human Factors community can aid in this effort

Keywords

Cognitively Plausible AI Autonomous Robots Cobots Healthcare Nursing 4E Cognition

References

Agre

P. E.

Chapman

(1987). Pengi: an implementation of a theory of activity. In Proceedings of the Sixth National Conference on Artificial Intelligence-Volume 1, 268–272.

Ahn

Brohan

Brown

N. A.

Chebotar

Andres

David

Finn

Gopalakrishnan

Hausman

Herzog

Daniel Hsu

Ibarz

Ichter

Irpan

Jang

E. B.

Ruano

R. J.

Jeffrey

Jesmonth

Joshi

N. J.

(2022). Do As I Can, Not As I Say: Grounding Language in Robotic Affordances. ArXiv Preprint. https://doi.org/10.48550/arxiv.2204.01691

Anderson

J. R.

(2009). How Can the Human Mind Occur in the Physical Universe? Oxford University Press.

Arora

Doshi

(2021). A survey of inverse reinforcement learning: Challenges, methods and progress. Artificial Intelligence, 297, 103500. https://doi.org/10.1016/j.artint.2021.103500

Auksztulewicz

Spitzer

Blankenburg

(2012). Recurrent Neural Processing and Somatosensory Awareness. Journal of Neuroscience, 32(3), 799–805. https://doi.org/10.1523/jneurosci.3974-11.2012

Babalola

G. T.

Felag

Sarkar

Ertem

Walter

Roberts

M.-C. R.

Tulk Jesso

(2024, March). “HeRoEs WoRk HeRe”: An Exploration of the Impact of Pandemic Virtue Signaling on Nursing Culture. 2024 HFES International Symposium on Human Factors and Ergonomics in Health Care, Chicago, IL.

Babalola

G. T.

Gaston

J.-M.

Trombetta

Tulk Jesso

(n.d.). A Systematic Review of Collaborative Robots for Nurses: Where are we now, and where is the evidence? Front. Robot. AI. (working paper).

Baumgartner

Zannettou

Keegan

Squire

Blackburn

(2020). The Pushshift Reddit Dataset. Proceedings of the International AAAI Conference on Web and Social Media, 14, 830–839. https://doi.org/10.1609/icwsm.v14i1.7347

Bonett

J. B.

(2022, May 24). Meet “Moxi” – Robotic Hospital Helper to Give Nurses More Time to Do What They Do Best. ChristianaCare News. https://news.christianacare.org/2022/05/meet-moxi-robotic-hospital-helper-to-give-nurses-more-time-to-do-what-they-do-best/

10.

Bröhl

Nelles

Brandl

Mertens

Nitsch

(2019). Human–Robot Collaboration Acceptance Model: Development and Comparison for Germany, Japan, China and the USA. International Journal of Social Robotics, 11(5), 709–726. https://doi.org/10.1007/s12369-019-00593-0

11.

Bueno-Guerra

(2018). How to apply the concept of Umwelt in the evolutionary study of cognition. Frontiers in Psychology, 9(OCT), 414563. https://doi.org/10.3389/FPSYG.2018.02001/BIBTEX

12.

Carney

(2020). Thinking avant la lettre: A Review of 4E Cognition. Evolutionary Studies in Imaginative Culture, 4(1), 77–90. https://doi.org/10.26613/esic/4.1.172

13.

de Graaf

M. M. A.

Ben Allouch

(2013). Exploring influencing variables for the acceptance of social robots. Robotics and Autonomous Systems, 61(12), 1476–1486. https://doi.org/10.1016/j.robot.2013.07.007

14.

Ding

Zhang

Paxton

Zhang

(2023). Task and Motion Planning with Large Language Models for Object Rearrangement. arXiv preprint. https://doi.org/10.1109/iros55552.2023.10342169

15.

Elprama

S. A.

Jewell

C. I. C.

Jacobs

El Makrini

Vanderborght

(2017). Attitudes of Factory Workers towards Industrial and Collaborative Robots. Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction - HRI ’17. https://doi.org/10.1145/3029798.3038309

16.

Epley

Waytz

Cacioppo

J. T.

(2007). On Seeing human: a three-factor Theory of anthropomorphism. Psychological Review, 114(4), 864–886.

17.

Frijda

(1986). The emotions. Cambridge: Cambridge University Press.

18.

Gebicke-Haerter

P. J.

(2023). The computational power of the human brain. Frontiers in Cellular Neuroscience, 17.

19.

Graetz

Michaels

(2018). Robots at Work. The Review of Economics and Statistics, 100(5), 753–768. https://doi.org/10.1162/rest_a_00754

20.

Greene

C. M.

(n.d.). Utilizing Cobotics in Pharmaceutical Packaging. Industrial and Systems Engineering Research Conference (ISERC 2024). Institute of Industrial and Systems Engineering, Montreal, QC.

21.

Guerguiev

Lillicrap

T. P.

Richards

B. A.

(2017). Towards deep learning with segregated dendrites. ELife, 6. https://doi.org/10.7554/elife.22901

22.

Hadfield-Menell

Dragan

Abbeel

Russell

(2016, November 12). Cooperative Inverse Reinforcement Learning. ArXiv.org. https://doi.org/10.48550/arXiv.1606.03137

23.

Hancock

(2014). A Primer on Touch. Pages.jh.edu; Johns Hopkins Magazine - September 1996 Issue. https://pages.jh.edu/jhumag/996web/touch.html

24.

Hassabis

Kumaran

Summerfield

Botvinick

(2017). Neuroscience-Inspired Artificial Intelligence. Neuron, 95(2), 245–258. https://doi.org/10.1016/j.neuron.2017.06.011

25.

Ignatieva

E. V.

Levitsky

V. G.

Yudin

N. S.

Moshkin

M. P.

Kolchanov

N. A.

(2014). Genetic basis of olfactory cognition: extremely high level of DNA sequence polymorphism in promoter regions of the human olfactory receptor genes revealed using the 1000 Genomes Project dataset. Frontiers in Psychology, 5. https://doi.org/10.3389/fpsyg.2014.00247

26.

Issa

E. B.

Cadieu

C. F.

DiCarlo

J. J.

(2018). Neural dynamics at successive stages of the ventral visual stream are consistent with hierarchical error signals. ELife, 7. https://doi.org/10.7554/elife.42870

27.

Johnson

(2022, April 19). Hospital Robots Are Helping Combat a Wave of Nurse Burnout. Wired. https://www.wired.com/story/moxi-hospital-robot-nurse-burnout-health-care/

28.

Kannampallil

Smyth

J. M.

Jones

Payne

P. R. O.

(2020). Cognitive plausibility in voice-based AI health counselors. Npj Digital Medicine, 3(1). https://doi.org/10.1038/s41746-020-0278-7

29.

Kennedy

W. G.

(2009). “Cognitive Plausibility” in Cognitive Modeling, Artificial Intelligence, and Social Simulation. Proceedings of the International Conference on Cognitive Modeling (ICCM), Manchester, UK.

30.

Kim

M. J.

Kohn

Shaw

(2020). Does Long-Term Exposure To Robots Affect Mind Perception? An Exploratory Study. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64(1), 1820–1824. https://doi.org/10.1177/1071181320641438

31.

LeCun

Bengio

Hinton

(2015). Deep Learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539

32.

(2020). Openai’s gpt-3 language model: A technical overview. Blog Post.

33.

Markram

(2012). The human brain project. Scientific American, 306(6), 50-55.

34.

Meltzoff

A. N.

(1999). Origins of theory of mind, cognition and communication. Journal of Communication Disorders, 32(4), 251–269. https://doi.org/10.1016/s0021-9924(99)00009-x

35.

Molday

R. S.

Moritz

O. L.

(2015). Photoreceptors at a glance. Journal of Cell Science, 128(22), 4039–4045. https://doi.org/10.1242/jcs.175687

36.

Newell

Shaw

J. C.

Simon

H. A.

(1958). Elements of a theory of human problem solving. Psychological Review, 65(3), 151–166. https://doi.org/10.1037/h0048495

37.

Newen

De Bruin

Gallagher

(2018). The Oxford Handbook of 4E Cognition. Oxford University Press.

38.

Pauliková

Gyurák Babeľová

Ubárová

(2021). Analysis of the Impact of Human–Cobot Collaborative Manufacturing Implementation on the Occupational Health and Safety and the Quality Requirements. International Journal of Environmental Research and Public Health, 18(4), 1927. https://doi.org/10.3390/ijerph18041927

39.

Pujol

Nouvian

Lenoir

(2016, September 19). Hair cells | Cochlea. Journey into the world of hearing. Www.Cochlea.eu. https://www.cochlea.eu/en/hair-cells

40.

Rabinowitz

Perbet

Song

Zhang

Eslami

S. M. A.

Botvinick

(2018, July 3). Machine Theory of Mind. Proceedings.mlr.Press; PMLR. https://proceedings.mlr.press/v80/rabinowitz18a.html

41.

Rai

Constantinides

Sarker

(2019). Next-Generation Digital Platforms: Toward Human–AI Hybrids. Management Information Systems Quarterly, 43(1).

42.

Reddit. (2023, September 18). R/Nursing. Www.reddit.Com. https://www.reddit.com/r/Nursing

43.

Repko

(2021, December 27). The robot work force isn’t coming. It’s already here. CNBC. https://www.cnbc.com/2021/12/27/the-robot-work-force-isnt-coming-its-already-here-.html

44.

Rumelhart

D. E.

Hinton

G. E.

Williams

R. J.

(1986). Learning representations by back-propagating errors. Nature, 323(6088), 533–536. https://doi.org/10.1038/323533a0

45.

Russell

S. J.

(2019). Human compatible : artificial intelligence and the problem of control. Viking.

46.

Summerfield

M. R.

Seagull

F. J.

Vaidya

Xiao

(2011). Use of pharmacy delivery robots in intensive care units. American Journal of Health-System Pharmacy, 68(1), 77–83. https://doi.org/10.2146/ajhp100012

47.

Teng

Ding

See

K. C.

(2022). Use of Robots in Critical Care: Systematic Review. Journal of Medical Internet Research, 24(5). https://doi.org/10.2196/33380

48.

Thomason

Shridhar

Bisk

Paxton

Zettlemoyer

(2022, January 11). Language Grounding with 3D Objects. Proceedings.mlr.Press; PMLR. https://proceedings.mlr.press/v164/thomason22a.html

49.

Thomaz

(2023a). Robots in Real Life: Putting HRI to Work. Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. https://doi.org/10.1145/3568162.3578810

50.

Thomaz

(2023b). Robots in the Real World: Putting Robot Learning to Work. Conference on Robot Learning.

51.

Tietze

Mcbride

(2020). ROBOTICS AND THE IMPACT ON NURSING PRACTICE. Maryland: American Nurses Association. https://www.nursingworld.org/~494055/globalassets/innovation/robotics-and-the-impact-on-nursing-practice_print_12-2-2020-pdf-1.pdf

52.

Tulk Jesso

Kennedy

W. G.

Wiese

(2020). Behavioral Cues of Humanness in Complex Environments: How People Engage With Human and Artificially Intelligent Agents in a Multiplayer Videogame. Frontiers in Robotics and AI, 7. https://doi.org/10.3389/frobt.2020.531805

53.

Turja

Oksanen

(2019). Robot Acceptance at Work: A Multilevel Analysis Based on 27 EU Countries. International Journal of Social Robotics, 11(4), 679–689. https://doi.org/10.1007/s12369-019-00526-x

54.

Wang

Sun

Q.-Q.

(2021). A long-range, recurrent neuronal network linking the emotion regions with the somatic motor cortex. Cell Reports, 36(12), 109733. https://doi.org/10.1016/j.celrep.2021.109733

55.

Waytz

Gray

Epley

Wegner

D. M.

(2010). Causes and consequences of mind perception. Trends in Cognitive Sciences, 14(8), 383–388. https://doi.org/10.1016/j.tics.2010.05.006

56.

Waytz

Heafner

Epley

(2014). The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of Experimental Social Psychology, 52, 113–117. https://doi.org/10.1016/j.jesp.2014.01.005

57.

Wilson

H. J.

Daugherty

P. R.

(2018). Collaborative Intelligence: Humans and AI Are Joining Forces. Harvard Business Review. https://hbr.org/2018/07/collaborative-intelligence-humans-and-ai-are-joining-forces

58.

You

Lionel

(2023). Trusting and Working with Robots: A Relational Demography Theory of Preference for Robotic over Human Co-Workers. Deep Blue (University of Michigan). https://doi.org/10.7302/7223

59.

Zech

Haller

Lakani

S. R.

Ridge

Ugur

Piater

(2017). Computational models of affordance in robotics: a taxonomy and systematic classification. Adaptive Behavior, 25(5), 235–271. https://doi.org/10.1177/1059712317726357

60.

Zhang

Ding

Amiri

Yang

Kaminski

Esselink

Zhang

(2023). Grounding Classical Task Planners via Vision-Language Models. ArXiv (Cornell University). https://doi.org/10.48550/arxiv.2304.08587