Mapping 3D Gestural Inputs to Traditional Touchscreen Interface Designs within the Context of Anesthesiology

Abstract

Gestures are a natural means of every day human-human communication, and with the advances in gestural input technology, there is an opportunity to investigate gestures as a means of communicating with computers and other devices. The primary benefit of gestural input technology is that it facilitates a touchless interaction, so the ideal market demand for this technology is an environment where touch needs to be minimized. The perfect example of an environment that discourages touch are sterile or clean environments, such as operating rooms (ORs). Healthcare-associated infections are a great burden to the healthcare system, and gestural input technology can decrease the number of surfaces, computers, and other devices that a healthcare provider comes in contact with, thus reducing the likelihood of bacterial contamination. The objective of this research was to map 3D gestural inputs to traditional touchscreen interface designs within the context of anesthesiology. An experimental study was conducted to elicit intuitive gestures from users and assess the cognitive complexity of ten typical functions of anesthesia providers. Intuitive gestures were observed in six out of the ten functions without any cognitive complexity concerns. Two functions, of the remaining four, demonstrated a higher-level gesture mapping with no cognitive complexity concerns. Overall, gestural input technology demonstrated promise for the ten functions of anesthesia providers in the operating room, and future research will continue investigating the application of gestural input technology for anesthesiology in the OR.

References

Ardito

Costabile

M. F.

Jetter

H.-C.

(2014). Gestures that people can understand and use. Journal of Visual Languages & Computing, 25(5), 572–576.

Bates

Mächler

Bolker

Walker

(2014). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1).

Baudel

Beaudouin-Lafon

(1993). Charade: remote control of objects using free-hand gestures. Communications of the ACM, 36(7), 28–35.

Betza

S. M.

Jurewicz

K. A.

Neyens

D. M.

Riggs

S. L.

Abernathy

J. H.

Reeves

S. T.

(2016). Anesthesia Maintenance and Vigilance. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 60, pp. 608–612). SAGE Publications.

Bizzotto

Costanzo

Bizzoto

Regis

Sandri

Magnan

(2014). Leap motion gesture control with OsiriX in the operating room to control imaging: first experiences during live surgery. Surgical Innovation, 1.

Efron

(1972). Gesture, race and culture. Mouton The Hague.

Horsky

Kaufman

D. R.

Oppenheim

M. I.

Patel

V. L.

(2003). A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. Journal of Biomedical Informatics, 36(1), 4–22.

Hurka

Wenger

Heininger

Lueth

T. C.

(2011). Method, accuracy and limitation of computer interaction in the operating room by a navigated surgical instrument. In 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 2144–2147). IEEE.

Jacob

M. G.

Wachs

J. P.

Packer

R. A.

(2013). Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images. Journal of the American Medical Informatics Association, 20(1), 183–186.

10.

Karam

Schraefel

M. C.

(2005). A Taxonomy of Gestures in Human Computer Interactions. University of Southampton. Computing Service.

11.

Loftus

R. W.

Brown

J. R.

Koff

M. D.

Reddy

Heard

S. O.

Patel

H. M.

. . . Jensen

J. T.

(2012). Multiple reservoirs contribute to intraoperative bacterial transmission. Anesthesia & Analgesia, 114(6), 1236–1248.

12.

Mewes

Saalfeld

Riabikin

Skalej

Hansen

(2016). A gesture-controlled projection display for CT-guided interventions. International Journal of Computer Assisted Radiology and Surgery, 11(1), 157–164.

13.

Miller

R. D.

Pardo

(2011). Basics of Anesthesia (6th ed.). Philadelphia, PA: Elsevier.

14.

Morris

M. R.

Wobbrock

J. O.

Wilson

A. D.

(2010). Understanding users’ preferences for surface gestures. In Proceedings of graphics interface 2010 (pp. 261–268). Canadian Information Processing Society.

15.

Nielsen

Störring

Moeslund

Granum

(2004). A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In Camurri

Volpe

(Eds.), Gesture-Based Communication in Human-Computer Interaction SE - 38 (Vol. 2915, pp. 409–420). Springer Berlin Heidelberg.

16.

Pereira

Wachs

J. P.

Park

Rempel

(2015). A user-developed 3-D hand gesture set for human–computer interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society, 57(4), 607–621.

17.

Stackhouse

R. A.

Beers

Brown

Greene

McCann

M. E.

Tompkins

B. M.

(2011). Recommendations for Infection Control for the Practice of Anesthesiology. American Society of Anesthesiologists (3rd ed.). Park Ridge, IL.

18.

Wachs

J. P.

Stern

H. I.

Edan

Gillam

Handler

Feied

Smith

(2008). A gesture-based tool for sterile browsing of radiology images. Journal of the American Medical Informatics Association, 15(3), 321–323.

19.

Wigdor

Wixon

(2011). Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier.

20.

World Health Organization. (2009). WHO guidelines on hand hygiene in health care: first global patient safety challenge. Clean care is safer care. World Health Organization.