“U” in User Experience (UX) Stands for the Frontline Employee: A Case Study of Voice Assistant Technology Use in Hotels

Abstract

This case focuses on voice assistant technology, one of the AI-based service technologies in hotels, which transforms service employees’ work environments and hotel guests’ experiences. The application of AI-based technologies in the service industry has been widespread and provided various advantages to customers and organizations. However, at the same time, the adoption accompanied technology challenges that influenced successful operation and management. Drawing from the previous literature and the current issues related to voice assistant technology, this case study presents the four potential challenges that service employees may encounter in the use of the technology in the lodging industry with imaginary scenarios considering each situation so that the organizers can fully take advantage of voice assistant technology by avoiding the threats: (1) Privacy concern; (2) Ease of use; (3) Efficiency; and (4) Customer service.

Keywords

voice assistant technology artificial intelligence technology amenities user experience employee engagement privacy concern ease of use efficiency customer service

Get full access to this article

View all access options for this article.

References

Ahmad

Scott

(2019). Technology innovations towards reducing hospitality human resource costs in Langkawi, Malaysia. Tourism Review, 74(3), 547–562. https://doi.org/10.1108/TR-03-2018-0038

Alam

(2021). Possibilities and apprehensions in the landscape of artificial intelligence in education [Conference session]. 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA), Nagpur, India, pp. 1–8.

Alsetoohy

Ayoun

Arous

Megahed

Nabil

(2019). Intelligent agent technology: What affects its adoption in hotel food supply chain management? Journal of Hospitality and Tourism Technology, 10(3), 286–310. https://doi.org/10.1108/JHTT-01-2018-0005

Ameen

Tarhini

Shah

Madichie

N. O.

(2020). Going with the flow: Smart shopping malls and omnichannel retailing. Journal of Services Marketing, 35(3), 325–348. https://doi.org/10.1108/JSM-02-2020-0066

Asan

Bayrak

A. E.

Choudhury

(2020). Artificial intelligence and human trust in healthcare: Focus on clinicians. Journal of Medical Internet Research, 22(6), Article e15154. https://doi.org/10.2196/15154

Astuti

Harsono

Uhai

Muthmainah

H. N.

Vandika

A. Y.

(2024). Application of artificial intelligence technology in customer service in the hospitality industry in Indonesia: A literature review on improving efficiency and user experience. Sciences Du Nord Nature Science and Technology, 1(01), 28–36.

Buhalis

Moldavska

(2021). In-room voice-based AI digital assistants transforming on-site hotel services and guests’ experiences. In Information and communication technologies in tourism 2021: Proceedings of the ENTER 2021 eTourism Conference, January 19–22, 2021 (pp. 30–44). Springer International Publishing.

Buhalis

Moldavska

(2022). Voice assistants in hospitality: Using artificial intelligence for customer service. Journal of Hospitality and Tourism Technology, 13(3), 386–403.

Bulchand-Gidumal

William Secin

O’Connor

Buhalis

(2024). Artificial intelligence’s impact on hospitality and tourism marketing: Exploring key themes and addressing challenges. Current Issues in Tourism, 27(14), 2345–2362.

10.

Cai

Cain

L. N.

Jeon

(2022). Customers’ perceptions of hotel AI-enabled voice assistants: does brand matter? International Journal of Contemporary Hospitality Management, 34(8), 2807–2831.

11.

Cain

L. N.

Thomas

J. H.

Alonso

J. M.

(2019). From sci-fi to sci-fact: The state of robotics and AI in the hospitality industry. Journal of Hospitality and Tourism Technology, 10(4), 624–650. https://doi.org/10.1108/JHTT-07-2018-0066

12.

Cao

Sun

Goh

Wang

Kuiavska

(2022). Adoption of smart voice assistants technology among Airbnb guests: A revised self-efficacy-based value adoption model (SVAM). International Journal of Hospitality Management, 101, Article 103124.

13.

Carrier

(2024, September 10). Empowering hospitality employees to deliver beyond service: How technology enhances staff satisfaction and guest experience. Hospitalitynet. https://www.hospitalitynet.org/opinion/4121980.html

14.

Chaudhuri

Chatterjee

Vrontis

Galati

Siachou

(2023). Examining the issue of employee intentions to learn and adopt digital technology. Worldwide Hospitality and Tourism Themes, 15(3), 279–294. https://doi.org/10.1108/WHATT-02-2023-0020

15.

Chen

C.-C. (B.)

Cai

(2024). Are robots stealing our jobs? Examining robot-phobia as a job stressor in the hospitality workplace. International Journal of Contemporary Hospitality Management, 37(1), 94–112. https://doi.org/10.1108/IJCHM-09-2023-1454

16.

Chiang

A.-H.

Trimi

(2020). Impacts of service robots on service quality. Service Business, 14(3), 439–459. https://doi.org/10.1007/s11628-020-00423-8

17.

Choi

Kim

S. (S.)

Badu-Baiden

(2022). Human vs robot baristas during the COVID-19 pandemic: Effects of masks and vaccines on perceived safety and visit intention. International Journal of Contemporary Hospitality Management, 35(2), 469–491. https://doi.org/10.1108/IJCHM-02-2022-0157

18.

Christ-Brendemuhl

(2022). Bridging the gap: An interview study on frontline employee responses to restaurant technology. International Journal of Hospitality Management, 102, 103183.

19.

Davis

F. D.

(1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008

20.

Ding

(2021). Employees’ challenge-hindrance appraisals toward STARA awareness and competitive productivity: A micro-level case. International Journal of Contemporary Hospitality Management, 33(9), 2950–2969.

21.

Teng

Song

(2024). Linking employees’ challenge-hindrance appraisals toward AI to service performance: The influences of job crafting, job insecurity and AI knowledge. International Journal of Contemporary Hospitality Management, 36(3), 975–994. https://doi.org/10.1108/IJCHM-07-2022-0848

22.

Hoang

Tran

H.-A.

(2022). Robot cleaners in tourism venues: The importance of robot-environment fit on consumer evaluation of venue cleanliness. Tourism Management, 93, Article 104611. https://doi.org/10.1016/j.tourman.2022.104611

23.

Horpynich

Mistry

T. G.

Dogan

(2025). Service robots in hospitality: A cognitive appraisal perspective on job insecurity, turnover intentions, and generational differences. Journal of Hospitality and Tourism Technology, 16(1), 194–212. https://doi.org/10.1108/JHTT-03-2024-0189

24.

Huang

Chao

de la Mora Velasco

Bilgihan

Wei

(2021). When artificial intelligence meets the hospitality and tourism industry: An assessment framework to inform theory and management. Journal of Hospitality and Tourism Insights, 5(5), 1080–1100. https://doi.org/10.1108/JHTI-01-2021-0021

25.

Hwang

G.-J.

Chien

S.-Y.

(2022). Definition, roles, and potential research issues of the metaverse in education: An artificial intelligence perspective. Computers and Education: Artificial Intelligence, 3, Article 100082. https://doi.org/10.1016/j.caeai.2022.100082

26.

Insider Intelligence. (2023, January 13). Voice assistants in 2023: Usage, growth, and future of the AI voice assistant market. Insider Intelligence. https://www.insiderintelligence.com/insights/voice-assistants/

27.

International Organization for Standardization. (2010). ISO 9241-210:2010 Ergonomics of human-system interaction – Part 210: Human-centered design for interactive systems. https://www.iso.org/obp/ui/#iso:std:iso:9241:-210:ed-1:v1:en

28.

Ivanov

Seyitoğlu

Markova

(2020). Hotel managers’ perceptions towards the use of robots: A mixed-methods approach. Information Technology & Tourism, 22(4), 505–535. https://doi.org/10.1007/s40558-020-00187-x

29.

Janković

Tomić

Simeunović

Rakić

Stefanović

Lolić

(2019). User experience and customer experience as a solution for gaining competitive advantages of the company [Conference session]. 24th International scientific conference strategic management and decision support systems in strategic management, Subotica, Serbia.

30.

Kang

Shin

Kang

(2024). Hospitality labor leakage and dynamic turnover behaviors in the age of artificial intelligence and robotics. Journal of Hospitality and Tourism Technology, 15(5), 916–933. https://doi.org/10.1108/JHTT-12-2023-0411

31.

Kantamneni

Chatterjee

(2023, June 18). Voice recognition in the hospitality industry. Hospitality Upgrade. https://hospitalityupgrade.com/_magazine/magazine_Detail/

32.

Kaplan

(2024, November 15). What is user experience (and what is it not)? Nielsen Norman Group. https://www.nngroup.com/articles/what-is-user-experience/

33.

Kaplan

Haenlein

(2019). Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business Horizons, 62(1), 15–25. https://doi.org/10.1016/j.bushor.2018.08.004

34.

Karagiannis

(2024, January 14). Common AI implementation challenges in hotels. Medium. https://medium.com/hotel-tech/overcoming-common-ai-implementation-challenges-in-hotels-15881b1d530f

35.

Khaliq

Waqas

Nisar

Q. A.

Haider

Asghar

(2022). Application of AI and robotics in hospitality sector: A resource gain and resource loss perspective. Technology in Society, 68, Article 101807. https://doi.org/10.1016/j.techsoc.2021.101807

36.

Kim

Erdem

Kim

(2024). Hi Alexa, do hotel guests have privacy concerns with you? A cross-cultural study. Journal of Hospitality Marketing & Management, 33(3), 360–383.

37.

Kimachia

(2022, May 31). How improving employee user experience boosts competitive advantage. Enterprise Networking Planet. https://www.enterprisenetworkingplanet.com/management/how-improving-employee-user-experience-boosts-competitive-advantage/

38.

Klaus

Maklan

(2013). Towards a better measure of customer experience. International Journal of Market Research, 55(2), 227–246.

39.

Kumar

Raut

R. D.

Narkhede

B. E.

(2020). A proposed collaborative framework by using artificial intelligence-internet of things (AI-IoT) in COVID-19 pandemic situation for healthcare workers. International Journal of Healthcare Management, 13(4), 337–345. https://doi.org/10.1080/20479700.2020.1810453

40.

Law

E. L.-C.

Roto

Hassenzahl

Vermeeren

A. P. O. S.

Kort

(2009). Understanding, scoping and defining user experience: A survey approach [Conference session]. Proceedings of the SIGCHI conference on human factors in computing systems, New York, NY, USA, pp. 719–728. https://doi.org/10.1145/1518701.1518813

41.

Lee

Yoon

S. N.

(2021). Application of artificial intelligence-based technologies in the healthcare industry: Opportunities and challenges. International Journal of Environmental Research and Public Health, 18(1), Article 1. https://doi.org/10.3390/ijerph18010271

42.

Liu

Song

Chu

(2024). The two faces of Artificial Intelligence (AI): Analyzing how AI usage shapes employee behaviors in the hospitality industry. International Journal of Hospitality Management, 122, Article 103875.

43.

Malone

(2024). Artificial intelligence in the hotel industry: The benefits and effects on corporations. Human Nutrition and Hospitality Management Undergraduate Honors Theses. https://scholarworks.uark.edu/hnhiuht/33

44.

Markus

A. F.

Kors

J. A.

Rijnbeek

P. R.

(2021). The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies. Journal of Biomedical Informatics, 113, Article 103655. https://doi.org/10.1016/j.jbi.2020.103655

45.

McGhee

(2023, November, 20). Benefits of customer service training programs. Unboxed. https://unboxedtechnology.com/blog/training-to-improve-customer-service/

46.

Methods. (2021, November 4). Improving employee experience with UX principles. Methods. https://methodsof.com/blog/improving-employee-experience-with-ux-principles/

47.

Miquido. (2021, July 16). A quick and easy guide to voice assistants. Miquido. https://www.miquido.com/blog/what-are-voice-assistants/

48.

Mishra

Shukla

(2020). Psychological determinants of consumer’s usage, satisfaction, and word-of-mouth recommendations toward smart voice assistants. In Sharma

S. K.

Dwivedi

Y. K.

Metri

Rana

N. P.

(Eds.), Re-imagining diffusion and adoption of information technology and systems: A continuing conversation (pp. 274–283). Springer International Publishing.

49.

Morosan

DeFranco

(2019). Co-creation of value using hotel interactive technologies: Examining intentions and conversion. International Journal of Contemporary Hospitality Management, 31(3), 1183–1204. https://doi.org/10.1108/IJCHM-04-2018-0314

50.

Myers

(2022, January 5). 5 charts that show what people around the world think about AI. World Economic Forum. https://www.weforum.org/agenda/2022/01/artificial-intelligence-ai-technology-trust-survey/

51.

Nasirian

Ahmadian

Lee

O.-K.

(2017). AI-based voice assistant systems: Evaluating from the interaction and trust perspectives. AMCIS 2017 Proceedings, 27. https://aisel.aisnet.org/amcis2017/AdoptionIT/Presentations/27

52.

Newman

(2018, April 2). 5 reasons employee user experience matters. Future of Work. https://fowmedia.com/five-reasons-employee-user-experience-matters/

53.

Ouyang

Zheng

Jiao

(2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. https://doi.org/10.1007/s10639-022-10925-9

54.

Paylocity. (2016, January 28). In a tech-friendly HR world, user experience is critical. Paylocity. https://www.paylocity.com/resources/resource-library/blog-post/blog-in-a-tech-friendly-hr-world-user-experience-is-critical/

55.

Pelau

Dabija

D.-C.

Ene

(2021). What makes an AI device human-like? The role of interaction quality, empathy and perceived psychological anthropomorphic characteristics in the acceptance of artificial intelligence in the service industry. Computers in Human Behavior, 122, Article 106855. https://doi.org/10.1016/j.chb.2021.106855

56.

Pelet

J. É.

Lick

Taieb

(2021). The internet of things in upscale hotels: Its impact on guests’ sensory experiences and behavior. International Journal of Contemporary Hospitality Management, 33(11), 4035–4056.

57.

Pillai

Sivathanu

Dwivedi

Y. K.

(2020). Shopping intention at AI-powered automated retail stores (AIPARS). Journal of Retailing and Consumer Services, 57, Article 102207. https://doi.org/10.1016/j.jretconser.2020.102207

58.

Pizam

Ozturk

A. B.

Balderas-Cejudo

Buhalis

Fuchs

Hara

Meira

Revilla

M. R. G.

Sethi

Shen

State

Hacikara

Chaulagain

(2022). Factors affecting hotel managers’ intentions to adopt robotic technologies: A global study. International Journal of Hospitality Management, 102, Article 103139.

59.

Potnuru

S. K.

(2019). Multi agent based system to automate shopping process using artificial intelligence. International Research Journal of Innovations in Engineering and Technology, 3(8), 58–63.

60.

ProductPlan (n.d.). User experience. ProductPlan. https://www.productplan.com/glossary/user-experience/

61.

PwC. (2018). The macroeconomic impact of artificial intelligence. PwC. https://www.pwc.co.uk/economic-services/assets/macroeconomic-impact-of-ai-technical-report-feb-18.pdf?source5post_page

62.

PwC. (n.d.). Tech at work and the employee experience. PwC. https://www.pwc.com/us/en/services/consulting/library/consumer-intelligence-series/tech-at-work.html

63.

Radic

Singh

Ariza-Montes

Calder

Han

(2024). The good shepherd: Linking artificial intelligence (AI)-driven servant leadership (SEL) and job demands-resources (JD-R) theory in tourism and hospitality. Journal of Hospitality and Tourism Insights, 8(4), 1494–1521.

64.

Revfine. (2022, January 24). How can voice control benefit the hospitality industry? Revfine.Com. https://www.revfine.com/voice-control-hospitality-industry/

65.

Romano

(2020, August 27). Google is putting voice assistants in hotels so you can turn on the lights, order prosecco, and check out hands-free. Travel and Leisure. https://www.travelandleisure.com/hotels-resorts/google-nest-hub-hands-free-hotel

66.

Roy

S. K.

Balaji

M. S.

Sadeque

Nguyen

Melewar

T. C.

(2017). Constituents and consequences of smart customer experience in retailing. Technological Forecasting and Social Change, 124, 257–270. https://doi.org/10.1016/j.techfore.2016.09.022

67.

Salesforce. (n.d.). Customer service training: A complete guide. Salesforce. https://www.salesforce.com/service/customer-service-incident-management/customer-service-training/

68.

Samara

Magnisalis

Peristeras

(2020). Artificial intelligence and big data in tourism: A systematic literature review. Journal of Hospitality and Tourism Technology, 11(2), 343–367. https://doi.org/10.1108/JHTT-12-2018-0118

69.

Saydam

M. B.

Arici

H. E.

Koseoglu

M. A.

(2022). How does the tourism and hospitality industry use artificial intelligence? A review of empirical studies and future research agenda. Journal of Hospitality Marketing & Management, 31(8), 908–936. https://doi.org/10.1080/19368623.2022.2118923

70.

Shrungare

(2023, March). AI in education. XRDS: Crossroads, The ACM Magazine for Students, 29(3), 63–65.

71.

Shum

Kim

H. J.

Calhoun

J. R.

Putra

E. D.

(2024). “I was so scared I quit”: Uncanny valley effects of robots’ human-likeness on employee fear and industry turnover intentions. International Journal of Hospitality Management, 120, Article 103762. https://doi.org/10.1016/j.ijhm.2024.103762

72.

Spacey

(2017, October 28). 12 examples of a user. Simplicable. https://simplicable.com/design/user

73.

Starkov

(2023, February 21). Hospitality digital technology: Challenges, priorities, and buzzwords. Hospitality Net. https://www.hospitalitynet.org/opinion/4092304.html

74.

Stumpp

Knopf

Michelis

(2019). User experience design with augmented reality (AR) [Conference session]. ECIE 2019 14th European conference on innovation and entrepreneurship, Kalamata, Greece.

75.

Suciu

Balanean

Pasat

Istrate

Ijaz

Matei

(2020). A new concept of smart shopping platform based on IoT solutions [Conference session]. 2020 12th International conference on electronics, computers and artificial intelligence (ECAI), Bucharest, Romania, pp. 1–4.

76.

Tai

Y. F.

Wang

Y. C.

Luo

C. C.

(2021). Technology-or human-related service innovation? Enhancing customer satisfaction, delight, and loyalty in the hospitality industry. Service Business, 15, 667–694.

77.

Thiebes

Lins

Sunyaev

(2021). Trustworthy artificial intelligence. Electronic Markets, 31(2), 447–464. https://doi.org/10.1007/s12525-020-00441-4

78.

Tuzovic

Paluch

(2018). Conversational commerce – A new era for service business development? In Bruhn

Hadwich

(Eds.), Service business development: Strategien – innovationen – geschäftsmodelleBand 1 (pp. 81–100). Springer Fachmedien.

79.

Voicebot.AI. (2018, November). Voice assistant consumer adoption report 2018. https://voicebot.ai/wpcontent/uploads/2018/11/voice-assistant-consumer-adoptionreport-2018-voicebot.pdf

80.

Walson

(2023, January, 25). The evolution of in-room voice tech in hospitality. PhocusWire. https://www.phocuswire.com/evolution-in-room-voice-tech-hospitality

81.

Wang

Chen

Wang

Law

C. H. R.

Zhang

(2024). Exploring the affordances of service robots and the effects on frontline employees in China: A qualitative research in hotels. Journal of Hospitality and Tourism Technology, 15(5), 862–877. https://doi.org/10.1108/JHTT-11-2023-0367

82.

Warren

S. D.

Brandeis

L. D.

(1890). The right to privacy (Vol. 4). Harvard Law Review.

83.

Wibowo

A. D.

Tamsah

Farida

Rasyid

Rusli

Yusriadi

(2021, March). The influence of work stress and workload on employee performance through the work environment at SAMSAT Makassar city. Proceedings of the International Conference on Industrial Engineering and Operations Management (pp. 6276–6282).

84.

Chin

Liu

(2022). Technostress and the smart hospitality employee. Journal of Hospitality and Tourism Technology, 13(3), 404–426. https://doi.org/10.1108/JHTT-01-2021-0032

85.

Hsiao

Reid

(2023). Working with service robots? A systematic literature review of hospitality employees’ perspectives. International Journal of Hospitality Management, 113, Article 103523.

86.

Yang

Chi

(2024). How does the anthropomorphism of service robots impact employees’ role service behavior in the workplace? International Journal of Hospitality Management, 122, Article 103857. https://doi.org/10.1016/j.ijhm.2024.103857

87.

Zhang

Jin

(2023). How does smart technology, artificial intelligence, automation, robotics, and algorithms (STAARA) awareness affect hotel employees’ career perceptions? A disruptive innovation theory perspective. Journal of Hospitality Marketing & Management, 32(2), 264–283.

88.

Zhang

(2023, December 11). The future of hotel communication: Guest-led voice assistants. Hospitality Technology. https://hospitalitytech.com/future-hotel-communication-guest-led-voice-assistants

89.

Zhang

(2019). User experience study: The service expectation of hotel guests to the utilization of ai-based service robot in full-service hotels. In HCI in business, government and organizations. eCommerce and consumer behavior: 6th International conference, HCIBGO 2019, held as part of the 21st HCI international conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings, Part I 21 (pp. 350–366). Springer International Publishing.