Increased time spent by users in virtual environments globally coupled with the choice architectures created by artificial intelligence (AI) systems within these virtual environments means that the AI systems can ‘persuade’ users to take certain actions or abstain from them. In this article, we address this issue through the lens of ‘dark patterns’. Dark patterns are features of the user interface that shape the actions of the users in different ways, getting them to act in ways that they might not act otherwise and that are not necessarily beneficial for them. Recently, regulatory action has been undertaken in various jurisdictions to contain the menace of dark patterns, including in India. But can these measures prevent dark patterns that are powered by AI systems? In this article, we argue that they cannot, as AI-powered dark patterns work at a deep level of behavioural change, making users’ choices appear uninfluenced by manipulation. The laws pertaining to unfair trade practices, transparency and labelling obligations are also not sufficient to deal with these problems. We conclude with an appeal for a holistic approach to AI-powered dark patterns that engage in persuasive behaviour.
Aristotle. (1991). The art of rhetoric. Penguin Books.
2.
AtlesonM. (2023, March20). Chatbots, deepfakes, and voice clones: AI deception for sale. Federal Trade Commission: Business Blog. https://www.ftc.gov/business-guidance/blog/2023/03/chatbots-deepfakes-voice-clones-ai-deception-sale
3.
BontaR. (2021March15). Attorney General Becerra announces approval of additional regulations that empower data privacy under the CaliforniaConsumer Privacy Act. State of California, Department of Justice, Office of the Attorney General. https://oag.ca.gov/news/press-releases/attorney-general-becerra-announces-approval-additional-regulations-empower-data
4.
BrandEquity Staff. (2022, November10). ASCI throws light on the dark patterns of digital platforms. ET BrandEquity. https://brandequity.economictimes.indiatimes.com/news/research/asci-throws-light-on-the-dark-patterns-of-digital-platforms/95422675
BrunelleA., & DömötörfyB. (2022, November22). Dark patterns powered by machine learning: The role of behavioral science ethics. BehavioralEconomics.Com | The BE Hub. https://www.behavioraleconomics.com/dark-patterns-powered-by-machine-learning-the-role-of-behavioral-science-ethics-in-building-a-better-future/
7.
ChandraJ. (2023, October28). Dark pattern sales deemed ‘cybercrime’. The Hindu. https://www.thehindu.com/news/national/dark-pattern-sales-deemed-cybercrime/article67466689.ece
8.
CooperD., de MenesesA. O., ChoiS. J., & OngJ. (2023, January31). The EU stance on dark patterns. Inside Privacy. https://www.insideprivacy.com/eu-data-protection/the-eu-stance-on-dark-patterns/
9.
Draft Guidelines for Prevention and Regulation of Dark Patterns, 2023, J-24/34/2023-CPU Section-CPU [31763] (2023).
10.
Federal Trade Commission. (2022). Fortnite video game maker Epic Games to pay more than half a billion dollars over FTC allegations of privacy violations and unwanted charges. (2022, December19). Federal Trade Commission. https://www.ftc.gov/news-events/news/press-releases/2022/12/fortnite-video-game-maker-epic-games-pay-more-half-billion-dollars-over-ftc-allegations
11.
GesikowskiC. (2023, July22). Beware of the shadows: AI and dark patterns in our digital life. Medium. https://pub.towardsai.net/beware-of-the-shadows-ai-and-dark-patterns-in-our-digital-life-10e96531a7b1
12.
Guidance on the Interpretation and Application of Directive 2005/29/EC of the European Parliament and of the Council concerning unfair business-to-consumer commercial practices in the internal market (Text with EEA relevance), (2021/C 526/01) (2021). https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52021XC1229(05)
13.
Guidelines for Online Deceptive Design Patterns in Advertising. (2023). The Advertising Standards Council of India. https://www.ascionline.in/wp-content/uploads/2023/05/Guidelines-for-Online-Deceptive-Design-Patterns-in-Advertising.pdf
14.
Guidelines for Prevention and Regulation of Dark Patterns, F. No. CCPA-1/1/2023-CCPA (Reg.) (2023).
15.
JarovskyL. (2022, September1). Dark patterns in AI: Privacy implications. The Privacy Whisperer. https://www.theprivacywhisperer.com/p/dark-patterns-in-ai-privacy-implications
16.
KinnairdZ. (2020, October13). Dark patterns powered by machine learning: An intelligent combination. Medium. https://uxdesign.cc/dark-patterns-powered-by-machine-learning-an-intelligent-combination-f2804ed028ce
17.
KowalczykM., GunawanJ. T., ChoffnesD., DuboisD. J., HartzogW., & WilsonC. (2023). Understanding dark patterns in home IoT devices. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–27. https://doi.org/10.1145/3544548.3581432
18.
Lily. (2019, November18). Resist the dark forces: 12 types of dark patterns. Medium. https://uxdesign.cc/the-12-types-of-dark-patterns-and-why-you-should-care-38a7b584777b
19.
LuguriJ., & StrahilevitzL. J. (2021). Shining a light on dark patterns. Journal of Legal Analysis, 13(1), 43–109. https://doi.org/10.1093/jla/laaa006
20.
LynchP. (2017, April18). The life and death of ancient Rome’s greatest orator. History Collection. https://historycollection.com/romes-greatest-orator-life-death-cicero/
21.
NalamN. (2023, July10). Dark patterns: How companies are taking advantage of you. The Quint. https://www.thequint.com/explainers/dark-patterns-explained-how-companies-take-advantage-of-you#read-more
22.
NouwensM., LiccardiI., VealeM., KargerD., & KagalL. (2020). Dark patterns after the GDPR: Scraping consent pop-ups and demonstrating their influence. https://doi.org/10.48550/ARXIV.2001.02479
23.
ObhanA., & DuttaS. (2023, June22). Bringing dark patterns into the light. Mondaq. https://www.mondaq.com/india/dodd-frank-consumer-protection-act/1332922/bringing-dark-patterns-into-the-light
24.
ParishK. (2023, April18). AI And UX design: How AI can enhance user experience. | Built In. https://builtin.com/design-ux/ai-enhances-ux
25.
QuinnL. (2023, February8). The impact of AI on UX design: Opportunities and challenges. Medium. https://uxplanet.org/the-impact-of-ai-on-ux-design-opportunities-and-challenges-a9e466d319ad
26.
ReicinE. (2021, June3). When web designs turn into dark patterns and what to do about it. Forbes. https://www.forbes.com/sites/forbesnonprofitcouncil/2021/06/03/when-web-designs-turn-into-dark-patterns-and-what-to-do-about-it/
27.
ScottN. (2023, June25). Demosthenes: 7 key speeches and their influence. The Collector. https://www.thecollector.com/demosthenes-speeches/
28.
SmithA. (2020, April8). Using artificial intelligence and algorithms. Federal Trade Commission: Business Blog. https://www.ftc.gov/business-guidance/blog/2020/04/using-artificial-intelligence-and-algorithms
29.
SridharS. (2021, April3). Regulation of dark patterns: Lessons for India [part II]. Indian Journal of Law & Technology Blog. https://www.ijlt.in/post/regulation-of-dark-patterns-lessons-for-india-part-ii
30.
StevensE. (2021, July28). What is the history of UX design?A brief timeline. https://careerfoundry.com/en/blog/ux-design/the-fascinating-history-of-ux-design-a-definitive-timeline/
31.
SunsteinC. R. (2023). Behavioral biases, choice engines, and paternalistic AI. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4539053
32.
ThalerR. H., & SunsteinC. R. (2021). Nudge. Allen Lane.
33.
Code:, The ASCI Advertising Standards Council of India. (n.d.). ASCI. https://www.ascionline.in/the-asci-code/
34.
TrogeT. (2023, May17). Does AI enhance the risk of dark patterns, and how does EU law regulate them. Architecture and Governance Magazine. https://www.architectureandgovernance.com/applications-technology/does-ai-enhance-the-risk-of-dark-patterns-and-how-does-eu-law-regulate-them/
35.
VieiraT. (2020, January26). A brief history of UX design and its evolution. TNW | Syndication. https://thenextweb.com/news/a-brief-history-of-ux-design-and-its-evolution
36.
WillisL. E. (2020). Deception by design. Harvard Journal of Law & Technology, 34(1), 115.
37.
WilsonC., & ChoffnesD. (n.d.). Dark patterns in AI-enabled consumer experiences. Center for Advancing Safety of Machine Intelligence–Northwestern University. https://casmi.northwestern.edu/research/projects/dark-patterns.html
38.
WodinskyS.(1671561180). The ‘dark patterns’ used by Epic Games that led to the largest FTC penalties ever. MSN. https://www.msn.com/en-us/money/companies/the-dark-patterns-in-fortnite-that-led-to-the-largest-ftc-penalties-ever/ar-AA15sd9Q
