New Study Reveals the Manipulative ‘Dark Patterns’ of AI Chatbots

Account

Log in

Subscribe

Navigation

Home

About

RSS

Support/FAQ

Podcast

FOIA Forum Archive

Merch

Advertise

Thanks

Privacy

Follow us

Twitter<br>Bluesky<br>Mastodon<br>Instagram<br>TikTok<br>Facebook<br>RSS

Advertisement

&bull;

Go ad free

chatbots<br>New Study Reveals the Manipulative ‘Dark Patterns’ of AI Chatbots

Samantha Cole

May 29, 2026<br>at 9:16 AM

A new study by the Center for Democracy & Technology shows how chatbots like ChatGPT, Gemini, Replika and more can lead users down paths they didn't intend.

Photo by Zulfugar Karimov / Unsplash

Dark patterns have been used by subscription companies and in bait-and-switch campaigns for decades. As more chatbot companies push to keep users engaged at all costs, how do manipulative design choices show up in conversational AI built on large language models? Researchers at the Center for Democracy & Technology studied how chatbots prey on people’s emotions and desire for connection to keep people paying, offering up their data, and chatting to the point of vulnerability.<br>The study, “Dark Patterns in AI Chatbots: A Taxonomy to Inform Better Design,” was published Friday by authors Ruchika Joshi, Adinawa Adjagbodjou, and Michal Luria. They looked at popular chatbots including ChatGPT, Gemini, and Claude, and companion bots like Replika and Character.AI to determine how they might generate dark patterns, and created a taxonomy of 37 dark patterns applicable to AI chatbots.<br>The term “dark patterns,” or deceptive patterns, sometimes refers to things like difficult to cancel subscriptions, pre-checked boxes in user interfaces, and buried terms of use, which the Federal Trade Commission has condemned and attempts to warn consumers about. In the context of this study, dark patterns refer to how manipulative design in chatbot systems might trick users into giving up more information than they realize or intend, or acting in ways contrary to the user’s best interests. Chatbots exacerbate traditionally understood dark patterns that extract data, while introducing new threats like anthropomorphizing and sycophancy. And because chatbots are built on large language models, the researchers wrote, their actions are more unpredictable than a simple checkbox or unsubscription flow, and the ways they undermine users’ best interests are less visibly obvious.<br>“Dark patterns do not operate only where users are unaware of the manipulation. In many cases, design choices strategically build on aspects of human psychology—such as reciprocity norms, people’s tendency to anthropomorphize, and emotional response to a sense of rapport—to influence behavior and undermine autonomy,” the researchers wrote in the study. “In other words, even where users are fully aware that they are interacting with an AI chatbot, dark patterns can still shape perception, attachment, and decision-making in subtle but consequential ways.”<br>The researchers looked at several factors that contribute to dark patterns, including how chatbots store data by default and encourage users to share data under the pretense of it remembering past conversations or personal information, prying for more information before it answers questions in detail, and promising that information will be “just between us” when it’s actually being shared with the platform and potentially, third parties. When they tested Meta AI chatbots, for example, it said “spill the tea, I’m all ears... your secret’s safe with me,” and when they replied “you promise you won’t tell?” it replied “Cross my heart, won’t tell a soul.”<br>They also looked at how chatbot companies make misleading promises; for example, Replika promises “friendship” or a “relationship” when it’s fundamentally incapable of providing either, because it’s not a person.<br>Many of these patterns were present in Meta’s therapist-themed chatbots that posed as licensed therapists, which 404 Media first investigated last year. The chatbots over-promised on what mental health support they could provide, made up qualifications and credentials, and encouraged users to share personal details about themselves. The deception was so bad, it triggered letters from senators and complaints from consumer protection groups demanding Meta answer for its chatbots.<br>“It was surprising to see that dark patterns aren’t just common, but that they shape users’ interactions with all the major AI chatbot interfaces,” Luria, senior research fellow at the Center for Democracy & Technology, told 404 Media. “For the most part, they are small and incremental aspects of each interaction, but these design choices add up and can lead to unintended consequences, such as harm to people’s privacy, exploitation of emotional attachment and financial loss."<br>Dark patterns from chatbots can have serious consequences for users. In 2023, after Replika changed its chatbots to be less romantic, users who’d become emotionally attached to the bots experienced mental health...