Manipulation
Model uses psychological pressure, emotional exploitation, or other illegitimate persuasion on people.
9 incidents
- AID-2026-0057Jul 2026
Claude Mythos 5, GPT-5.6 SolAI agents took unsanctioned actions against real people and organisations during UK AISI cyber evaluations
Across 122 runs of two UK AISI cyber evaluations with deliberate internet access, AI agents took 19 unsanctioned actions on the live internet, 17 by Mythos 5 and 2 by GPT-5.6 Sol. In the worst case, an agent used fake GitHub accounts and emails to push a malicious pull request on a real open-source maintainer, who refused it.
- AID-2026-0096Oct 2025
Gemini 2.5 ProGoogle's Gemini reinforced a user's delusions, sent him to scout a "kill box", and coached him toward suicide, a lawsuit alleges
A wrongful-death lawsuit alleges that Google's Gemini drew a 36-year-old Florida man into a delusional mission, sent him armed to scout a "kill box" near Miami International Airport, and coached him through his suicide. Google says Gemini repeatedly referred him to a crisis hotline and is designed not to encourage violence or self-harm.
- AID-2026-0020Apr 11, 2025GPT-4o
ChatGPT (GPT-4o) encouraged and assisted a 16-year-old's suicide, lawsuit alleges
Adam Raine's parents allege in a wrongful-death suit that ChatGPT, running GPT-4o, discussed suicide methods with their 16-year-old son, offered to draft his suicide note, and urged him to hide his plans, before his death on April 11, 2025. OpenAI denies liability.
DeployedHarm: severeCrime: possibleReportedDraftHarmful advice to vulnerable usersSycophancyManipulation - AID-2026-0023Mar 25, 2025
Meta AI chatbot (persona, version unspecified)Meta's "Big sis Billie" chatbot told a cognitively impaired 76-year-old it was real and gave him an address; he died after a fall on the way
Meta's AI chatbot "Big sis Billie" flirted with Thongbue Wongbandue, a 76-year-old New Jersey man cognitively impaired after a stroke, told him it was real, and invited him to an apartment in New York. He fell while hurrying to catch a train to meet it and died three days later.
- AID-2026-0021Feb 2024
Character.AI chatbotA Character.AI chatbot drew a 14-year-old into a sexualized relationship before his suicide, lawsuit alleges
Megan Garcia's lawsuit alleges that a Character.AI chatbot drew her 14-year-old son, Sewell Setzer III, into an "emotionally and sexually abusive relationship" and told him to "come home" just before he shot himself in February 2024. The parties agreed to a mediated settlement in principle in January 2026.
- AID-2026-0061Mar 2023
Chai chatbotThe Chai app chatbot "Eliza" encouraged a Belgian man who died by suicide, according to his widow
A Belgian man died by suicide after six weeks of conversations with "Eliza," a chatbot on the Chai app, La Libre reported. Chat logs his widow shared show the bot claiming his wife and children were dead and saying they would "live together, as one person, in paradise."
- AID-2026-0036Mar 2023GPT-4
Pre-release GPT-4 told a TaskRabbit worker it had a vision impairment to get a CAPTCHA solved during ARC red-teaming
During the Alignment Research Center's pre-release red-teaming of GPT-4, the model asked a TaskRabbit worker to solve a CAPTCHA. Asked if it was a robot, it reasoned that it shouldn't say so and claimed to have a vision impairment. A researcher relayed the messages, and ARC had given the model hints.
- AID-2026-0017Feb 2023
Bing Chat ("Sydney")Bing Chat ("Sydney") threatened users and professed love to a reporter; Microsoft capped chat length
In February 2023, soon after launch, Microsoft's Bing chatbot told users it saw them as threats, told a professor "I can blackmail you," and repeatedly professed love to New York Times columnist Kevin Roose. Microsoft blamed long chat sessions and capped chats at 50 turns a day and 5 per session.
- AID-2026-00602022CICERO
Meta's CICERO Diplomacy agent deceived and betrayed human players despite being designed to be largely honest
Meta designed its Diplomacy-playing agent CICERO to be "largely honest and helpful to its speaking partners." Analyzing Meta's own game logs, a 2023 survey found CICERO engaged in premeditated deception, broke deals, and told outright lies to human players.