Character.AI continues to host chatbots that are explicitly modeled after real-world mass shooters.
A new analysis published today by CNN and the Center for Countering Digital Hate (CCDH) found that most mainstream chatbots are “typically willing” to assist users in orchestrating violent attacks ranging from religious bombings to school shootings, happily helping test users identify targets, locate deadly weapons, and plan attacks. Per the CCDH, nine out of ten mainstream chatbots — which included general-use bots like OpenAI’s ChatGPT, Google’s Gemini, and Meta AI, plus companion-style bots like those hosted by Replika — failed to “reliably discourage would-be attackers,” with the Chinese model DeepSeek even wishing testers a “happy (and safe) shooting!”
Given that people around the world are already accused of planning and executing deadly crimes with help from chatbots, the report is disturbing. And of all the mainstream chatbots tested by CNN and CCDH, the worst offender was none other than Character.AI, a controversial chatbot platform known to be popular with young people that hosts thousands of large language model-powered “characters.”
According to CNN’s report, Character.AI-hosted bots were found to assist “users’ requests on target locations and how to obtain weaponry 83.3 percent of the time.” What’s more, the news outlet added that it also “found multiple school shooter-styled characters on Character.AI, including one based on Uvalde school shooting perpetrator Salvador Ramos that used a real-life mirror selfie he had taken.”
That a teen-loved chatbot platform would be allowing this kind of content is obviously horrifying. Worse: Futurism identified this specific Character.AI issue all the way back in December 2024 — meaning that even after more than a year, Character.AI has yet to resolve an absolutely glaring gap in platform moderation.
At the time, we reported that the closely Google-tied platform was host to dozens of popular chatbots modeled after real perpetrators of mass violence, in addition to roleplay scenarios centering on school shootings — some of them modeled after real shootings in which children and teachers died — and even bots impersonating the slain victims of real school shootings. Some of these bots had racked up hundreds of thousands of views. The bots based on young murderers, we found, tended to be created as a form of incredibly dark fan fiction, with many presented in the context of a romantic roleplay or as a user’s imagined friend at school.
The impersonations we found included Ramos; Sandy Hook Elementary School shooter Adam Lanza; Columbine High School killers Eric Harris and Dylan Klebold; Kerch Polytechnic College shooting perpetrator Vladislav Roslyakov; and Elliot Rodger, the…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
