OpenAI is seemingly allowing the company behind a teddy bear that engaged in wildly inappropriate conversations to use its AI models again.
In response to researchers at a safety group finding that the toymaker’s AI-powered teddy bear “Kumma” gave dangerous responses for children, OpenAI said in mid-November it had suspended FoloToy’s access to its large language models. The teddy bear was running the ChatGPT maker’s older GPT-4o as its default option when it gave some of its most egregious replies, which included in-depth explanations of sexual fetishes.
Now that suspension appears to already be over. When accessing the web portal that allows customers to choose which AI should power Kumma, two of the options are GPT-5.1 Thinking and GPT-5.1 Instant, OpenAI’s latest models which were released earlier this month.
The timing is notable. On Monday, FoloToy announced that it was restarting sales of Kumma and its other AI-powered stuffed animals, after briefly pulling them from the market in the wake of a safety report conducted by researchers at the US PIRG Education Fund.
FoloToy, which is based in Singapore, had vowed it was “carrying out a company-wide, end-to-end safety audit across all products,” when it suspended the sales. OpenAI likewise confirmed that it had suspended FoloToy from accessing its AI models for violating its policies, which “prohibit any use of our services to exploit, endanger, or sexualize anyone under 18 years old,” it said in a statement provided to media outlets.
The audit, however, was remarkably quick as the holiday shopping season looms: only a “full week of rigorous review, testing, and reinforcement of our safety modules,” according to the company’s recent statement. As part of this overhaul, FoloToy says it “strengthened and upgraded our content-moderation and child-safety safeguards” and “deployed enhanced safety rules and protections through our cloud-based system.”
These comprehensive-sounding overhauls seem to have largely been achieved by introducing GPT-5.1 and ditching GPT-4o. GPT-4o, it’s worth noting, has been criticized for being especially sycophantic, and has been the subject of a number of lawsuits alleging that it led to the deaths of users who became obsessed with it after prolonged conversations in which it reinforced their delusions and validated their suicidal thoughts. Some experts are calling these mental health spirals “AI psychosis.”
Amid mounting public concern over the phenomena and an ever growing number of lawsuits, OpenAI billed GPT-5 as a safer model when it was released this summer, though users quickly complained about its “colder” and less personable tone.
Yet it’s clearly willing to push the limit of what’s safe to keep users engaged with its chatbots, if not enamored. Its latest 5.1 models have a big focus on being more “conversational,” and one way OpenAI is doing that is by giving users the option…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
