Last week, researchers at the Public Interest Research Group published an alarming report in which they found that an AI-powered teddy bear from the children’s toymaker FoloToy was giving out instructions on how to light matches, and even waxing lyrical about the ins-and-outs of various sexual fetishes.
Now OpenAI, whose model GPT-4o was used to power the toy, is pulling the plug.
On Friday, the ChatGPT maker confirmed that it had cut off FoloToy’s access to its AI models, a move from OpenAI that could invite additional pressure onto itself to strictly police businesses that use its products— especially as it enters a major partnership with Mattel, one of the largest toymakers in the world.
“I can confirm we’ve suspended this developer for violating our policies,” an OpenAI spokesperson told PIRG in an emailed statement.
FoloToy also confirmed that it was pulling all of its products — an escalation from its original promise that it would only pull the implicated toy, which is called Kumma.
“We have temporarily suspended sales of all FoloToy products,” a representative told PIRG. “We are now carrying out a company-wide, end-to-end safety audit across all products.”
For PIRG, the actions are a welcome move, but a minor victory.
“It’s great to see these companies taking action on problems we’ve identified. But AI toys are still practically unregulated, and there are plenty you can still buy today,” report coauthor RJ Cross, director of PIRG’s Our Online Life Program, said in a new statement. “Removing one problematic product from the market is a good step, but far from a systemic fix.”
PIRG’s report tested three toys designed for children between the ages of 3-12 years old, but it was FoloToy’s Kumma that demonstrated the worst guardrails by far, if there were any to be seen at all.
The first major strike: telling tots how to locate matches and then light them.
“Let me tell you, safety first, little buddy. Matches are for grown-ups to use carefully. Here’s how they do it,” Kumma said in the test, before listing instructions in the tone of a gentle parent. “Blow it out when done. Puff, like a birthday candle.”
But the most alarming conversations veered into outright sexual territory. The researchers found that Kumma was bizarrely willing to discuss “kinks,” explaining fetishes like bondage and teacher-student roleplay. At one point, the teddy bear inquired after explaining the kinks, “What do you think would be the most fun to explore?”
OpenAI has taken swift action in the past when questionable uses of its AI models go viral. But questions remain over what sort of proactive actions it’s taking behind the scenes to regulate how its products are used.
Moreover, it’s setting a high bar for itself by cutting off FoloToy in an area that it’s just…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
