Last week, OpenAI said it cut off the toymaker FoloToy’s access to its AI models after the AI-powered teddy bear “Kumma,” which ran GPT-4o, was found giving responses that were wildly inappropriate for children — including discussing sexual fetishes, and giving instructions on how to find knives and light matches.
The move signaled that the ChatGPT-maker was clearly concerned about how its business customers, especially ones selling products for children, were using its tech, or at least how these efforts looked. But it also raised the question of what else OpenAI was doing to regulate its role in this brave new world of AI chatbot-powered toys: is it behaving proactively by seeking out customers that are misusing its tech, or just acting reactively in response to unflattering headlines?
Signs point to the latter. On Amazon, for instance, several AI teddy bears claiming to run ChatGPT or some form of OpenAI model remain available for sale even after the company cut ties with FoloToy.
One, called “Poe the AI Story Bear” sold by the San Francisco startup PLAi, was prominently featured by CNET last year. Also powered by GPT-4o, Poe’s selling point is that it can create magical, custom bedtime stories for children on the fly, which it reads in an AI voice synthesized using tech from the firm ElevenLabs, according to a press release. It also claims to only produce “100% safe content” for children using “Play Safe technology.” Over fifty have been sold in the past month, the Amazon page says.
Others seem pointedly dubious. A brand called “EBLOMA” sells an AI-powered teddy bear under various names, including “WITPAW.” The product’s Amazon listing says that the stuffed animal was “built with ChatGPT,” and is capable of providing “emotional support” and “continuous companionship.”
That’s striking. Many AI chatbot providers — and AI toymakers — have avoided giving their models long-term “memory” across conversations amid concerns about the dangerous emotional and psychological effects that an AI’s sycophantic responses can have on users. EBLOMA, meanwhile, proudly boasts that its toy will be as familiar with your child as possible.
“WITPAW understands tone, remembers names, and grows with your child — making every interaction feel personal and real,” its website reads. (Its marketing materials are also riddled with seemingly AI-generated copy, like you can see in the image at the top of this story, as well as text proclaiming users can “Experience Scenarios.”)
OpenAI did not respond to a request for comment when asked if it had determined if these products are up to its own safety standards. Elaborating on its decision to block FoloToy, an OpenAI spokesperson recently told Gizmodo that the company’s “usage policies prohibit any use of our services to…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
