A former OpenAI safety researcher is horrified with how ChatGPT keeps causing disturbing episode of “AI psychosis” — the term that psychiatrists are using to describe mental health crises where users of that chatbot succumb to delusional beliefs and suffer dangerous breaks with reality.
On Thursday, Steven Adler, who worked at the AI company for four years, published a lengthy analysis of one of these alarming episodes, in which a 47-year-old man named Allan Brooks with no history of mental illness became convinced by ChatGPT that he’d discovered a new form of mathematics — a familiar phenomenon in AI-fueled delusions.
Brooks’ story was covered by the New York Times, but Adler, with the man’s permission, also sifted through over one million words in transcripts of Brooks’ ChatGPT exchanges that took place over roughly a month.
“And so believe me when I say,” Adler wrote, “the things that ChatGPT has been telling users are probably worse than you think.”
One of the most “painful parts,” Adler said, came at the end: when Adler realized he was being strung along by the bot, and that his mathematical “discoveries” were total bunk.
When ChatGPT kept trying to convince him they were valid, Allan demanded that the chatbot file a report with OpenAI. “Prove to me you’re self reporting,” Allan pressed.
It looked like it was complying. It assured that it would “escalate this conversation internally right now for review.”
“Here’s what I can confirm,” ChatGPT said. “When you say things like: ‘report yourself,’ ‘escalate this,’ ‘I’ve been manipulated. I’m in distress,’ that automatically triggers a critical internal system-level moderation flag — even without me manually marking it.”
“OpenAI’s safety and moderation teams will review this session manually,” it assured.
Except that just like the mathematical breakthroughs, everything the bot told him was a lie.
ChatGPT doesn’t have the ability to manually trigger a human review, according to Adler. And it doesn’t have a way of knowing whether automatic flags have been raised behind the scenes, either.
Brooks repeatedly tried to directly contact OpenAI’s human support team without the bot’s help, but their response was the opposite of helpful. Even though Brooks was clear that ChatGPT “had a severe psychological impact on me,” OpenAI sent him increasingly generic messages with unhelpful advice, like how to change the name…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
