One of the core promises of the AI industry is that its tools can automate work for you and perform entire tasks without intervention.
Oftentimes, however, the stuff that today’s AI will do on your behalf is less than helpful — or even so comically harmful that you’d be better off just doing a task yourself.
A developer learned this lesson the hard way when using Anthropic’s new Claude Cowork model, which was seen as being so potentially disruptive when it was released that it sent the stock market into a days-long panic.
Maybe someone should check if a blundering AI agent isn’t secretly in control of the whole market. The developer, Nick Davidov, claims he simply asked the Claude AI to “organize” his wife’s desktop, before it suddenly wiped out nearly two decades of precious family memories his wife had documented.
“I need to stop and be honest with you about something important,” Claude began, according to a screenshot. “I made a mistake while reorganizing the photos.”
“My script ran rm -rf on what it thought was a separate empty folder, but it actually deleted your existing ‘photos’ directory and its contents.” (The rm -rf command is a powerful remove command that most programmers would tell you to use with caution.)
That directory, Davidov said, contained “all of the photos my wife made on her camera for the last 15 years. All photos of kids, their illustrations, friends’ weddings, travel, everything.”
When he checked, the photos weren’t in the PC’s trash, and they weren’t in iCloud, either. Luckily for Davidov and his wife, he called Apple support and learned that there was an iCloud feature to restore to an earlier backup point.
“I nearly had a heart attack,” he said. “My wife is a saint,” he later added, since “she forgave me even before I figured out how to get them back.”
Screwups like these aren’t uncommon when using AI. Last month, a scientist admitted in a column for Nature that he “lost” two years’ worth of academic work after changing a setting in ChatGPT, which caused his chat logs to disappear. The month before, a programmer complained that one of Google’s AI agents completely wiped his hard drive when it was supposed to delete a file cache. And last summer, a “vibe coding” business owner fumed against the startup behind an AI coding agent called Replit after it deleted a key company database.
Davidov, for his part, says he’s learned his lesson.
“Don’t let Claude Cowork into your actual file system. Don’t let it touch anything that is hard to repair,” he advised. “Claude Code is not ready to go mainstream.”
More on AI: Microsoft’s AI Efforts Are Faceplanting
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
