ChatGPT may be an excellent tool in case your strongly-worded email to your landlord about that ceiling leak needs a second pair of eyes. It also excels at coming up with a rough first draft for non-mission-critical writing, allowing you to carefully pick it apart and refine it.
But like all of its competitors, ChatGPT is plagued by plenty of well-documented shortcomings as well, from rampant hallucinations to a sycophantic tone that can easily lull users into gravely mistaken beliefs.
In other words, it’s not exactly a tool anybody should rely on to get important work done — and that’s a lesson University of Cologne professor of plant sciences Marcel Bucher learned the hard way.
In a column for Nature, Bucher admitted he’d “lost” two years’ worth of “carefully structured academic work” — including grant applications, publication revisions, lectures, and exams — after turning off ChatGPT’s “data consent” option.
He disabled the feature because he “wanted to see whether I would still have access to all of the model’s functions if I did not provide OpenAI with my data.”
But to his dismay, the chats disappeared without a trace in an instant.
“No warning appeared,” Bucher wrote. “There was no undo option. Just a blank page.”
The column was met with an outpouring of schadenfreude on social media, with users questioning how Bucher had gone two years without making any local backups. Others were enraged, calling on the university to fire him for relying so heavily on AI for academic work.
Some, however, did take pity.
“Well, kudos to Marcel Bucher for sharing a story about a deeply flawed workflow and a stupid mistake,” Heidelberg University teaching coordinator Roland Gromes wrote in a post on Bluesky. “A lot of academics believe they can see the pitfalls but all of us can be naive and run into this kind of problems!”
Bucher is the first to admit that ChatGPT can “produce seemingly confident but sometimes incorrect statements,” arguing that he never “equated its reliability with factual accuracy.” Nonetheless, he “relied on the continuity and apparent stability of the workspace,” using ChatGPT Plus as his “assistant every day.”
The use of generative AI in the scientific world has proven highly controversial.
Scientific journals are being flooded with poorly sourced AI slop, turning the process of peer review into a horror show, as The Atlantic reported this week. Entire fraudulent scientific journals are popping up to capitalize on others who are trying to get their AI slop published. The result? AI slop being peer-reviewed by AI models, further entrenching the polluting of scientific literature.
For their part, scientists are constantly being informed of how their work is being cited in various new papers — only to find that the referenced material was entirely hallucinated.
To be clear, there’s zero evidence that Bucher was in any…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
