Librarians, and the books they cherish, are already fight a losing battle for our attention spans with all kinds of tech-enabled brainrot.
Now, in a further assault to their sanity, AI models are generating so much slop that students and researchers keep coming into libraries and asking for journals, books, and records that don’t exist, Scientific American reports.
In a statement from the International Committee of the Red Cross spotted by the magazine, the humanitarian organization cautioned that AI chatbots like ChatGPT, Gemini, and Copilot are prone to generating fabricated archival references.
“These systems do not conduct research, verify sources, or cross-check information,” the ICRC, which maintains a vast library and archives, said in the warning. “They generate new content based on statistical patterns, and may therefore produce invented catalogue numbers, descriptions of documents, or even references to platforms that have never existed.”
Library of Virginia chief of researcher engagement Sarah Falls told SciAm that the AI inventions are wasting the time of librarians who are asked to hunt down nonexistent records. Fifteen percent of emailed reference questions that Fall’s library receives, she claims, are now ChatGPT-generated, which include hallucinated primary source documents and published works.
“For our staff, it is much harder to prove that a unique record doesn’t exist,” Falls added.
Other librarians and researchers have spoken out about AI’s effects on their profession.
“This morning I spent time looking up citations for a student,” wrote one user on Bluesky who identified themselves as a scholarly communications librarian. “By the time I got to the third (with zero results), I asked where they got the list, and the student admitted they were from Google’s AI summary.”
“As a librarian who works with researchers,” another wrote, “can confirm this is true.”
AI companies have put a heavy focus on creating powerful “reasoning” models aimed at researchers that can conduct a vast amount of research off a few prompts. OpenAI released its agentic model for conducting “deep research” in February, which it claims to do “at the level of a research analyst.” At the time, OpenAI claimed it hallucinated at a lower rate than its other models, but admitted it struggled with separating “authoritative information from rumors,” and conveying uncertainty when it presented the information.
The ICRC warned about that pernicious flaw in its statement. AIs “cannot indicate that no information exists,” it stated. “Instead, they will invent details that appear plausible but have no basis in the archival record.”
Though AI’s hallucinatory habit is well known by now, and though no one in the AI industry has made particularly impressive progress in…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
