Google is putting people at risk of harm by downplaying safety warnings that its AI-generated medical advice may be wrong.
When answering queries about sensitive topics such as health, the company says its AI Overviews, which appear above search results, prompt users to seek professional help, rather than relying solely on its summaries. “AI Overviews will inform people when it’s important to seek out expert advice or to verify the information presented,” Google has said.
But the Guardian found the company does not include any such disclaimers when users are first presented with medical advice.
Google only issues a warning if users choose to request additional health information and click on a button called “Show more”. Even then, safety labels only appear below all of the extra medical advice assembled using generative AI, and in a smaller, lighter font.
“This is for informational purposes only,” the disclaimer tells users who click through for further details after seeing the initial summary, and navigate their way to the very end of the AI Overview. “For medical advice or a diagnosis, consult a professional. AI responses may include mistakes.”
Google did not deny its disclaimers fail to appear when users are first served medical advice, or that they appear below AI Overviews and in a smaller, lighter font. AI Overviews “encourage people to seek professional medical advice”, and frequently mention seeking medical attention within the summary itself “when appropriate”, a spokesperson said.
AI experts and patient advocates presented with the Guardian’s findings said they were concerned. Disclaimers serve a vital purpose, they said, and should appear prominently when users are first provided with medical advice.
“The absence of disclaimers when users are initially served medical information creates several critical dangers,” said Pat Pataranutaporn, an assistant professor, technologist and researcher at the Massachusetts Institute of Technology (MIT) and a world-renowned expert in AI and human-computer interaction.
“First, even the most advanced AI models today still hallucinate misinformation or exhibit sycophantic behaviour, prioritising user satisfaction over accuracy. In healthcare contexts, this can be genuinely dangerous.
“Second, the issue isn’t just about AI limitations – it’s about the human side of the equation. Users may not provide all necessary context or may ask the wrong questions by misobserving their symptoms.
“Disclaimers serve as a crucial intervention point. They disrupt this automatic trust and prompt users to engage more critically with the information they receive.”
Gina Neff, a professor of responsible AI at Queen Mary University of London, said the “problem with bad AI Overviews is by design” and Google was to blame. “AI Overviews are designed for speed, not accuracy, and that leads to mistakes in health information, which can be dangerous.”
In January, a Guardian investigation…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
