Google’s John Mueller says markdown pages serve a specific purpose for developer documentation sites but won’t help most websites, even as search becomes more agentic.
Mueller laid out his reasoning in a Bluesky thread. He was responding to a question from Lily Ray about why Google publishes LLMs.txt files and markdown pages, even though they aren’t needed for search performance.
His response focused mainly on markdown versions of developer documentation, not llms.txt as a standalone file.
Mueller wrote:
“The short answer is that it’s not done for search. There’s more to websites than just SEO :-).”
Mueller’s Discovery Vs. Functionality Framework
His reasoning focuses on two different website goals.
He called the first “discovery,” or being found via a search engine, and the second “functionality,” which helps users complete tasks on the page.
Mueller acknowledged the term wasn’t precise. “There’s probably a more accurate term for this,” he wrote in the thread.
He compared the distinction to calls to action on traditional pages, stating:
“You don’t ‘do them’ for SEO (to be found), but if you’re responsible for the website overall, ensuring a high ‘discovery rate’ (SEO) together with a high conversion rate is useful to justify your work.”
Why Developer Docs Are Different
On developers.google.com, he noted, markdown versions make sense.
Mueller said;
“AI coding has gotten very popular, and these coding systems can be (I think) efficient and accurate with the code they produce if they can easily read / parse reference material, such as developer documentation.”
He added that markdown can help AI systems “understand the context of the documentation they’re looking at, as well as a simplified version of the reference page.”
Mueller called this a workaround rather than a long-term need, adding:
“OF COURSE they can read HTML just fine, so this is imo more of a temporary crutch, perhaps to save some tokens.”
Non-Developer Sites Should Skip It
For everyone else, Mueller was direct, stating:
“For non-developer sites, I don’t think this makes much sense, even with more agentic traffic in the future. Making a markdown version of a shoe’s specs is not going to get you more sales (competitors appreciate it tho).”
He went further in a follow-up post, pushing back on the idea that sites should prepare for a future where agents drive more traffic.
Mueller added:
“And (I know, nobody reads this far), if you think this is important to prepare for when agents are everywhere: your site (all sites) have much more important things to do for SEO than to prepare for a potential future situation that may or may not come. Prioritize needs before dreams.”
Why This Matters
Mueller’s comments show a more detailed position than his earlier statements on the topic.
In February, Mueller called the idea of serving markdown pages to bots “a stupid idea.” His Bluesky comments carve out an exception…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
