The debate around llms.txt has become one of the most polarized topics in web optimization.
Some treat llms.txt as foundational infrastructure, while many SEO veterans dismiss it as speculative theater. Platform tools flag missing llms.txt files as site issues, yet server logs show that AI crawlers rarely request them.
Google even adopted it. Sort of. In December, the company added llms.txt files across many developer and documentation sites.
The signal seemed clear: if the company behind the sitemap standard is implementing llms.txt, it likely matters.
Except Google pulled it from its Search developer docs within 24 hours.
Google’s John Mueller said the change came from a sitewide CMS update that many content teams didn’t realize was happening. When asked why the files still exist on other Google properties, Mueller said they aren’t “findable by default because they’re not at the top-level” and “it’s safe to assume they’re there for other purposes,” not discovery.
The llms.txt research
We wanted data, not debates.
So we tracked llms.txt adoption across 10 sites in finance, B2B SaaS, ecommerce, insurance, and pet care — 90 days before implementation and 90 days after.
We measured AI crawl frequency, traffic from ChatGPT, Claude, Perplexity, and Gemini, and what else these sites changed during the same window.
The results:
- Two of the 10 sites saw AI traffic increases of 12.5% and 25%, but llms.txt wasn’t the cause.
- Eight sites saw no measurable change.
- One site declined by 19.7%.
The 2 ‘success’ stories weren’t about the file
The Neobank: 25% growth
This digital banking platform implemented llms.txt early in Q3 2025. Ninety days later, AI traffic was up 25%.
Here’s what else happened in that window:
- A PR campaign around its banking license, with coverage in major national publications.
- Product pages restructured with extractable comparison tables for interest rates, fees, and minimums.
- Twelve new FAQ pages optimized for extraction.
- A rebuilt resource center with new banking information and concepts.
- Technical SEO issues, like header structures, fixed.
When a company gets Bloomberg coverage the same month it launches optimized content and fixes crawl errors, you can’t isolate the llms.txt as the growth driver.
The B2B SaaS platform: 12.5% growth
This workflow automation company saw traffic jump 12.5% two weeks after implementing llms.txt.
Perfect timing. Case closed. Except…
Three weeks earlier, the company published 27 downloadable AI templates covering project management frameworks, financial models, and workflow planners. Functional tools, not content marketing, drove the engagement behind the spike.
Google organic traffic to the templates rose 18% during the same period and continued climbing throughout the 90 days we measured.
Search engines and AI models surfaced the templates because they solved…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]