We’re getting a lot of questions about prompt tracking. Many of our current and prospective clients are tracking their visibility using tools such as Profound, Athena, and Peec.
The million-dollar question that always comes up is “Which prompts should I be tracking?’. In an incredibly personalized and complex ecosystem, it’s extremely difficult to know what our buyers are even asking LLMs about our company.
There are no data sources I feel great about right now. This isn’t like traditional search, where Keyword Planner data was publicly provided. It’s unlikely that OpenAI or Google will ever fully open up this data for us to analyze. There have been some recent proposals by the UK CMA around Google + data transparency but let’s all expect the bare minimum to be done here.
So LLM tracking is a complete black box. Are there any data sources that we can possibly use to see which prompts to track?
Maybe.
OpenAI data leaking into Search Console
Last November, there was some extremely interesting reporting done around this. Last November, Jason Packer wrote a report analyzing how searches from ChatGPT were actually getting leaked into Search Console reports. An accidental test revealed quite a few queries in the Search Console data with PII.
The story was eventually picked up by Ars Technica and confirmed by sources as OpenAI. They since claimed to have fix the problem that was specifically occurring here and that “only a small number of queries were leaked”.
However, this is confirmation that ChatGPT queries are available in some Search Console profiles. Obviously, there’s huge implications with privacy, PII etc., that’s beyond the scope of this article. The point being, we know it’s not impossible that queries from LLM systems are available in Search Console.
AI Mode data available in Search Console
We also know from the amazing reporting of Barry Schwartz that data from AI Mode will be available in Search Console. So more evidence that Search Console will have the capabilities to collect data points for how users are searching within an LLM.
From what we’ve analyzed so far, I believe this is where the data is likely coming from. When you look at the data after applying this filter, you can see steady rises in impressions over the last 3 months:
This lines up pretty well with Google’s aggressive rollout of AI Mode-based features during Fall 2025/Winter 2026.
How to mine for your prompt-like Search Console queries
So how could we possibly access this data from user prompts in Search Console? Well, the best method is to took at longer query lengths. With a little bit of regex, we can filter our data down to queries that are 10+ words in length with the following process:
- Go into Search Console Performance > Search Queries
- Select Add Filter > Query
- Choose Custom Regex
- Enter in this regex:
^(?:\S+\s+){9,}\S+$
Here’s a screenshot of the regex you…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
