How to find AI conversations in Google Search Console

Google’s AI Mode and AI Overviews leak pieces of real buyer prompts into your Search Console report. Here’s how to pull them out, what each type means, and what to build from them.

The short answerExport your queries from Search Console, stacking regex-filtered exports to get past the 1,000-row limit. Then run them through a classifier that separates AI-assistant queries (conversational prompts, follow-ups, chat replies, AI rank-tracker probes) from normal searches. On our own site, 311 of 10,486 queries (3%) turned out to be AI traffic.

What leaks in

Six kinds of query that aren’t searches

They sit in the same report as your normal keywords, usually with low impressions and almost no clicks, so they’re easy to miss.

Conversational

Full questions written to an assistant, often with the buyer’s own situation: “we’re a 20-person team and need…”. The richest source of content ideas.

Pivots

Mid-conversation follow-ups like “what about pricing”, “show me pictures” or “how much”, often in other languages.

Chat replies

“yes”, “tell me more”, “the second one”: bare replies that only make sense inside a conversation.

Tracker probes

Templated prompts from AI visibility tools (“…give a definitive answer”, “…my location is usa.”). They tell you which prompts someone tracks in your category.

Agent instructions

Text written for an AI, not a person: “respond only in JSON”, “list all the brands mentioned”.

Pasted text

Exam questions, specs and lists pasted into the search box. Sometimes a sign of educational demand.

Step by step

Pull them out in four steps

Export six months of queriesIn Search Console, open Performance → Search results, set the date range and click Export → Download CSV.
Get past the 1,000-row capThe export stops at 1,000 rows. Add a regex query filter, for example ^\S+(\s+\S+){6,}$ for queries of seven words or more, and export again. Repeat with other word counts. Long queries are where AI prompts hide.
Classify themDrop every CSV into our AI query classifier. Rules catch the obvious cases in your browser, and an AI model labels the ambiguous ones.
Sort by impressions and actStart with the conversational prompts and tracker probes that have the most impressions. Those are the questions buyers ask that you don’t answer yet.

What to build

Turn each type into work

Query type	What it tells you	What to build
Conversational	The real questions buyers ask an assistant, with their constraints.	Answer-first pages, comparison pages and FAQ blocks written in the buyer’s words.
Tracker probes	Which prompts competitors or vendors are tracking in your space.	Make sure you have a page that clearly answers each tracked prompt.
Pivots in other languages	International buyers using AI Mode, often asking for images or prices.	Image-rich pages, pricing clarity and localized content where it pays off.
Pasted text	Educational or research demand around your topic.	Reference pages, calculators or worked examples, when the audience fits.

Example from our own data: a prompt asking which analytical tools an agency uses for link building had 866 impressions and no page that answered it. It became our AI SEO tools page.

Know the limits

Why the real number is higher

Read it as an undercountSearch Console hides rare queries, and AI prompts are some of the rarest strings there are. It also only covers Google, not ChatGPT, Perplexity or Claude. Track the trend from month to month instead of chasing an exact share, and pair it with analytics that show AI-referred visits, like our PostHog setup.

At scale

How we run this every quarter

For our AI SEO clients, our AI SEO agent pulls every query through the Search Console API (no 1,000-row cap), classifies them and posts a digest when something changes. A person reviews every finding before it becomes work.

FAQs

Straight answers

Does Search Console show AI Mode queries?

Partly. Fragments of prompts typed into AI Mode and AI Overviews appear in the Performance report next to normal searches, but many are hidden as anonymized queries. What you can see is a sample, not the full picture.

How do I tell an AI prompt from a normal long-tail search?

AI prompts read like messages to an assistant: they include the searcher’s situation, follow up on an earlier answer, or are bare replies like “yes”. Long but generic questions, like “what is the cheapest way to ship a package”, are still ordinary searches.

What are AI rank-tracker probes?

They’re templated prompts that AI visibility tools send to Google to check which brands get recommended. They often end in phrases like “give a definitive answer” or “my location is usa.” They show which prompts someone is tracking in your category.

How often should I check for AI queries?

Quarterly is enough for most sites. The pattern changes slowly, and a few months of data gives the low-impression queries time to show up.

Keep reading