Behind the scenes

What our AI SEO agent found in our own data

We built an AI agent that works inside Slack. It reads Search Console and analytics, flags what changed and drafts the next move for a person to approve. Before it touches anyone else’s site, we’re running it on our own.

The short answerOn its first run, the agent pulled 10,486 of our Search Console queries and found 311 of them (3%) were AI-assistant traffic: prompts typed into AI Mode and AI Overviews, follow-up questions, and probes from AI rank-tracking tools. One prompt, “analytical tools do you use for link building”, had 866 impressions and no page that answered it. We built one.
How it works

An analyst that never stops reading

The agent lives in a Slack channel. You @mention it with a question in plain English, and it works on a schedule in the background.

  1. It reads the dataIt has its own access to Google Search Console and GA4 and pulls every query, not just the 1,000 rows Search Console shows on screen.
  2. It flags what changedScheduled checks look for traffic shifts, technical issues and new AI search behavior. It posts only when there’s something worth acting on.
  3. It drafts the next moveIt turns findings into specific proposals, such as a page to write, an FAQ to add or a fix to make, each with the evidence behind it.
  4. A person approvesContent, plans and bigger changes wait for a human ✅. Safe fixes can run on their own, and every one can be undone.
The playbook library

A very particular set of skills

Skills we’ve built over a long career in search. Behind the agent is a library of more than 1,000 AI SEO skills: step-by-step playbooks for jobs like classifying Search Console queries, tracking AI citations, mining query fan-out and auditing schema. Each one is tested on our own sites and others before it’s trusted, always under strict human supervision.

1,000+ skills

Written as playbooks

Every task the agent can do is a written, versioned playbook: the steps, the checks and what “done” looks like.

Tested first

Proven on our own sites

New skills run on our own sites before anyone else’s, so the mistakes are ours to find, not a client’s.

Always supervised

A person signs off

Every skill runs under human supervision. People approve the work, edit the drafts and set the strategy and priorities.

First run

311 AI conversations hiding in Search Console

Search Console now shows fragments of prompts people type into Google’s AI Mode and AI Overviews, mixed in with normal searches. The agent separated them out across six months of our data.

10,486Search Console queries pulled in one pass, with no row cap.April to September 2026
311Queries that came from AI conversations, not normal searches.3% of all queries
866Impressions for one AI prompt we had no answer for.“analytical tools do you use for link building”
What it found Queries What it tells us
Conversational prompts 88 Buyers asking an assistant full questions, often with their own situation built in. The best source of content ideas.
AI rank-tracker probes 72 Prompts that AI visibility tools fire at Google, showing which questions someone is tracking in our space.
Pasted text 55 Copied questions, specs and lists pasted into the search box.
Instructions for an AI 28 Prompts written for an AI agent, not a person.
Follow-ups and replies 24 “I meant on iPhone”, “can you put this into Google Maps”: mid-conversation turns.
What we did with it

From one Slack message to three changes

The agent’s digest suggested three moves. A person reviewed each one and turned it into work.

New page

The tools we use for AI SEO

An honest comparison of our analytics stack, covering methodology, pricing model, fit by team size and what each tool can’t do.

New FAQ

Can AI SEO be fully automated?

Answered on our AI SEO service pages, including why human review stays at the core.

New tool

The classifier, public for anyone

The same AI-query check the agent runs, as a public tool for your own Search Console export.

Case studies

Proven on our sites, then on clients’

Shopify store

1,186 schema errors to zero in one day

Four root causes behind 1,300+ Ahrefs errors on a specialty coffee equipment store, fixed the same day.

Read the case study →

Our own site

Ahrefs health score 74 to 96

Seven problems the agent found on alchemyleads.com, from leads GA4 never recorded to 195 pages linking through redirects.

Read the case study →

Search Console

311 AI conversations found

AI Mode and AI Overview prompts separated from 10,486 normal queries in one pass.

See the findings →

The line we draw

What it does, and what stays human

Automated

  • Pulling Search Console and analytics data
  • Classifying queries and spotting new AI behavior
  • Drafting proposals with the evidence attached
  • Undoable safe fixes, on a schedule
Human-reviewed

  • What gets published, and the facts in it
  • Strategy, positioning and priorities
  • Earning mentions on sites AI engines trust
  • Anything touching prices, legal pages or outreach

That split is why we answer “can AI SEO be fully automated?” with a no. The measuring can be automated. The judgment can’t.

FAQs

Straight answers

What is an AI SEO agent?

It’s software that reads your search and analytics data on a schedule, spots changes and opportunities, and drafts the next step. Ours works inside Slack, and a person approves its content and strategy proposals before anything goes live.

Can I see the AI queries in my own Search Console?

Yes. Export your queries from Search Console and drop the file into our public AI query classifier. It runs the same check the agent runs.

Does the agent make changes to websites on its own?

Only low-risk fixes that can be undone, and only after a supervised trial period. Content, plans and bigger changes wait for a person to approve them.

Keep reading

Related guides

Toolkit

The tools we use for AI SEO

Our stack compared, including what each tool can’t do.

See the stack →

Service

AI SEO services

One search program for Google and every AI assistant.

See the service →

Your data, same check

What’s hiding in your queries?

Run the classifier on your own Search Console export, or talk to us about putting the full process to work on your site.