Data, SEO & AI Search · Practical guide
Measuring AI search visibility
What Search Console's generative AI report actually gives you, why Google's own AI answers are filed as ordinary organic search, the visits that arrive with no name on them, and the one outcome no report can count.
The short answer
What does measuring AI search visibility mean?
Measuring AI search visibility means answering three separate questions, because no single report answers all of them. How often are you shown inside an AI answer? How many people arrive because of one? And when an assistant is asked the question your customers ask, does it name you at all? Google now reports the first, Analytics partly reports the second, and nothing reports the third unless you go and check.
Key takeaways
Google splits AI search down the middle. Clicks from ChatGPT and Gemini go to an AI Assistant channel; clicks from Google AI Overviews go to Organic Search.
Search Console reports impressions inside AI Overviews and AI Mode, and nothing else. No clicks, no queries, no position.
A large share of assistant visits arrive with no referrer at all and are counted as Direct, so referral totals understate the real number.
Being named without being linked is the outcome you most want and the only one no analytics report can see. It has to be tested by asking.
The split
Why a single AI number does not exist
Ask a marketer how much traffic AI is sending them and you will usually get one figure. There is no honest way to produce one, because Google files the two halves of AI search in two different places, and the place a visit lands has nothing to do with how the customer experienced it.
In Google Analytics, the default channel group now contains a channel called AI Assistant. Google defines it as the channel by which users arrive from sources like ChatGPT, Gemini, Deepseek, Copilot or Grok, and adds one sentence that changes everything downstream: it excludes Google AI Overviews and AI Mode. Those are defined into Organic Search instead, which Google describes as arrivals via non-ad links in organic search results, including AI Overviews and AI Mode.
| Where the answer appeared | Channel in Analytics | Separable from ordinary organic? |
|---|---|---|
| ChatGPT, Gemini, Copilot, Grok, Deepseek on the web | AI Assistant | Yes, the medium reads ai-assistant |
| A Google AI Overview or AI Mode | Organic Search | No, it sits beside blue-link clicks |
| The same assistants, inside a phone app | Direct, when no referrer is sent | No, it sits beside typed visits |
So the same person, asking the same question, on the same afternoon, lands in a different channel depending on which assistant answered. Two of those rows are named after where the click came from. The third is named after nothing, because the click arrived with no name on it.
The practical consequence is that anyone quoting you a single percentage for AI traffic has either ignored the Google half or estimated it. Both are defensible if they are said out loud. Neither is defensible presented as a reading off a report.
What Google gives you
What Search Console will and will not tell you
Since 31 August 2026, Google has rolled out its generative AI performance report to all sites worldwide. It is the first official window into being shown inside an AI answer, and it is worth opening. It is also much thinner than most people expect.
The report covers impressions in AI Overviews and AI Mode. You can group those impressions by page, by country, by date and by device. That is the whole list. There is no clicks column, no query dimension and no average position, so the three numbers every SEO reaches for first are all absent. Google draws the data from the same Web search type as the ordinary performance report, so these impressions were always inside your totals; what changed is that you can now look at them on their own.
What each source can see, and what neither one can. Sources: Google Search Console Help, "Generative AI performance report (Search)", rolled out worldwide 31 August 2026; Google Analytics Help, "Default channel group".
That shape is worth sitting with, because it decides what you can honestly claim. Impressions by page will tell you which of your pages Google is willing to put inside an answer, which is genuinely useful and is the closest thing to a scoreboard anyone has. It will not tell you what was asked, whether anyone clicked, or where you sat among the sources named beside you.
The same 1,000-row limit and the same date handling as the ordinary performance report apply, and the newest days are marked preliminary while they settle. One more setting matters before you read any of it: there is a control that excludes a site from Google generative AI features altogether, and a site that has been excluded will show an empty report for reasons that have nothing to do with its content.
The blind spot
The visits and the wins you will never see
Referral data has a structural hole in it, and it is bigger than the numbers built on top of it usually admit. When someone taps a link inside a phone app rather than a browser, the visit often arrives with no referrer header, so there is nothing for Analytics to read. It is filed as Direct, sitting beside people who typed your address from memory.
Cloudflare, which sees a very large share of the world web, said this plainly when it published its crawl-to-refer ratios in July 2025. Its own caveat was that traffic referred by a native app does not include a referrer header, that it believed the same held for other native apps, and that because its referral counts only included web-based tools, the calculations may overstate the ratios by an unclear amount. That is the company with the best view of the problem telling you its own figure is a ceiling, not a reading.
This is why we treat measurement and testing as two different jobs. Analytics tells you what happened to the people who clicked. Asking the assistants the questions your buyers ask, on a schedule, in Australia, and recording who gets named, is the only way to see the rest. It is slower and less tidy than a dashboard, and it is the only method that touches the outcome that decides the sale.
That testing loop is the core of what we do in generative engine optimisation, and the reasoning behind it is set out in how to get cited by AI in Australia and what AI assistants cite in Australia.
The method
Four things to measure, in this order
Measure these in sequence, because each one only means something once the one above it is in place. Nearly every AI reporting failure we see is a business measuring the fourth thing while the first is still wrong.
Are you eligible at all
Confirm the site is not excluded from Google generative AI features, that the pages you care about are indexed, and that your identity markup says the same thing everywhere. An ambiguous source is a poor candidate for a sentence a model has to be confident about.
Week oneImpressions inside AI answers
Read the generative AI performance report by page, and compare it with the same pages in the ordinary performance report. The pages Google is willing to put inside an answer are rarely the pages you would have guessed.
MonthlyClicks, counted honestly
Read AI Assistant and Organic Search as two halves of one story, and watch Direct for the movement that has no other explanation. Report a range, not a point, and say which half you are talking about.
MonthlyWhether you get named
Ask the assistants the questions your buyers actually ask, in Australia, and record who is named and what is cited. This is the outcome. Everything above it is a proxy for it.
Every quarterTwo habits make the difference between a number you can act on and a number you can only recite. The first is writing down the date and the wording of every test, because answers change week to week and an undated result is worthless six weeks later. The second is comparing like with like: an assistant answering in Australia and the same assistant answering in the United States will name different businesses, and testing from the wrong place is the most common reason a result looks better than the market does.
None of this needs a large budget. It needs somebody to run the same questions on the same schedule and keep the record, which is exactly the sort of task that gets started once and abandoned. If you would rather it simply happened, that discipline is the service we sell, and our generative engine optimisation work is built around this loop rather than around a report.
A fair benchmark is your own last quarter, not a competitor. Cross-site AI visibility comparisons rest on sampled prompts, unstated locations and undisclosed dates, and two vendors measuring the same brand in the same week routinely disagree by a wide margin.
The failure modes
Five ways AI visibility measurement goes wrong
One number for all of AI search
The most common error, and it is built into the tooling. Adding AI Assistant to a share of Organic Search and calling the total AI traffic double counts nothing and undercounts everything, because the Google half is not separable from ordinary organic clicks in Analytics at all.
Treating Direct as noise
A large share of assistant visits arrive with no referrer and land in Direct. If Direct rises while nothing else explains it, that is a signal rather than an accident. It is soft evidence, and soft evidence reported honestly beats a precise number that is wrong.
Reporting an AI click-through rate
Search Console publishes impressions for generative AI features and no clicks. Any CTR for AI Overviews is therefore inferred from something else. It might be a reasonable inference; it is not a measurement, and it should never be presented as one.
Testing from the wrong country
An assistant asked a buying question resolves it locally. Run the test on a connection or an account that reads as United States and you will get a United States answer, then act on a market you do not sell in. Every test we record is run as an Australian would experience it.
Measuring once, at launch
AI answers are recomposed constantly, and a single result is a snapshot of one afternoon. Being named in June and absent in September is normal and is precisely the movement you need to see. One reading is not a baseline, it is an anecdote.
If you take one habit from this page, take the dated log. A plain record of the question asked, the date, the country and who was named will out-perform any dashboard you can buy, because it is the only artefact that survives the next model update.
Start here
Want to know what the assistants actually say about you?
Get a free audit and we will run the questions your buyers ask, as an Australian would ask them, then show you who gets named, what gets cited and where you sit today. Dated, recorded and repeatable, so the next reading means something.
Get your free auditGood questions
Measuring AI search visibility FAQs
How do I see traffic from ChatGPT in Google Analytics?
Look at the AI Assistant channel in the default channel group. Google defines it as arrivals from sources like ChatGPT, Gemini, Deepseek, Copilot and Grok, identified by the referrer, with the medium set to ai-assistant and the campaign set to (ai-assistant). It will undercount, because visits from the phone apps often arrive with no referrer and are filed as Direct instead.
Does Google Analytics count AI Overviews as AI traffic?
No. Google explicitly excludes AI Overviews and AI Mode from the AI Assistant channel and files them under Organic Search, described as arrivals via non-ad links in organic search results including AI Overviews and AI Mode. There is no way to separate an AI Overview click from an ordinary blue link click in that channel, which is why a single total for AI traffic cannot be produced honestly.
What does the Search Console generative AI report show?
Impressions in AI Overviews and AI Mode, grouped by page, country, date or device. Google rolled it out to all websites worldwide on 31 August 2026. It has no clicks column, no query dimension and no position, and the usual performance report limits, including the 1,000-row cap and preliminary data on the newest days, apply to it as well.
Why can I not see a click-through rate for AI Overviews?
Because Google does not publish clicks for generative AI features. The report gives impressions only. Any AI Overviews click-through rate you are shown has been inferred from other data, and while the inference may be sensible, it is a model rather than a measurement and should be labelled as one.
Is my AI traffic hiding in Direct?
Some of it, yes. Links tapped inside a native app frequently arrive with no referrer header, so there is nothing for Analytics to read and the session is recorded as Direct. Cloudflare made the same point when publishing its crawl-to-refer ratios in July 2025, noting that its referral counts covered only web-based tools and so may overstate the imbalance. Treat an unexplained rise in Direct as soft evidence worth investigating rather than as noise.
How often should I test whether AI assistants mention my brand?
Quarterly is enough for most Australian businesses, monthly if AI answers are already a real source of enquiries. What matters more than the frequency is the consistency: the same questions, worded the same way, run as an Australian user would experience them, with the date and the answer recorded each time. A single test is an anecdote, and a changed question invalidates the comparison.
What is a good AI visibility score?
There is no external benchmark worth trusting. Scores of this kind rest on a sample of prompts somebody chose, run from a location that is often unstated, on a date that is often undisclosed, and two vendors measuring the same brand in the same week will commonly disagree. Your own previous quarter, measured the same way, is the only comparison that means anything.
Keep rolling