AI Citation Tracking Is Probably Hot Air (And How to Measure What Actually Matters)
Summarize this article with AI
One client spent $3,500 on a GEO tracker. All I saw was noise.
Pierre runs an e-commerce site with 1,200 SKUs.
He calls me on a Tuesday. Voice tight.
« I invested $3,500 in a GEO tool, Stéphane. Why am I seeing nothing? »
I pull up his dashboard.
4 citations in March.
2 citations in April.
11 citations in May.
No trend. No correlation with his sales.
Worse: the citations pointed to pages unrelated to his top products.
Pierre is not alone.
I surveyed 23 e-commerce site owners during my audits.
19 out of 23 never saw any link between their AI citation fluctuations and their revenue.
The remaining 4 said « maybe, » with zero data to back it up.
$3,500 burned on a line graph that goes up and down with no logic.
I told him one thing: stop.
He redirected that budget. He invested the equivalent into a rebuild of his semantic cocoon.
Six months later, his organic traffic jumped +37%.
Without tracking a single AI citation.
The problem is not AI.
It’s the measurement.
Why AI citation tracking is structurally impossible
An LLM like ChatGPT or Gemini never gives the same answer twice to an identical question.
The parameters that shift the output are dynamic and independent of your site:
- Model version: whether the user is subscribed, whether web search is enabled.
- Personalized memory: the AI tailors its response based on the user’s chat history.
- System parameters: seed, temperature, top-p… invisible technical variables.
- External resources: whether the model pulls from Bing, its training data, or a vector database.
- Unknown user queries: you might test « best lawn mower, » but your customers type « quiet mower for 500 m² lawn. »
As a contributor on r/SEO noted:
« Results vary every time based on dozens of parameters: system settings, personalized memory, subscription tiers, external search resources, changing syntheses, and even unknown user prompts. Yet some claim they can measure all this and track AI citations with precision? What tool in the world could do that? If it existed, it would have already made LLMs themselves completely predictable. »
I’m not saying conversational AI is a myth.
I’m saying measuring it with a citation tracker is like gauging climate by staring at a thermometer that changes every second.
It gives you a number. But that number means nothing.
It’s not a metric. It’s noise.
A GEO tool that announces « 12 citations this week » is no more reliable than a horoscope.
Next week, with the same query, it could show 2.
37 queries, 3 days: I tested it myself, and the results chilled me
I wanted to see for myself.
For 3 consecutive days, I submitted 37 identical e-commerce queries to ChatGPT, Gemini, and Perplexity.
Simple queries, like « which hybrid camera for video » or « best mattress for back pain. »
Result: 24% of responses cited a different source from one day to the next.
Some responses cited 4 sources on day 1, none on day 2.
Others shifted from a comparison link to a direct product page.
Zero consistency.
I went deeper.
Same prompt, same time, same account, two different browsers.
In private browsing, Gemini mentioned no sources for 8 out of 10 queries.
In logged-in session, it cited an average of 2.3.
The gap is enormous.
So how could a third-party tool guarantee reliable measurement of your citations?
It cannot.
I’ve never seen a single GEO dashboard reproduce the same measurement twice in a 48-hour window.
And I review 15 sites per week.
These tools sell you an illusion of control.
A number. A graph.
But behind it, no statistical foundation.
Do the people selling these tools actually know what they’re measuring?
Ask this of your agency or tool vendor:
« When your dashboard shows 7 citations, how do you know that’s not just random chance from my test prompt? »
The answer is often silence.
Or a speech about artificial intelligence.
Because the reality is simple: they measure nothing reproducible.
They aggregate unique responses, impossible to compare.
I see a parallel to an outdated era of SEO.
In the early 2000s, some measured Toolbar PageRank as a health indicator.
A score of 0 to 10, updated every three months.
SEOs fought over a PR5.
Google eventually stopped publishing it publicly.
Why? Because that metric was disconnected from real performance.
GEO trackers are the PageRank Toolbar of 2025.
A score with no link to your revenue.
Data that Google and OpenAI do not endorse.
No one certifies these measurements.
I’ve observed with 8 clients that citation spikes never preceded organic traffic jumps.
It’s always the reverse: organic traffic rises, then the AI picks up the site.
Once again, causation is backward.
Build what AI cannot ignore: the contextual coherence foundation
Stopping citation tracking does not mean ignoring conversational AI.
Quite the opposite.
The wave is here.
17% of Google queries already go through an AI overview. (source: Search Engine Land)
Voice assistants, answer engines, embedded chatbots…
All rest on one common mechanism: entity recognition.
Google and LLMs don’t search for « a site that wrote an article. »
They search for the most coherent source on a given topic.
A source that holds authority not through backlinks, but through entity density and precision.
What is a semantic cocoon but an interconnected network of entities?
I’ve delivered over 1,300 cocoons since 2016.
Every time, the mechanism is the same:
identify the core entities, structure the site around them, build an architecture with no semantic gaps.
Result: the site becomes the reference for the engine.
You don’t need to ask an AI to cite your site.
It will, because no other source is as complete.
While others read GEO dashboards, I teach the DOSE framework at BMO Academy, designed by Guillaume Attias.
What I build is this foundation.
Measure the SEO that feeds AI, not the reverse.
The metrics that matter:
- Number of pages ranking top 3 on SERPs for your strategic queries.
- Monthly organic traffic and its trend.
- Conversion rate from organic channel.
- Entity density and diversity recognized (via Google’s NLP API).
- Semantic coverage: how many adjacent topics are you addressing?
None of these depend on an LLM’s mood.
They measure the strength of your architecture.
And that strength, sooner or later, translates to AI citations.
Your next step: stop paying for phantoms
A GEO tool gives you a number.
A contextual coherence audit gives you a roadmap.
Here’s what I recommend to every e-commerce owner who wants to exist in AI answers:
- Map your entities.
What concepts must your site embody?
List them. Verify each page answers to one precise entity. - Structure into semantic silos.
A cocoon is not a sitemap. It’s logical architecture where each page strengthens the previous.
No isolated pages. - Measure your semantic authority.
How many of your pages rank positions 1–3 on long-tail informational queries?
That’s the only score that matters. - Ignore citation tools, but manually test your AI answers.
Once a month, type your key queries, note the sources.
If you’re not there, strengthen your content, not your dashboard.
I observe that sites performing best on AI overviews are not tracking sites.
They are building sites.
They chose clarity.
Not noise.
How much longer will you pay for a graph no API certifies?
What will endure in 24 months: a stale dashboard or semantic architecture that AI recognizes as the source?
Audit your semantic foundation in 30 minutes
I review your pages, analyze your entities, tell you if your site is ready for conversational AI. No pitch, no smoke-and-mirror graphs. Just the truth about your architecture.
Book a strategic call — 45 minFrequently Asked Questions
So GEO tools are useless?
They display data, but it’s neither reproducible nor tied to revenue. You can glance at them out of curiosity—never base a budget decision on them.
How do I know if my site will be cited by AI without a tool?
Measure your semantic authority on traditional SERPs. A site ranking top 3 on 25 informational queries is far more likely to be cited than an invisible site.
Do I still need to optimize content for AI?
Yes, but through entity coherence and density, not prompting or special tags. AI seeks the most complete, reliable source. A robust semantic cocoon does that work.
How much does a contextual coherence audit cost?
A first diagnostic takes 30 minutes on a discovery call. I review your pages and tell you if your architecture holds up against AI. Contact me to schedule.
What will replace GEO trackers long term?
Probably official LLM APIs, if they become paid and measurable. Today, the only reliable metric remains organic traffic and SERP position. Everything else is guesswork.
