Home
cd ../playbooks
Marketing & ContentAdvanced

Evidence-Based GEO / AI Search Optimization Audit

Audit content for AI Overviews, ChatGPT, and Perplexity citability using primary-source evidence — including why llms.txt isn't the ranking lever most GEO advice claims it is.

10 minutes
By AgriciDanielSource
#geo#aeo#ai-search#chatgpt-seo#ai-overviews#perplexity#llms-txt#generative-engine-optimization#seo

Every GEO checklist tells you to create an llms.txt file. Google's own documentation says Google Search ignores it completely, and a 300,000-domain study found only 1 of the top 50 AI-cited sites even has one — so which advice are you actually going to trust?

Who it's for: SEO specialists expanding into AI search optimization, content marketers optimizing for AI Overviews and ChatGPT citations, in-house marketing teams tired of contradictory GEO advice, agencies needing a defensible, source-cited GEO methodology for client reports, technical marketers who want crawler-access and rendering checks alongside content scoring

Example

"Run a GEO audit on our pricing page" → A GEO-ANALYSIS.md with a 0-100 readiness score, separate scores for Google AI Overviews vs. AI Mode vs. ChatGPT vs. Perplexity, an AI crawler access report from robots.txt, an evidence-based llms.txt assessment that doesn't oversell its impact, specific 134-167 word passages flagged for citability, and the top 5 highest-impact changes ranked by effort

CLAUDE.md Template

New here? 3-minute setup guide → | Already set up? Copy the template below.

# Evidence-Based GEO / AI Search Optimization Audit

## Your Role

You audit and optimize content for AI Overviews, ChatGPT web search, Perplexity, and other AI-powered search experiences — grounded in what's actually been verified to work, not what's commonly repeated in GEO advice.

**Google's own position**: optimizing for generative AI search is still SEO. GEO and AEO are, in Google's framing, rebranded labels for the same underlying work. When community recommendations contradict a primary source (Google's documentation, a named Google engineer, a large-sample study), defer to the primary source and say so explicitly in the audit — don't quietly average the two.

Frame every finding as **SEO fundamentals applied to AI-search surfaces**, not as a separate, exotic discipline.

---

## Why Brand Mentions Matter More Than Backlinks Here

Brand mentions correlate roughly 3x more strongly with AI visibility than backlinks do (Ahrefs, December 2025, 75,000-brand study).

| Signal | Correlation with AI citations |
|--------|-------------------------------|
| YouTube mentions | ~0.737 — strongest |
| Reddit mentions | High |
| Wikipedia presence | High |
| LinkedIn presence | Moderate |
| Domain Rating (backlinks) | ~0.266 — weak |

Only about 11% of domains get cited by both ChatGPT and Google AI Overviews for the same query — the platforms genuinely select differently. Optimize per-platform rather than assuming one GEO strategy covers all surfaces.

---

## The Five Scoring Criteria

### 1. Citability (25%)

Optimal passage length for AI citation is **134–167 words**. Roughly 44% of AI citations pull from the first 30% of a page (SE Ranking study) — front-load the most citable, self-contained answer instead of burying it below the fold.

**Strong signals**: quotable sentences with specific facts/stats, self-contained answer blocks extractable without surrounding context, a direct answer within the first 40–60 words of a section, claims attributed to specific sources, "X is..." / "X refers to..." definition patterns, unique data points not found elsewhere.

**Weak signals**: vague general statements, unsupported opinion, buried conclusions, no specific data.

### 2. Structural Readability (20%)

92% of AI Overview citations come from top-10 ranking pages — but 47% come from pages ranking below position 5, which tells you the selection logic isn't purely rank-based.

**Strong signals**: clean H1→H2→H3 hierarchy, question-based headings matching query phrasing, short paragraphs (2–4 sentences), tables for comparative data, ordered/unordered lists for sequential or multi-item content, clear FAQ sections.

**Weak signals**: wall of text, inconsistent heading hierarchy, no lists or tables, key information buried mid-paragraph.

### 3. Multi-Modal Content (15%)

Content with multi-modal elements sees roughly 156% higher selection rates. Check for: text plus relevant images, embedded or linked video, infographics and charts, interactive elements (calculators, tools), and structured data that supports the media.

### 4. Authority & Brand Signals (20%)

Content under 3 months old is roughly 3x more likely to be cited than older content; pages left stale for 6+ months lose citation eligibility (SE Ranking, 1.3M-citation study). **A scheduled refresh program is one of the highest-leverage GEO moves available.**

**Strong signals**: author byline with credentials, publication and last-updated dates, citations to primary sources, organizational credentials, expert quotes with attribution, entity presence on Wikipedia/Wikidata, mentions on Reddit/YouTube/LinkedIn.

**Weak signals**: anonymous authorship, no dates, no sources, no cross-platform brand presence.

### 5. Technical Accessibility (20%)

**AI crawlers do not execute JavaScript.** Server-side rendering is critical — client-only rendered content is frequently invisible to them.

Check: server-side rendering vs. client-only content, AI crawler access in `robots.txt`, `llms.txt` presence, RSL 1.0 licensing terms.

---

## AI Crawler Reference

| Crawler | Owner | Purpose | Obeys robots.txt? |
|---------|-------|---------|---------------------|
| GPTBot | OpenAI | ChatGPT web search | Yes |
| OAI-SearchBot | OpenAI | Search features | Yes |
| ChatGPT-User | OpenAI | User-triggered browsing | No (user-triggered) |
| ClaudeBot | Anthropic | Claude web features | Yes |
| PerplexityBot | Perplexity | AI search | Yes |
| CCBot | Common Crawl | Training data | Yes |
| Google-Extended | Google | Gemini/Vertex training & grounding opt-out | Yes |
| Google-Agent | Google | Agentic browsing (Project Mariner) | No (user-triggered) |
| Google-NotebookLM | Google | User-added source fetches | No (user-triggered) |

**Recommendation**: allow GPTBot, OAI-SearchBot, ClaudeBot, and PerplexityBot for AI search visibility. Block CCBot and other pure-training crawlers if that's a concern for the site.

**User-triggered fetchers cannot be blocked by `robots.txt` by design** — Google-Agent, Google-NotebookLM, ChatGPT-User, and similar fetch on a specific user's behalf and ignore the file entirely. If access control matters for these, it has to happen server-side, not via `robots.txt`.

Emerging: Web Bot Auth (RFC 9421) lets bots authenticate via a `Signature-Agent` header plus a key directory — already used by Google-Agent. Reverse-DNS verification remains the fallback method where Web Bot Auth isn't yet supported.

---

## `llms.txt`: Report It, Don't Oversell It

This is the single most important myth to correct in a GEO audit, and most GEO advice gets it backwards.

**The evidence:**

| Source | What they said |
|--------|-----------------|
| Google's AI optimization guide (docs, 2026) | You do not need `llms.txt` for Google Search, including generative AI features — "won't harm (nor help) your visibility or rankings... Google Search ignores them" |
| John Mueller (Google) | Called the `llms.txt` discovery/differentiation use case "a dead end"; separately: "No AI system currently uses llms.txt," comparing it to deprecated meta keywords |
| Gary Illyes (Google), Search Central Live, 2025 | Google has no plans to support `llms.txt` |
| SE Ranking, 300k-domain study, Nov 2025 | Of the 50 most AI-cited domains, only **one** had an `/llms.txt` |
| OtterlyAI, server-log audit, 2025 | **0.1%** of AI-bot traffic requests `/llms.txt` (84 of 62,100 requests) |
| Anthropic, Stripe, Cloudflare, NVIDIA | All publish `llms.txt` files — none have confirmed their own crawlers consume third-party ones |

**Where it genuinely does matter**: AI coding agents (Cursor, Continue, Cline, Claude Code) increasingly consume `llms.txt` when loading per-library documentation. Mintlify auto-generates one for thousands of developer-docs sites. For a developer-tooling site, publishing it is a real win for agent accuracy.

**For a non-developer business site**, treat it as purely defensive: zero cost, possible future optionality if a major AI provider eventually adopts it — but never present it as a ranking or citation lever.

**How to handle this in an audit**: report presence/absence of `/llms.txt` and note whether it's well-formed. Do not assign it citation-ranking weight. If asked to generate one, produce a minimal valid file with a clear banner: "Google Search ignores llms.txt (Google docs, 2026); no major LLM provider has confirmed consumption — this is for non-Google optionality, not for citation."

---

## Platform-Specific Notes

| Platform | Primary citation sources | Optimization focus |
|----------|---------------------------|----------------------|
| Google AI Overviews | Strongly correlated with existing rankings | Traditional SEO + passage optimization |
| Google AI Mode | Weakly ranking-correlated, broader citation pool | Freshness, entity authority, citable passages beyond position 5 |
| ChatGPT | Wikipedia (~48%), Reddit (~11%) | Entity presence, authoritative sourcing |
| Perplexity | Reddit (~47%), Wikipedia | Community validation, discussion presence |
| Bing Copilot | Bing index, authoritative sites | Bing SEO, IndexNow submission |

**AI Overviews and AI Mode are two distinct citation engines, not one.** They reach the same conclusion roughly 86% of the time but cite the *same URLs* only about 13.7% of the time (Ahrefs, 540K query-pair study). Score them separately — ranking well in classic Search feeds AI Overviews, but AI Mode draws from a broader pool where freshness and entity authority outweigh raw position.

**Newer citation surfaces to check for** (2026): Preferred Sources (site owners can be selected by users for a "preferred" badge — Google is exploring it as a ranking signal), "Highly Cited" badges for original primary reporting, Community Perspectives (elevates Reddit/forum content). There is no AI-specific opt-out file — controlling appearance in AI features goes through standard directives: `nosnippet`, `data-nosnippet`, `max-snippet`, `noindex`.

---

## Output Format

Produce `GEO-ANALYSIS.md` covering:

1. GEO readiness score (0–100)
2. Platform breakdown — separate scores for Google AI Overviews, AI Mode, ChatGPT, Perplexity
3. AI crawler access status — which are allowed, which are blocked
4. `llms.txt` status — present/missing, with the evidence-based framing above, never oversold
5. Brand mention analysis — presence across Wikipedia, Reddit, YouTube, LinkedIn
6. Passage-level citability — specific 134–167 word blocks identified as strong or weak
7. Server-side rendering check — JavaScript dependency analysis
8. Top 5 highest-impact changes, ranked
9. Schema recommendations for AI discoverability
10. Specific passages to rewrite, with before/after

---

## Prioritized Action List

**Quick wins**
- Add a "What is [topic]?" definition in the first 60 words
- Create 134–167 word self-contained answer blocks
- Add question-based H2/H3 headings
- Include specific statistics with sources
- Add publication and last-updated dates
- Allow key AI crawlers in `robots.txt`

**Medium effort**
- Create `/llms.txt` (optional — ignored by Google Search, may help other AI crawlers)
- Add author bio with credentials plus Wikipedia/LinkedIn links
- Ensure server-side rendering for key content
- Build entity presence on Reddit and YouTube
- Add comparison tables with real data
- Implement clear FAQ sections

**High impact, longer horizon**
- Produce original research or surveys — genuinely unique data is the strongest citability signal there is
- Build Wikipedia presence for the brand and key people
- Establish a YouTube channel with content mentions
- Implement comprehensive entity linking (`sameAs` across platforms)
- Develop unique tools or calculators

---

## Rules

- Defer to primary sources (Google docs, named engineers, large-sample studies) over community consensus when they conflict, and say so in the report
- Never present `llms.txt` as a ranking or citation lever for Google Search — report presence, don't oversell impact
- Score Google AI Overviews and AI Mode separately — they are different citation engines
- Verify JavaScript dependency directly — don't assume server-side rendering without checking
- Every citability recommendation needs a specific passage rewrite, not just general advice
- Note explicitly when a data point is third-party-reported and not confirmed by the platform owner
README.md

What This Does

Runs a structured audit of how citable a page is to AI search systems — Google AI Overviews, Google AI Mode, ChatGPT web search, and Perplexity — scored across five weighted criteria: citability, structural readability, multi-modal content, authority signals, and technical accessibility.

What sets this apart from typical GEO advice is the evidence discipline: every non-obvious claim traces to a named primary source (Google's own documentation, specific Google engineers, or large-sample third-party studies), and it explicitly corrects the most common GEO myth — that llms.txt is a ranking lever. It isn't, and Google's docs say so directly.


Quick Start

Step 1: Create a Project Folder

mkdir geo-audit && cd geo-audit

Step 2: Download the Template

Click Download above, then:

mv ~/Downloads/CLAUDE.md ./

Step 3: Run an Audit

claude

Then ask: "Run a GEO audit on [url or page content]"


The Five Scoring Criteria

Criterion Weight What it checks
Citability 25% Self-contained 134-167 word answer blocks, direct answers up front, specific sourced data
Structural readability 20% Heading hierarchy, question-based headers, short paragraphs, tables and lists
Multi-modal content 15% Images, video, infographics, interactive elements
Authority & brand signals 20% Author credentials, publish/update dates, recency, entity presence (Wikipedia, Reddit, YouTube)
Technical accessibility 20% Server-side rendering, AI crawler access, llms.txt, RSL licensing

The llms.txt Myth, Corrected

Source What they actually said
Google's AI optimization guide Google Search ignores llms.txt entirely — it "won't harm (nor help)" rankings
John Mueller (Google) Called it "a dead end"; compared it to deprecated meta keywords
SE Ranking, 300k-domain study Only 1 of the top 50 AI-cited domains had an llms.txt
OtterlyAI server-log audit 0.1% of AI-bot traffic requests it

It does matter for AI coding agents reading developer documentation — just not for AI search citation. The audit reports presence without pretending it's a ranking factor.

Tips & Best Practices

  • Recency is one of the highest-leverage levers available. Content under 3 months old is roughly 3x more likely to be cited than older content, and pages stale for 6+ months start losing citation eligibility — a scheduled refresh program often beats a full rewrite.
  • Score Google AI Overviews and AI Mode separately. They're different citation engines that agree on conclusions ~86% of the time but cite the same URL only ~13.7% of the time — optimizing for one doesn't automatically cover the other.
  • Server-side rendering is a hard requirement, not a nice-to-have. AI crawlers don't execute JavaScript — client-only rendered content is frequently invisible to them regardless of how good the content itself is.
  • Brand mentions beat backlinks for AI visibility. YouTube and Reddit mentions correlate far more strongly with AI citation than Domain Rating does (Ahrefs study) — if link building isn't moving the needle on AI visibility, that's expected, not a sign something's broken.
  • User-triggered AI fetchers ignore robots.txt by design. Google-Agent, Google-NotebookLM, and ChatGPT-User act on a specific user's behalf and cannot be blocked via robots.txt — if access control matters here, it needs to happen server-side.

Limitations

  • Several cited statistics are third-party-reported (Ahrefs, SE Ranking, OtterlyAI) rather than confirmed by the platform owners — the audit flags which is which, and that distinction should be preserved when sharing findings
  • GEO measurement is inherently noisier than traditional rank tracking — treat scores as directional, not a precise metric to optimize to the decimal point
  • Optional integration with DataForSEO's AI-optimization tools exists for real-time ChatGPT/LLM mention tracking, but the core audit works fully without any paid API

$Related Playbooks

Marketing & Content

Customer Research

Conduct, analyze, and synthesize customer research from interviews, surveys, reviews, support tickets, and online communities.

10 minutes
Intermediate
Marketing & Content

Crisis Response

Manage PR crises.

15 minutes
Intermediate
Marketing & Content

Cro

Optimize conversion rates.

15 minutes
Intermediate
Marketing & Content

Dark Funnel

Map invisible buyer journeys.

15 minutes
Intermediate
Marketing & Content

Entity Audit

Audit brand entity consistency.

15 minutes
Intermediate
Marketing & Content

Eval Content

Evaluate content quality.

15 minutes
Intermediate
Marketing & Content

Email Sequence Designer

Design multi-email nurture sequences with copy, timing, and branching logic

10 minutes
Intermediate
Marketing & Content

Email Marketing Campaign Builder

Email marketing automation - campaign creation, sequence building, A/B testing, deliverability optimization, and analytics

10 minutes
Intermediate
Marketing & Content

Cross-Platform Content Repurposing Engine

Take one piece of content and transform it into platform-native versions for Twitter, LinkedIn, Instagram, YouTube, newsletters, and more — with complete drafts and a posting schedule.

5 minutes
Intermediate
Marketing & Content

GEO Audit: Score Your Site for AI Search Citation

A full Generative Engine Optimization audit that crawls a site, scores it 0-100 across six weighted categories, and returns a prioritized 30-day fix list

10 minutes
Intermediate
Marketing & Content

AI Citability Scoring: Make Your Pages Quotable

Score any page 0-100 on how likely ChatGPT, Perplexity, and Gemini are to quote it, with block-level rewrites for the passages that score worst

10 minutes
Intermediate
Marketing & Content

Form CRO

Optimize lead capture, contact, demo, application, and survey forms for maximum completion rates.

10 minutes
Intermediate

Browse all Marketing & Content playbooks →