cd /news/generative-engine-optimization/the-six-kinds-of-pages-llms-actually… · home › topics › generative-engine-optimization › article
[ARTICLE · art-166746] src=dev.to ↗ pub= topic=generative-engine-optimization verified=true sentiment=· neutral

The six kinds of pages LLMs actually cite (and how to find yours in an afternoon)

A developer outlined a repeatable method for auditing which pages AI answer engines cite, running twelve buyer prompts across ChatGPT, Perplexity and Gemini and clustering every cited URL into six buckets: directories, listicles and comparisons, docs and changelogs, community threads, news and editorial, and code and lists. The approach compares citation counts against where a brand actually appears to produce a gap list, and flags accidental robots.txt blocks on GPTBot, ClaudeBot, PerplexityBot and Google-Extended as a common failure. The developer also built a tool, bidvix, to track mention rate and cited URLs across five models.

by read2 min views1 publishedNov 10, 2026

Last time I wrote about auditing whether AI mentions your brand. The part people ask about is always the same: which pages get cited, and how do I get on them?

Here's the short version: run your buyer prompts, collect every URL the answer cites, and cluster them. In every audit I've done, the citations fall into six buckets. Your job is to find the buckets where you're absent but reachable.

Twelve prompts, four families: category, problem, comparison, brand. Run them in ChatGPT (with search), Perplexity and Gemini, logged out. Copy every source URL each answer cites into one column. Don't judge yet, just collect — 60 to 100 rows is normal.

Every URL will land in one of these:

Bucket What it looks like How you get in
Directories "Top 40 AI tools", niche tool indexes Free/paid submission forms
Listicles & comparisons "Best X for Y in 2026", "A vs B" Pitch the author, or publish your own comparison page
Docs & changelogs Product docs, release notes, pricing pages Yours to write — make one page answer one question
Community threads Reddit, Quora, HN, Indie Hackers, forums Answer real questions, disclose you're the maker
News & editorial Trade press, launch coverage Harder; usually needs a story, not a product
Code & lists GitHub repos, awesome-lists, package docs A PR, if your tool is developer-adjacent

Count rows per bucket. Two patterns come up constantly:

Now compare with where you actually exist. The gap list is your roadmap — and it's usually shorter than it feels.

Before any of this works, two things are often quietly broken:

robots.txt for GPTBot, ClaudeBot, PerplexityBot, Google-Extended. Plenty of sites block them by accident via a copied template. Two years of content behind a crawler block is a common, embarrassing finding. The failure mode is trying all six at once. I'd pick: one directory pass (10 submissions), one community pass (3 thoughtful answers, disclosure included), and one content pass (5 answer-shaped pages — one question per page, answer in the first 40 words).

Then re-run the same twelve prompts two to four weeks later and count the same buckets. If the distribution shifted toward sources you control, it's working. If it didn't, you were probably working on the wrong bucket — which is exactly the thing measurement is for.

If you'd rather not build the spreadsheet, I made bidvix for the measurement half (mention rate + cited URLs across five models). The clustering above is the part that actually changes what you do, and it works fine in a notebook.

── more in #generative-engine-optimization 4 stories · sorted by recency
── more on @chatgpt 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/the-six-kinds-of-pag…] indexed:0 read:2min 2026-11-10 · —