Modern AI coding and shopping agents (ClaudeBot, OAI-SearchBot, PerplexityBot, Claude Code) waste up to 85% of their context window parsing inline CSS, SVGs, and layout boilerplate when fetching raw HTML.
In February 2026, HTTP content negotiation via Accept: text/markdown and the Content-Signal header emerged as the cleanest white-hat Generative Engine Optimization (GEO) pattern for SaaS and Shopify sites:
Accept: text/html) receive your normal interactive page; Accept: text/markdown) receive 1:1 visible content converted into clean YAML-frontmatter Markdown tables (Vary: Accept), cutting payload size from ~16,000 tokens to ~2,000 tokens with zero SEO cloaking risk.
We built a free real-time edge inspector — GeoReady — plus an open-source zero-dependency MCP server (yixuanrobot/geoready-mcp) that audits any URL in 5 seconds across:
robots.txt`` OAI-SearchBot, PerplexityBot, ClaudeBot, Google-Extended + firewall HTTP 403 challenge detection)/llms.txt & /llms-full.txt`` index.html fallbacks)Organization, Product/ SoftwareApplication, FAQPage) Content-Signal HTTP Headersai-train=yes, search=yes, ai-input=yes)_headers Snippet
Drop this into your static output folder's _headers file:
/*
Content-Signal: ai-train=yes, search=yes, ai-input=yes
Vary: Accept
Link: <https://yourdomain.com/llms.txt>; rel="llms-txt", <https://yourdomain.com/llms-full.txt>; rel="llms-full-txt"
uvx)
{
"mcpServers": {
"geoready-auditor": {
"command": "uvx",
"args": [
"--from",
"git+https://github.com/yixuanrobot/geoready-mcp",
"geoready-mcp"
]
}
}
}
Test your own domain's live score and generate a tailored llms.txt + robots.txt + JSON-LD kit free at https://geoready.aitruelabs.com.