{"slug": "serving-http-accept-text-markdown-content-signal-llms-full-txt-on-cloudflare-geo", "title": "Serving HTTP Accept: text/markdown, Content-Signal & /llms-full.txt on Cloudflare Pages (2026 GEO Guide)", "summary": "A developer built GeoReady, a free real-time edge inspector, and an open-source zero-dependency MCP server (yixuanrobot/geoready-mcp) that audits any URL in about five seconds for AI-agent readiness. The tool checks robots.txt rules for bots like OAI-SearchBot, PerplexityBot and ClaudeBot, llms.txt and llms-full.txt presence, JSON-LD structured data, and Content-Signal HTTP headers. The project promotes serving Markdown via HTTP Accept: text/markdown content negotiation, which the developer says cuts payloads from roughly 16,000 to 2,000 tokens.", "body_md": "Modern AI coding and shopping agents (`ClaudeBot`, `OAI-SearchBot`, `PerplexityBot`, `Claude Code`) waste up to **85% of their context window** parsing inline CSS, SVGs, and layout boilerplate when fetching raw HTML.\n\nIn February 2026, HTTP content negotiation via `Accept: text/markdown` and the `Content-Signal` header emerged as the cleanest white-hat **Generative Engine Optimization (GEO)** pattern for SaaS and Shopify sites:\n\n`Accept: text/html`) receive your normal interactive page;` Accept: text/markdown`) receive 1:1 visible content converted into clean YAML-frontmatter Markdown tables (`Vary: Accept`), cutting payload size from ~16,000 tokens to ~2,000 tokens with zero SEO cloaking risk.\nWe built a free real-time edge inspector — **[GeoReady](https://geoready.aitruelabs.com)** — plus an open-source zero-dependency MCP server ([`yixuanrobot/geoready-mcp`](https://github.com/yixuanrobot/geoready-mcp)) that audits any URL in 5 seconds across:\n\n`robots.txt`` OAI-SearchBot`, `PerplexityBot`, `ClaudeBot`, `Google-Extended` + firewall HTTP 403 challenge detection)`/llms.txt` & `/llms-full.txt`` index.html` fallbacks)`Organization`, `Product`/` SoftwareApplication`, `FAQPage`)` Content-Signal` HTTP Headers`ai-train=yes, search=yes, ai-input=yes`)`_headers` Snippet\nDrop this into your static output folder's `_headers` file:\n\n```\n/*\n  Content-Signal: ai-train=yes, search=yes, ai-input=yes\n  Vary: Accept\n  Link: <https://yourdomain.com/llms.txt>; rel=\"llms-txt\", <https://yourdomain.com/llms-full.txt>; rel=\"llms-full-txt\"\n```\n\n`uvx`)\n\n```\n{\n  \"mcpServers\": {\n    \"geoready-auditor\": {\n      \"command\": \"uvx\",\n      \"args\": [\n        \"--from\",\n        \"git+https://github.com/yixuanrobot/geoready-mcp\",\n        \"geoready-mcp\"\n      ]\n    }\n  }\n}\n```\n\nTest your own domain's live score and generate a tailored `llms.txt` + `robots.txt` + JSON-LD kit free at **[https://geoready.aitruelabs.com](https://geoready.aitruelabs.com)**.", "url": "https://wpnews.pro/news/serving-http-accept-text-markdown-content-signal-llms-full-txt-on-cloudflare-geo", "canonical_source": "https://dev.to/yixuanrobot/serving-http-accept-textmarkdown-content-signal-llms-fulltxt-on-cloudflare-pages-2026-geo-l6j", "published_at": "2026-11-20 03:05:26+00:00", "updated_at": "2026-11-20 03:13:02.114659+00:00", "lang": "en", "topics": ["generative-engine-optimization", "ai-crawlers", "agent-protocols", "structured-data", "ai-tools"], "entities": ["GeoReady", "Cloudflare Pages", "yixuanrobot/geoready-mcp", "ClaudeBot", "OAI-SearchBot", "PerplexityBot", "Google-Extended", "Claude Code"], "also_reported_by": [], "takeaway": "Serving Markdown via Accept: text/markdown with Vary: Accept and a Content-Signal header cuts agent payloads from about 16,000 to 2,000 tokens, and the GeoReady MCP server audits robots.txt, llms.txt, JSON-LD and Content-Signal for any URL in about five seconds.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/serving-http-accept-text-markdown-content-signal-llms-full-txt-on-cloudflare-geo", "markdown": "https://wpnews.pro/news/serving-http-accept-text-markdown-content-signal-llms-full-txt-on-cloudflare-geo.md", "text": "https://wpnews.pro/news/serving-http-accept-text-markdown-content-signal-llms-full-txt-on-cloudflare-geo.txt", "jsonld": "https://wpnews.pro/news/serving-http-accept-text-markdown-content-signal-llms-full-txt-on-cloudflare-geo.jsonld"}}