{"slug": "agent-friendly-user-docs-for-wagtail", "title": "Agent-friendly user docs for Wagtail", "summary": "The Wagtail project published its user guide documentation in four agent-oriented formats — an MCP server, Markdown served via content negotiation built on Wagtail 8.1's Vary HTTP header support, a revised llms.txt sitemap, and experimental WebMCP — after testing them across 33 information retrieval tasks with 5 harnesses and more than 10 models. The project reported that agents used llms.txt in only 11% of runs when the file was linked from Markdown responses as a \"documentation index,\" versus below 1% when it was unlinked, rendered as vanilla HTML, or inlined in every response, and 52% when the agent's search functionality was unavailable. The project called the formats \"clearly not a transformational technology\" but worth setting up for added redundancy and ease of use for agents.", "body_md": "# Agent-friendly user docs for Wagtail\n\n## Four new documentation formats for AI agents\n\nAfter weeks of testing, we are now making Wagtail’s user guide documentation [available in four new formats](https://guide.wagtail.org/en/about/documentation-formats/). Try them out and let us know what you think!\n\n## The new formats\n\nHere they are in the order of \"most\" to \"least\" useful based on the evidence we collected.\n\n### MCP server\n\nOnce set up, the [user guide MCP server](https://guide.wagtail.org/en/about/documentation-formats/#mcp-server) allows direct fetching of docs, and site-wide search, in a format optimized for agents doing tasks.\n\n### **Markdown with content negotiation**\n\nEvery page of the guide now serves Markdown variants on request, based on the [Wagtail 8.1](https://wagtail.org/blog/wagtail-8-1/) support for the Vary HTTP header and Markdown conversion. This is useful for task agents but also crawlers for training and search.\n\n### **llms.txt**\n\nWe revised the guide website’s [llms.txt](https://guide.wagtail.org/llms.txt) file to facilitate navigation, using it as an agent-friendly sitemap. While almost no agents reach for this file, it works very well when signposted for them, particularly for simpler agents with no built-in search tools.\n\n### **WebMCP**\n\nJust like the MCP server, you can use [webMCP](https://developer.chrome.com/docs/ai/webmcp) to search and retrieve pages of the site. This is very experimental so only works with a limited number of browser-based agents.\n\n## Discovery\n\nYou can find all those options and more in the site’s [Documentation formats](https://guide.wagtail.org/en/about/documentation-formats/) page. For agents, the site also advertises the formats according to the [Agentic Resource Discovery specification](https://agenticresourcediscovery.org/).\n\n## How we tested them\n\nWe built an evaluation suite of information retrieval tasks, for common documentation requests. It compares 5 harnesses and 10+ models on 33 tasks, which we ran over all of the different formats to increase the success of the tasks as well as the cost / efficiency.\n\nFor example, for the runs where agents used llms.txt, usage was:\n\n- Below 1% when not linked from anywhere\n- Below 1% when rendering vanilla HTML for agents\n- Below 1% in Markdown but with llms.txt contents inlined in every response.\n- At 11% when the file was linked from the Markdown responses as a \"documentation index\"\n- **At 52% when the agent’s search functionality wasn’t available.**\n\nThis is clearly not a transformational technology but it’s well worth setting up for the added redundancy and ease of use for agents.\n\nIf you want to see our full results and how this applies to the wider Wagtail ecosystem, be sure to join [Agent readiness for Wagtail sites](https://wagtail.org/wagtail-space-2026/agent-readiness-for-wagtail-sites/) as part of [Wagtail Space 2026](https://wagtail.org/wagtail-space-2026/) later today! And we also have a corresponding [Guide to GEO presentation (aka really good SEO)](https://wagtail.org/wagtail-space-2026/a-wagtail-editor-s-guide-to-geo-aka-really-good-seo/) for editors.", "url": "https://wpnews.pro/news/agent-friendly-user-docs-for-wagtail", "canonical_source": "https://wagtail.org/blog/agent-friendly-user-docs-for-wagtail/", "published_at": "2026-11-19 00:00:00+00:00", "updated_at": "2026-11-19 09:13:45.445583+00:00", "lang": "en", "topics": ["ai-agents", "agent-protocols", "ai-crawlers", "generative-engine-optimization", "developer-tools"], "entities": ["Wagtail", "MCP", "WebMCP", "Wagtail Space 2026", "Agentic Resource Discovery"], "also_reported_by": [], "takeaway": "Linking llms.txt from Markdown responses as a \"documentation index\" raised agent usage to 11% from below 1% unlinked, and to 52% when the agent had no search tool, across 33 retrieval tasks.", "recommendation": {"advice": "Signpost llms.txt as a \"documentation index\" inside your Markdown responses and keep it available for agents without search tools, where usage reached 52% versus below 1% when unlinked.", "playbook": "agent-architecture", "playbook_url": "https://wpnews.pro/playbooks/agent-architecture"}, "alternates": {"html": "https://wpnews.pro/news/agent-friendly-user-docs-for-wagtail", "markdown": "https://wpnews.pro/news/agent-friendly-user-docs-for-wagtail.md", "text": "https://wpnews.pro/news/agent-friendly-user-docs-for-wagtail.txt", "jsonld": "https://wpnews.pro/news/agent-friendly-user-docs-for-wagtail.jsonld"}}