cd /news/generative-engine-optimization/how-to-automate-ai-search-llms-txt-e… · home › topics › generative-engine-optimization › article
[ARTICLE · art-174056] src=dev.to ↗ pub= topic=generative-engine-optimization verified=true sentiment=↑ positive

How to Automate AI Search (llms.txt) & EU EAA (WCAG 2.2) Audits with Apify, MCP & n8n

A developer built four pay-per-event Apify Actors that automate AI search readiness and accessibility audits, including one that checks robots.txt policies for eight major AI crawlers, validates JSON-LD, scores pages 0–100, and generates ready-to-upload llms.txt and llms-full.txt files at $0.01 per page. A second Actor uses headless Chrome and axe-core to run WCAG 2.2 AA audits, maps DOM violations to EN 301 549 clauses, and exports a Markdown remediation checklist and CSV at $0.05 per page. All four Actors run with limited permissions and can be triggered via API, n8n, or Apify's MCP server.

key takeaway

Apify's AI-readiness Actor checks robots.txt for eight AI bots, validates JSON-LD and emits llms.txt/llms-full.txt at $0.01 per page, while the accessibility Actor runs axe-core in headless Chrome and maps violations to EN 301 549 at $0.05 per page.

by read2 min views6 publishedNov 22, 2026

Two technical audits have quickly become mandatory for modern engineering and SEO teams:

GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended) aren't accidentally blocked in robots.txt, validating Schema.org JSON-LD entities, and serving clean /llms.txt + /llms-full.txt indices at your site root.WCAG 2.2 AA audits via axe-core and mapping DOM violations directly to EN 301 549 clauses before compliance deadlines hit. Instead of paying $99–$299/month for separate SaaS subscriptions, we built 4 lightweight, Pay-Per-Event Apify Actors that you can trigger on demand via API, n8n, or Claude / Cursor MCP (mcp.apify.com).

llms.txt & Score AI Search Readiness ($0.01 / page) Actor: AI Search (GEO / AEO), llms.txt & Markdown Generator

It crawls your site using fast HTTP (CheerioCrawler), inspects robots.txt policies for 8 major AI bots, validates JSON-LD structured data, scores every page (0–100), and outputs ready-to-upload llms.txt and llms-full.txt files into the Key-Value Store.

curl -X POST "https://api.apify.com/v2/acts/sadis~geo-llms-ai-readiness-auditor/runs?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "startUrl": "https://example.com",
    "maxPages": 25,
    "generateLlmsTxt": true,
    "generateLlmsFullTxt": true
  }'

$0.05 / page) Actor: WCAG 2.2 & EU EAA Accessibility Auditor (EN 301 549)

Uses headless Chrome (PlaywrightCrawler) + official axe-core to evaluate rendered DOM states, maps violations to EU EN 301 549 clauses, and exports an executive Markdown remediation checklist (EAA_REPORT.md) plus EAA_VIOLATIONS.csv.

curl -X POST "https://api.apify.com/v2/acts/sadis~wcag-eaa-accessibility-auditor/runs?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "startUrl": "https://example.com",
    "maxPages": 10,
    "wcagStandard": "wcag22aa",
    "includeBestPractices": true
  }'

$3.00 / 1,000 URLs) — Recursively audits XML sitemaps, traces hop-by-hop redirect chains (301/302/307/308), and flags canonical mismatches or accidental noindex tags.$0.80 / 1,000 emails) — Zero-browser DNS validation ( MX, SPF, DMARC, disposable & role-based filtering) for CRM hygiene before outbound campaigns. All four tools run with Limited Permissions and work seamlessly with Apify's MCP server:

{
  "mcpServers": {
    "apify": {
      "command": "npx",
      "args": [
        "-y",
        "@apify/actors-mcp-server",
        "--actors",
        "sadis/geo-llms-ai-readiness-auditor,sadis/wcag-eaa-accessibility-auditor,sadis/sitemap-canonical-redirect-auditor,sadis/bulk-email-mx-dmarc-validator"
      ],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_TOKEN"
      }
    }
  }
}

You can test all 4 Actors on the free Apify tier here: https://apify.com/sadis

── more in #generative-engine-optimization 4 stories · sorted by recency
── more on @apify 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/how-to-automate-ai-s…] indexed:0 read:2min 2026-11-22 · —