PyreCrawl (io.github.SanggonBoy/PyreCrawl@0.2.2)

PyreCrawl v0.2.2, a self-hosted web scraping and crawling tool for AI agents, was published to the official MCP registry on 2026-09-04 and is distributed as pyrecrawl on PyPI. The tool is not yet evaluated by the mcpindex gate, which pins tool contracts and holds calls on silent contract drift, so agents should treat it as not-yet-cleared until a verdict is recorded.

← Index /leaderboard PyreCrawl One tool for AI agents to scrape, crawl, extract, map, and search the web. Self-hosted, no API keys. The current version, v0.2.2, was published to the official MCP registry on 2026-09-04. It is distributed as pyrecrawl on PyPI, filed under Web Scraping by this index. Removals and unreachable sources are measured across every server this index tracks, contract drift across the servers that answer in consecutive snapshots; the index's current counts /stats put this record in context. Using PyreCrawl in Claude, Cursor, Gemini CLI, Cline, or Zed? MCP tool contracts can change remotely with no version bump. The mcpindex gate pins each contract and HOLDs the call when it drifts-before your agent acts. Zero credentials. This is not the package install for this server itself use Install this server for that . Rewrites your MCP host config so each server launches behind the gate. Inspect first: curl -fsSL https://mcpindex.ai/install.sh | less uv tool install mcpindex-gate && mcpindex-config-wire method /methodology Verdict not yet evaluated for this tool. The semantic screen takes adversarial cases first; coverage rolls out as the corpus expands 15/150 labels to graduation . The deterministic conformance probe is built but has not yet run on the public corpus, so a recorded verdict here is REVIEW or UNVERIFIED, never a clearing ALLOW. Until a verdict is recorded, an agent should treat this tool as not-yet-cleared and fall back to its own checks. Method: the eval, four-state verdict, honest limits /methodology . Own this server? Screen its description → /screen That verdict was true at screening time snapshot 2026-09-04 . Contracts can change after screening, with no version bump. The gate pins PyreCrawl’s tool contracts on first sight and holds any silent change before your agent acts - the check that keeps being true on Tuesday. See your first HOLD in 2 minutes → /guides/install-the-gate-first-hold Related: how to trust an MCP server /guides/how-to-trust-an-mcp-server · screen before install /guides/screen-mcp-server-before-install · silent contract drift /guides/mcp-silent-contract-drift methodology /methodology Scrape-LEio.github.nolindnaidoo/scrape-le /server/io-github-nolindnaidoo-scrape-le Analyse robots.txt content and report whether a path may be crawled. ReefAPIio.github.reefapi/reefapi-mcp /server/io-github-reefapi-reefapi-mcp One MCP server for 180+ live web-data APIs returning clean JSON from sites that block scrapers. io.github.ScrapeGraphAI/scrapegraph-mcpio.github.ScrapeGraphAI/scrapegraph-mcp /server/io-github-scrapegraphai-scrapegraph-mcp AI-powered web scraping and data extraction capabilities through ScrapeGraph API