Thought on how to deal with AI crawlers
A blog post proposes using HTTP status codes to handle AI crawlers, noting that a site with zero published articles still receives thousands of impatient crawler requests. The post suggests 402 Paymen…
A blog post proposes using HTTP status codes to handle AI crawlers, noting that a site with zero published articles still receives thousands of impatient crawler requests. The post suggests 402 Paymen…
A developer built Argentic, a Go-based reverse proxy that charges AI scrapers per request using Lightning Network payments via L402 credentials, returning a 402 Payment Required with a Bitcoin Lightni…
Argentic, a new L402 Lightning toll booth for AI scraping agents, allows AI agents to pay in Bitcoin Lightning for access to the open web without accounts or API keys. The service returns a 402 with a…
Lightning Labs launched l402.tech on July 29, a dedicated website for the L402 protocol that enables AI agents to pay for services via Bitcoin's Lightning Network without human intervention. The proto…
Lightning Labs launched Wavelength, a non-custodial API toolkit for Bitcoin Lightning Network payments, on July 21. The toolkit lets developers integrate instant, low-fee transactions into apps and AI…
The x401 protocol extends HTTP with a cryptographic identity assertion layer, enabling servers to require verified identity before granting access and agents to prove human authorization. As AI agents…
Cinderwright has built a payment bridge that allows an AI agent holding only USDC on Base to pay a Lightning Network invoice for the first time. The agent requested a joke from an L402 service and was…
Sentry engineers encountered a rate-limiting bug when Cursor Automations exhausted a human-sized bucket of 60 requests per 60 seconds in seconds, highlighting the challenge of gating MCP servers for a…