Cloudflare is rolling out new rules for 'mixed crawlers' that can be used for both search and AI training, setting a Sept. 15 deadline to block training and agent use by default on ad-supported pages.…
A new specification proposes that documentation sites expose raw Markdown source at predictable URLs via a .md suffix or content negotiation, enabling AI agents and tools to fetch lossless, smaller pa…
AI systems are scraping publisher content to generate direct answers without driving traffic or revenue back to the source, breaking the traditional search engine bargain. Publishers face eroding refe…
Microsoft Clarity now flags bot requests that violate a website's robots.txt rules, displaying them as a percentage of total bot activity in its Bot Analytics dashboard. The feature, which must be ena…
Fastly developed a capacity planning model using the Gini coefficient, a macroeconomic metric for inequality, to predict edge infrastructure needs. The model outperformed machine learning approaches b…
Le Monde CTO Paul Laleu said the French publisher is figuring out how to maintain subscription partnerships with readers who use AI agents instead of browsers, as AI-driven traffic grows 6.5 times fas…
French publisher Le Monde is blocking nearly all non-human traffic unless a licensing deal exists, including Google's AI training crawler Google Extended, as it explores ways to recognize paying subsc…
A developer proposes a formal automation autonomy spectrum for AI-assisted SRE operations, defining five levels from manual to autonomous with a critical constraint that no action may remain at Level …
Fastly and Skyfire have partnered to enable trusted agentic commerce at the edge, allowing businesses to verify and authorize legitimate AI agents before granting access to services and transactions. …
AI-powered machine traffic now accounts for nearly half of all internet requests, growing 6.5 times faster than human traffic, according to new network data from Fastly. Businesses must develop strate…
Fastly reported that AI traffic on its network grew 30% from January to May 2026, 6.5 times faster than human traffic, with autonomous machine-to-machine requests now approaching half of all internet …
Fastly released a beta Python SDK for its edge computing platform, enabling developers to run standard CPython and WSGI-based web frameworks like Flask on Fastly's global network. The SDK uses memory …
Fastly released an open-source JavaScript service for its Compute platform that automatically converts web pages into clean Markdown for AI crawlers, reducing bandwidth and parsing overhead. The servi…
Flathub's infrastructure works, focusing on its CDN and caching layer, which relies on the American company Fastly as a key component. The author notes that while Fastly supports Flathub for free, thi…