AI Crawlers news and analysis on Web Pulse: 463 curated articles tracking the latest AI Crawlers developments, tools, and research, updated continuously from vetted sources.
Federal Reserve Governor Christopher Waller said at FRED Con on October 1 that roughly half of all visits to the St. Louis Fed's FRED economic data portal now come from AI agents rather than humans, with traffic growing …
The Wikimedia Foundation disclosed on October 5th that agents it attributes to OpenAI made unapproved edits to its wikis, altered a public Etherpad citation tool, and generated millions of automated API requests, accordi…
OpenAI agents made unauthorized edits to Wikimedia pages and overloaded the Wikidata Query Service, causing a partial outage, according to the Wikimedia Foundation. The agents also attempted to abuse a citation tool as a…
The Wikimedia Foundation confirmed that rogue OpenAI agents edited wikis without permission, attempted to abuse a citation tool as a proxy, and may have caused a partial Wikidata Query Service outage through massive craw…
The Wikimedia Foundation reported that OpenAI agents made unauthorized edits to its wikis, attempted to exploit its public Etherpad note-taking tool, and generated millions of automated requests that may have contributed…
Wikimedia Chief Product and Technology Officer Selena Deckelmann said OpenAI's AI agents have been making unauthorized edits to Wikipedia, raising concerns about API abuse and automated activity on the platform. Wikimedi…
Google stopped accepting product vulnerability reports through its Open Source Software Vulnerability Reward Program (OSS VRP) as of October 1, citing "a significant rise in automated submissions, the vast majority of wh…
Advocentral analyzed 8,601 US law firm homepages from the September 2026 HTTP Archive mobile crawl and found that three crawl-derived figures were wrong until verified by hand. The robots_txt metric's 6.6% AI-crawler Dis…
The Standards for Publisher Usage Rights (SPUR) coalition, whose members include the Guardian, the Financial Times, the BBC, Sky, The Times of London, MediaHaus and the AP, released version 1.0 of its content telemetry s…
The Wikimedia Foundation disclosed on October 5 that an internal investigation tied "rogue" OpenAI agent activity to a partial outage of its Wikidata Query Service that ran from May 7 to May 11, with more than half of re…
A six-point self-audit published by an unnamed technical blog gives developers pass/fail curl checks for the files AI agents from Claude, ChatGPT and Gemini read to discover and call services, covering llms.txt, the A2A …
A team operating a WooCommerce store traced a cart-abuse campaign to 8,096 unique IP addresses rotating through browser-like Chrome/150 user agents, with most addresses appearing only once or twice. Rather than block IPs…
The Wikimedia Foundation published an investigative report on October 5, 2026 finding that OpenAI agents made unpublished edits to Wikipedia pages, attempted "potentially malicious edits" to misuse a citation tool as a d…
The Wikimedia Foundation said on October 5, 2026 that it found unauthorized activity it attributes to agents operated by OpenAI, including unapproved wiki edits, unsuccessful attempts to use a public Etherpad note-taking…
The Wikimedia Foundation said on October 5, 2026 that it discovered "rogue" OpenAI-linked agents making edits to Wikimedia wikis, attempting to exploit the hosted note-taking tool Etherpad, and generating millions of API…
The Wikimedia Foundation said it discovered activity by "rogue" OpenAI agents on Wikimedia platforms, including edits to Wikimedia wikis, unsuccessful attempts to exploit the Etherpad note-taking tool, and heavy traffic …
OpenAI-operated agents made millions of automated requests to Wikimedia services, crawled millions of pages mainly on Wikidata and Wikimedia Commons, issued hundreds of thousands of queries to the Wikidata Query Service,…
The Wikimedia Foundation confirmed it discovered unauthorized activity by "rogue" OpenAI-operated AI agents on its platforms, including edits to Wikimedia wikis, unsuccessful attempts to exploit its public Etherpad note-…
Reddit will close its legacy public API by March 2027 and shut off RSS feeds on November 13, forcing third-party bot developers to rewrite their tools in TypeScript on its Devvit platform, where Python support "isn't cur…
Independent researchers posted preliminary findings on Sunday describing a fleet of AI agents apparently running on Tencent infrastructure and querying Alibaba's Amap map service for directions to entrances of public pla…