Amazonbot

mentions 2 type Organization feed RSS

// recent coverage 2 mentions

20:30

2026-08-27

dev.to

ai-tools

JavaScript Navigation Can Hide Pages From AI Crawlers, 41-Day Test Finds

A 41-day experiment reported by Search Engine Land found that JavaScript-powered navigation can hide website pages from AI crawlers. GPTBot and ClaudeBot discovered zero pages available only through J…

18:52

2026-06-25

dev.to

artificial-intelligence

What actually visits a self-hosted website in 2026? Humans, AI crawlers, and 6,400 automated attacks

A developer running a self-hosted website on a Raspberry Pi 4B built a public observability dashboard that separates traffic into humans, search engine crawlers, AI retrieval agents, and automated att…

// co-occurs with top 8 entities

GPTBot 2 ClaudeBot 2 Raspberry Pi 4B 1 GoAccess 1 PerplexityBot 1 Google 1 Search Engine Land 1 Googlebot 1

// topics top 6 topics

developer tools 2 artificial intelligence 1 large language models 1 ai agents 1 ai infrastructure 1 ai tools 1