05:02
2026-08-15
dejan.ai
ai-infrastructure
Google, Anthropic and OpenAI crawlers fetched dejan.ai's robots.txt 1,150 times and its llms.txt 4 times in 30 days
In a 30-day server-log census of dejan.ai's machine-readable files, Google, Anthropic and OpenAI crawlers fetched robots.txt 1,150 times, the OKF content bundle 23 times, and llms.txt 4 times (none frβ¦