cd /news/ai-crawlers/google-blocks-yandex · home › topics › ai-crawlers › article
[ARTICLE · art-134778] src=lr0.org ↗ pub= topic=ai-crawlers verified=true sentiment=↓ negative

Google blocks Yandex

Google's robots.txt file explicitly blocks Yandex, according to a Medium post by nikurusov titled "Google blocks Yandex: A Tale of Two robots.txt Files." The blocking was noted by a blogger who looked into Google's robots.txt and found the Yandex restriction, then criticized the Medium post for lacking substantive explanation.

read1 min views8 publishedSep 16, 2026

larrasket

I really hate slop writing. I was looking at Google's robots.txt today, found that Google explicitly blocks Yandex, so I decided to look into why, I found Google blocks Yandex: A Tale of Two robots.txt Files, and I was expecting a "tale". The article is just a small disappointing slop. I miss when even the shortest low-quality blogposts on the internet would have been at least some kind of genuine thoughts #LLM [[permlink]]

source & further reading
lr0.org — original article I remain skeptic 2026/08/15 tokens per language
── more in #ai-crawlers 4 stories · sorted by recency
── more on @google 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/google-blocks-yandex] indexed:0 read:1min 2026-09-16 · —