cd /news/ai-crawlers/ai-scrapers-are-hiding-behind-referr… · home › topics › ai-crawlers › article
[ARTICLE · art-154831] src=disassociated.com ↗ pub= topic=ai-crawlers verified=true sentiment=↓ negative

AI scrapers are hiding behind referrer spam

AI scrapers are disguising their crawling activity as referrer spam, according to a first-person account published 8 October 2026, in which a publisher reported a reputable American medical organization appearing to link to the site's front page and then to unrelated pages with no medical content. The publisher identified the pattern as an AI scraper trawling the site and said there are no effective solutions for keeping the referrer-spam scraping activity out of referrer logs.

read2 min views12 publishedOct 7, 2026
AI scrapers are hiding behind referrer spam
Image: Disassociated (auto-discovered)

AI scrapers are hiding behind referrer spam #

8 October 2026

Back in the day, referrer spam used to be a means to trick a website publisher into thinking another website was sending visitors their way.

It’s something I’ve seen often. I’ll be looking through my referrer logs, and see traffic apparently emanating from a website, usually one I’ve not heard of before.

At first I’d be stoked. Someone had found my website and liked it enough to share with their readers. Awesome. And of course I’d fallen for the ruse and gone to the supposedly referring website, only to learn there was no sign of a link to mine.

I’ve never tried to make another blogger believe I’ve linked to their website when I haven’t, so I don’t know what’s involved in engineering referrer spam. But it seems like a lot of trouble to score what might be a single visit from someone who’ll probably never return.

However, there are, or were, some websites posting lists of their traffic sources. This might prompt a visit from whoever looks at that information. This referrer list apparently also, in the past, had the effect of boosting the spamming website’s search engine rankings.

A few weeks ago I noticed a reputable American medical organisation had linked to the front page here. That didn’t seem right. Why would a website for medical professionals be linking to mine?

Of course, they weren’t. But the “visits” kept coming, and increasing. Soon they were linking to all sorts of disparate pages, none of which contain any medical or health related content at all.

It didn’t take long to recognise the pattern of page visit activity though, it was clear another AI scraper was trawling through the content here.

I looked into ways of blocking, or at least keeping the referrer spam scraping activity off my referrer logs, but as ever there really aren’t any effective solutions.

AI scrapers hiding behind referrer spam, whatever will they do next?

RELATED CONTENT

── more in #ai-crawlers 4 stories · sorted by recency
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/ai-scrapers-are-hidi…] indexed:0 read:2min 2026-10-07 · —