{"slug": "ai-scrapers-are-hiding-behind-referrer-spam", "title": "AI scrapers are hiding behind referrer spam", "summary": "AI scrapers are disguising their crawling activity as referrer spam, according to a first-person account published 8 October 2026, in which a publisher reported a reputable American medical organization appearing to link to the site's front page and then to unrelated pages with no medical content. The publisher identified the pattern as an AI scraper trawling the site and said there are no effective solutions for keeping the referrer-spam scraping activity out of referrer logs.", "body_md": "## AI scrapers are hiding behind referrer spam\n\n8 October 2026\n\nBack in the day, [referrer spam](https://en.wikipedia.org/wiki/Referrer_spam) used to be a means to trick a website publisher into thinking another website was sending visitors their way. \n\nIt’s something I’ve seen often. I’ll be looking through my referrer logs, and see traffic apparently emanating from a website, usually one I’ve not heard of before.\n\nAt first I’d be stoked. Someone had found my website and liked it enough to share with their readers. Awesome. And of course I’d fallen for the ruse and gone to the supposedly referring website, only to learn there was no sign of a link to mine.\n\nI’ve never tried to make another blogger believe I’ve linked to their website when I haven’t, so I don’t know what’s involved in engineering referrer spam. But it seems like a lot of trouble to score what might be a single visit from someone who’ll probably never return.\n\nHowever, there are, or were, some websites posting lists of their traffic sources. This might prompt a visit from whoever looks at that information. This referrer list apparently also, in the past, had the effect of boosting the spamming website’s search engine rankings.\n\nA few weeks ago I noticed a reputable American medical organisation had linked to the front page here. That didn’t seem right. Why would a website for medical professionals be linking to mine?\n\nOf course, they weren’t. But the “visits” kept coming, and increasing. Soon they were linking to all sorts of disparate pages, none of which contain any medical or health related content at all.\n\nIt didn’t take long to recognise the pattern of page visit activity though, it was clear another AI scraper was trawling through the content here.\n\nI looked into ways of blocking, or at least keeping the referrer spam scraping activity off my referrer logs, but as ever there really aren’t any effective solutions.\n\nAI scrapers hiding behind referrer spam, whatever will they do next?\n\nRELATED CONTENT", "url": "https://wpnews.pro/news/ai-scrapers-are-hiding-behind-referrer-spam", "canonical_source": "https://disassociated.com/ai-scrapers-hiding-behind-referrer-spam/", "published_at": "2026-10-07 20:00:18+00:00", "updated_at": "2026-10-21 20:40:09.325429+00:00", "lang": "en", "topics": ["ai-crawlers", "artificial-intelligence"], "entities": [], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/ai-scrapers-are-hiding-behind-referrer-spam", "markdown": "https://wpnews.pro/news/ai-scrapers-are-hiding-behind-referrer-spam.md", "text": "https://wpnews.pro/news/ai-scrapers-are-hiding-behind-referrer-spam.txt", "jsonld": "https://wpnews.pro/news/ai-scrapers-are-hiding-behind-referrer-spam.jsonld"}}