17:39
2026-07-29
justinribeiro.com
ai-infrastructure
Blocking AI Crawlers on Your Mastodon Server, Nginx Edition
AI crawlers hammering a small Mastodon server prompted Justin Ribeiro to block them via an nginx include, based on the ai-robots-txt/ai.robots.txt repository. Ribeiro advises Mastodon admins to add th…