You can now log or block requests from AI crawlers and AI assistants separately with the AI Bots managed ruleset in Vercel Firewall.
AI crawlers: bots that collect content for indexing and model training
AI assistants: bots that fetch pages in response to user actions or search queries
For example, you can block AI crawlers while allowing AI assistants to retrieve your content to answer users’ questions. Vercel updates the rules as new bots are added. To configure these controls, open your project’s Security > Firewall > Rules. Under Bot Management, enable AI Bots and select the gear icon beside it. Set an action for AI crawlers and AI assistants, then review and publish your changes.
You can also modify these rule settings using the Vercel CLI:
type: embedded-entry-inline id: 30azXU4HVTfrsO9MbBOCLv
Review the changes with vercel firewall diff, then apply them with vercel firewall publish.
The AI Bots managed ruleset is available on all plans. Learn more in the documentation.