02:01
2026-08-13
ezy.ai
ai-research
We put llms.txt on 83 websites. In 12 weeks OpenAI's crawler read it 7 times
EZY Research's 12-week study of 83 websites found OpenAI's GPTBot fetched llms.txt only 7 times versus 3,990 robots.txt fetches, while Meta's crawler fetched llms.txt 193 times, more than its 172 robo…