AhrefsBot

GPTBot, OpenAI's web crawler, is the most blocked bot among websites with organic traffic, according to data from Site Stats Database tracking 880,858 sites. Over 45,000 websites block GPTBot, surpass…

AI crawlers now match Googlebot in traffic to a website that hit the front page of Hacker News, with both categories accounting for 35% of 240,060 bot visits over 30 days. AmazonBot was the most aggre…