Inherently incomplete. Sourced to https://archive.is/Lz4nY
| ← Older revision | Revision as of 21:27, 17 August 2026 | ||
| Line 1: | Line 1: | ||
{{Incomplete}} | {{Incomplete}} | ||
This is | This is an early/inherently incomplete list of companies who took the lead their websites purposefully blacklisted/excluded from the Internet Archive (IA) for various reasons, whether for malice reasons (plausible deniability) or not. For these websites, utilize other archive websites found [[Consumer_Rights_Wiki:Tools_for_writing_articles#Archived_citations|here]]. | || Unless there's a way for IA to have the content but not make it available to train AI, a large proportion of content sites will be blocking it, in order to avoid their content being available to train AI. So the list is very incomplete. For example, it was reported in April of 2023 "Twenty-three major news outlets, including [[The New York Times]] and [[USA Today]] have updated their [[robots.txt]] files to explicitly block the Internet Archive’s Wayback Machine crawler."<ref>{{Cite news |title=The Internet Archive just got blocked by Big News. (Paywalled; Archive.is has complete article) |url=https://amjohnphilip.medium.com/the-internet-archive-just-got-blocked-by-big-news-f74fe59bbd2f |archive-url=https://archive.is/Lz4nY |archive-date=17 Aug 2026}}</ref> | ||| There might be websites with [[Cloudflare]] DDoS protection, which falls in a grey area for archival purposes, though should not be listed on this article. | There might be websites with [[Cloudflare]] DDoS protection, which falls in a grey area for archival purposes, though should not be listed on this article. |