{"slug": "google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web", "title": "Google Lost Its Scraping Case – Now You Have To Pick A Side On The Open Web", "summary": "A federal judge in California dismissed Google's DMCA anti-circumvention claims against SerpApi, ruling that SearchGuard, Google's anti-bot system, protects ad revenue rather than a copyrighted work. Chief Judge Yvonne Gonzalez Rogers threw out the claims with prejudice, allowing Google 21 days to refile a narrow version concerning Knowledge Panel images. The decision reinforces the principle that publicly accessible web content may be read by machines, including those scraping Google's own results.", "body_md": "Here is a sentence I did not think I would write: I am on the side of a search-scraper that resells data to AI companies. Not because SerpApi is the good guy. There is no good guy here. But a federal judge in California ruled against Google in its fight with them, and the principle underneath the ruling is the right one, even if it showed up wearing the ugliest costume available. If it is on the open web, a machine is allowed to read it. And that has to include the machine reading Google. You do not get to spend more than two decades building the richest library on earth by crawling everyone else’s pages, and then act appalled when someone aims a crawler at yours.\n\nSo either we actually mean this [open web](https://www.searchenginejournal.com/google-search-sends-23-of-queries-to-the-open-web/578724/) thing, or we stop saying it.\n\n## What The Court Actually Said\n\nOn July 20, Chief Judge Yvonne Gonzalez Rogers [tossed Google’s DMCA claims against SerpApi](https://chatgptiseatingtheworld.com/2026/07/20/judge-gonzalez-rogers-dismisses-googles-dmca-anti-circumvention-claim-v-serpapi-for-alleged-circumvention-of-searchguard-v-scraping-google-results/), a company whose whole business is scraping Google’s search results and reselling them through an API, more and more of it to AI companies. Google’s theory was that SerpApi broke the law by getting around SearchGuard, its anti-bot system. If you have not heard of SearchGuard, join the club: It is the internal machinery Google uses to spot automated traffic and stop it from scraping search results, the bouncer on the door of Google’s results. Google’s claim was that beating that bouncer counts as illegal circumvention under the DMCA, the same law that makes it illegal to crack the copy protection on a DVD. The judge was not convinced. Her reasoning: SearchGuard protects Google’s ad revenue, not a copyrighted work, and [DMCA anti-circumvention](https://www.searchenginejournal.com/court-dismisses-googles-dmca-claims-against-serpapi/583033/) is about copyright. A wall around your business model is not a lock on a copyrighted file. She threw the claim out with prejudice wherever no copyrighted content was involved, and gave Google 21 days to come back with a narrow version about Knowledge Panel images. Good luck with that.\n\nLet me be honest about the cast. SerpApi scrapes at industrial scale and resells the results, much of it feeding the exact AI companies everyone is nervous about, so no, not a sympathetic plaintiff. Google is a trillion-dollar company that built itself by crawling the open web and now wants [copyright law](https://www.searchenginejournal.com/google-defends-ai-training-as-fair-use-in-governance-paper/580776/) to stop others crawling it, which is not a sympathetic position either. This is two heavyweights fighting over who gets to package the web, and the rest of us are watching from the cheap seats. It is the worst-person-you-know-makes-a-great-point meme, in legal-docket form.\n\n## The People Aren’t In This Fight\n\nWhen the story gets told as SerpApi versus Google, something goes missing: The open web was supposed to be by the people and for the people. Look at this fight and try to find a person in it. The users whose searches and pages and questions make the web worth scraping in the first place are not a party to anything. Two companies brawl over the spoils, a judge draws a line, and everyone else reads about the outcome later.\n\nBut the line she drew is the honest one, and I will take an honest line even out of an ugly fight. If it is on the web, it should be reachable by whatever wants to read it. That is a lovely principle when it is someone else’s wall coming down. It stings when you remember who owns the biggest crawler on the planet. Google’s entire existence is the open web turned into a product. Running that playbook for more than two decades and then declaring your own results the one crawl-proof corner of the internet is not a legal position, it is nerve. Google is fair game too. That is the deal it signed the day it pointed its first crawler at somebody else’s website.\n\n## And This Is The Whole Agentic Web, Not A Scraping Footnote\n\n“On what terms is an automated visitor allowed onto public web content?” is the founding question of the [agentic web](https://www.searchenginejournal.com/the-web-is-growing-a-second-layer-almost-a-third-head/581147/), not some niche scraping spat, and it does not end with SerpApi. A scraper reselling results, an answer engine reading your pages to cite you, a [shopping agent](https://www.searchenginejournal.com/agentic-commerce-what-seos-need-to-consider-acp-ucp/563503/) turning up to buy on someone’s behalf, an assistant pulling your specs to compare you against a competitor. In the eyes of the law, those are one thing: an automated visitor on public content. SerpApi is the ugly early test case. Whatever boundary the courts draw around it is the boundary for all of them.\n\nAnd this is not a someday problem. A real and growing share of what hits your website already is not human. The terms for how much say you get over those visitors are being written right now, one lawsuit at a time, in fights you have no seat in. Which is exactly why the one decision that is yours matters as much as it does.\n\n## Where You Actually Sit\n\nYou are in this too, and you are two things at the same time, and they do not get along.\n\nYou are one of the people. Your content gets scraped, resold, and poured into models, and nobody sent you a form to sign. The fight is over your web too, and your seat at the table is the same size as the users’: none.\n\nYou are also a tiny Google. You would like a say over who takes your content and on what terms, and maybe you would like to [get paid for it](https://www.searchenginejournal.com/charging-ai-bots-decides-which-agents-can-still-cite-you/580050/). This ruling trims the tools for that, because the precedent has nothing to do with Google specifically. An anti-bot wall that guards your revenue instead of a copyrighted work is what most websites are running, and the court said that kind of wall does not buy you DMCA protection.\n\nThis is the same frontier the [Amazon v. Perplexity case](https://www.searchenginejournal.com/amazon-vs-perplexity-the-cfaa-case-that-decides-whether-ai-agents-can-visit-your-website/575499/) is testing from the opposite end. That one runs on the CFAA and asks whether an [AI agent](https://www.searchenginejournal.com/google-tells-developers-to-build-for-ai-agents-not-just-humans/573587/) counts as an authorized visitor when it acts on your website. This one runs on the DMCA and asks whether your anti-bot wall counts as copyright protection. Different statutes, same question underneath, and the toolkit for keeping machines out keeps coming up shorter than the people counting on it hoped.\n\n## Stop Waiting For Someone Else To Decide\n\nThe takeaway is not a checkbox to go flip. It is where your head should be.\n\nYou do not get to feast on the open web for discovery, every scrap of traffic you were ever found, cited, or ranked for, and then clutch your pearls when that same openness lets a machine you do not care for read you too. It is one web, not two. The consistency runs both ways, whether you like the direction or not.\n\nSo make the call yourself. Decide what you want open and what you want closed, per crawler, on purpose, using the [AI crawler](https://www.searchenginejournal.com/ask-an-seo-should-i-block-ai-crawlers-or-measure-their-value-first/580005/) controls your host, or CDN already gives you, knowing the legal ground under “block them” is still moving and might not hold. Do not outsource that decision to a court refereeing a fight you are not in, and do not outsource it to a plugin that flipped a default you never read. Own it.\n\nFight for the open web or stop pretending. Whichever you pick, actually pick it. Right now Google and a scraper you have never heard of are making that call for you, and taking it back is the one move in this whole fight that is yours.\n\n**More Resources:**\n\n[Google Faces Class Action Over Books Used To Train Gemini](https://www.searchenginejournal.com/google-faces-class-action-over-books-used-to-train-gemini/582708/)[US Publishers Demand Common Crawl Stop Scraping Their Content](https://www.searchenginejournal.com/us-publishers-demand-common-crawl-stop-scraping-their-content/578532/)[Google NotebookLM Rebrand May Expose Your Site To More AI Scraping](https://www.searchenginejournal.com/google-notebooklm-rebrand-may-expose-your-site-to-more-ai-scraping/582775/)\n\n*This post was originally published on No Hacks.*\n\n*Featured Image: Mixed Sketches/Shutterstock*\n\n[SEO](https://www.searchenginejournal.com/category/seo/)", "url": "https://wpnews.pro/news/google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web", "canonical_source": "https://www.searchenginejournal.com/google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web/583066/", "published_at": "2026-07-28 17:30:13+00:00", "updated_at": "2026-07-28 17:34:19.086978+00:00", "lang": "en", "topics": ["ai-policy", "ai-infrastructure"], "entities": ["Google", "SerpApi", "Yvonne Gonzalez Rogers", "SearchGuard"], "alternates": {"html": "https://wpnews.pro/news/google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web", "markdown": "https://wpnews.pro/news/google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web.md", "text": "https://wpnews.pro/news/google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web.txt", "jsonld": "https://wpnews.pro/news/google-lost-its-scraping-case-now-you-have-to-pick-a-side-on-the-open-web.jsonld"}}