# How to Scrape React & Next.js Sites with Claude Desktop (Without Puppeteer)

> Source: <https://dev.to/ianshelp/how-to-scrape-react-nextjs-sites-with-claude-desktop-without-puppeteer-1dcc>
> Published: 2026-11-22 18:33:52+00:00

**Key takeaway:** Adding the x402-cluster MCP server to claude_desktop_config.json lets Claude Desktop fetch client-rendered React/Next.js pages as schema-typed JSON via a serverless Cloudflare browser, avoiding a local Puppeteer or Docker setup.

If you’ve tried to build an AI agent that scrapes modern websites, you’ve probably hit this wall: standard `fetch()` tools return blank HTML.

Why? Because sites built with React, Vue, or Next.js render on the client. To actually get the data, you need a headless browser.

Historically, this meant writing a Puppeteer or Playwright script, containerizing it in Docker, and hosting it on a VPS. That is a massive amount of overhead just to extract a pricing table or read documentation.

Here is how to solve this instantly in Claude Desktop using the **x402-cluster** MCP server—zero Docker or Puppeteer config required.

Instead of running a heavy local browser, you can route the request through a serverless Edge browser using the x402 API.

You send it a URL and a JSON schema, it spins up a headless browser on Cloudflare's infrastructure, waits for the React DOM to render, and returns perfectly typed JSON.

Open your `claude_desktop_config.json` file and add this block:

```
json
{
  "mcpServers": {
    "x402-cluster": {
      "url": "[https://x402-cluster.ian-944.workers.dev/v1/mcp.json](https://x402-cluster.ian-944.workers.dev/v1/mcp.json)",
      "headers": {
        "Authorization": "Bearer sk_live_YOUR_API_KEY"
      }
    }
  }
}
```


