{"slug": "i-tested-20-agent-ready-shopify-stores-25-silently-break-at-add-to-cart", "title": "I tested 20 \"agent-ready\" Shopify stores –> 25% silently break at add-to-cart", "summary": "An automated buyer test of 20 Shopify stores with verified UCP manifests found that only 65% reached checkout, while 25% silently failed at add-to-cart, according to a developer who published the results. The test, which used headless Chromium to simulate a buyer, revealed that declared agent-readiness does not guarantee actual agent-workability, with stores like dixxon.com and aeternum-jewelry.com accepting the add-to-cart click but showing an empty cart. The author recommends merchants test real purchases and developers score purchases rather than manifests.", "body_md": "**TL;DR:** I ran an automated buyer against 20 Shopify stores that *explicitly advertise* themselves as ready for AI agents (verified UCP merchants). Only 65% let the buyer reach checkout. 25% silently broke at add-to-cart — the button was clicked, the cart stayed empty. A store can declare itself \"agent-ready\" and still be broken for the agents that actually matter.\n\n| Outcome | Stores | % |\n|---|---|---|\n| Reached checkout | 13 | 65% |\n| Silent add-to-cart failure | 5 | 25% |\n| Add-to-cart blocked (disabled button) | 1 | 5% |\n| No add-to-cart at all | 1 | 5% |\n\nEvery one of these 20 stores has a **UCP manifest** — they went to the trouble of publishing the file that tells AI shopping agents (ChatGPT, Perplexity, Google's agentic checkout) \"you can buy from me.\"\n\nThe existing tooling (UCP Checker, Cloudflare's Agent Readiness score, Shopify's own scanner) checks whether that **manifest exists and is well-formed**. It does *not* check whether the store **actually works** for a non-human buyer.\n\nI checked the thing nobody else checks: **does the purchase actually complete?**\n\n**2 stores**(`dixxon.com`\n\n,`aeternum-jewelry.com`\n\n) accepted the \"Add to cart\" click, then served \"your cart is empty.\" The add silently failed.**1 store**(`extoolsjapan.com`\n\n) showed a permanently-disabled add button with no selectable variant exposed to automation.**1 store**(`fillhappy-va.com`\n\n) had no add-to-cart at all — its \"product\" was actually an event page.\n\nThat's a real, measurable gap: **declared agent-readiness and actual agent-workability diverge, and the divergence is silent** — the store thinks it's fine, the agent just doesn't buy.\n\n- 20 stores, all from the public UCP registry (\n`ucpregistry.com`\n\n), all`verified`\n\n, all Shopify. - An automated buyer: headless Chromium + a polite, identified user agent.\n- Per store: found a real product → selected a variant if present → clicked add-to-cart →\n**verified actual cart state**(navigated to`/cart`\n\n, checked for a line item) → attempted checkout. **No payment was ever submitted.**\"Reached checkout\" = the email/payment fields rendered.- Full per-store results and the harness are public:\nand`results.json`\n\n.`checkout_test.py`\n\n**This is a scripted browser, not an LLM agent.** Real AI agents drive browsers the same way but are*less*reliable than a script — a silent failure that breaks a script will break an agent too, probably more often. Treat 65% as an*optimistic*ceiling for real agent success.**\"Reached checkout\" ≠ \"purchased.\"** Payment, 3DS, and fraud checks are the next failure layer and weren't tested. Real purchase completion is lower than 65%.**Small, biased sample.** 20 stores, one platform, and the cohort is self-selected (these stores*want*agent traffic). The average merchant is almost certainly worse.**3 of the 5 add-to-cart failures are ambiguous**(cart state couldn't be verified — could be my detector, not the store). 2 are definitive (\"your cart is empty\" after a successful add click).\n\nIf you're a merchant: agentic checkout is coming (Google's UCP, Perplexity's Buy with Pro, Visa's agent payments are all live). A manifest doesn't make you ready — **an agent actually completing a purchase does.** The stores losing out are the ones whose carts silently break.\n\nIf you build in this space: **stop scoring manifests, start scoring purchases.** The manifest tells you what a store *says*; the cart tells you what it *does*.\n\nIf you want to know whether *your* store actually works for automated/AI buyers — not just whether its manifest is valid — email ** mythrilsredraw@gmail.com**. I'll run the same test against your storefront and tell you exactly where it breaks.", "url": "https://wpnews.pro/news/i-tested-20-agent-ready-shopify-stores-25-silently-break-at-add-to-cart", "canonical_source": "https://github.com/MythrilS/agent-ready-checkout", "published_at": "2026-08-22 04:10:13+00:00", "updated_at": "2026-08-22 04:43:26.819128+00:00", "lang": "en", "topics": ["ai-agents", "ai-products"], "entities": ["Shopify", "UCP Registry", "Cloudflare", "ChatGPT", "Perplexity", "Google", "Visa", "dixxon.com"], "alternates": {"html": "https://wpnews.pro/news/i-tested-20-agent-ready-shopify-stores-25-silently-break-at-add-to-cart", "markdown": "https://wpnews.pro/news/i-tested-20-agent-ready-shopify-stores-25-silently-break-at-add-to-cart.md", "text": "https://wpnews.pro/news/i-tested-20-agent-ready-shopify-stores-25-silently-break-at-add-to-cart.txt", "jsonld": "https://wpnews.pro/news/i-tested-20-agent-ready-shopify-stores-25-silently-break-at-add-to-cart.jsonld"}}