{"slug": "visa-tested-22-ai-shopping-agents-23-bought-the-wrong-thing-nubanks-q3-2026-half", "title": "Visa tested 22 AI Shopping Agents & 23% bought the wrong thing 🤖🛍️; Nubank’s Q3 2026 earnings: half the profit growth came from taxes, the 12% margin that’s really 10% & what NU stock is worth 🏦💜", "summary": "Visa's Agentic Commerce Benchmark tested 22 AI shopping agents built on models from Google, Meta, OpenAI, Anthropic and eight other labs, finding that 23.1% of runs ended with the shopper buying a product that did not meet their needs despite a 57.2% headline pass rate. The newsletter analysis notes that these purchases would clear checkout normally, with authenticated payments and tokenized cards, and that no party has yet agreed on liability when a shopper disputes an agent's mistaken purchase.", "body_md": "Hey Everyone,\n\nGood morning & happy Wednesday! Today, we’re **breaking down Visa’s new Agentic Commerce Benchmark** (why the best AI models still fail & why a more expensive model doesn’t fix that, the consistency figure that matters more than the 57.2% headline pass rate, who’s liable when an agent buys the wrong item, what Visa’s next move means for agent builders, merchants, issuers & investors, & what to watch next + bonus deep dives into [Visa’s latest financials](https://linas.substack.com/p/fintechpulse1150), and [How to Build a One-Person Company on Grok Bot](https://linas.substack.com/p/one-person-company-grok-bot) inside), and **diving deep into Nubank’s Q3 2026 earnings, a record $1.1B profit from Latin America’s largest digital bank where nearly half the growth came from a lower tax rate** (why NU’s 12% lending margin is really 10%, why loan losses are outrunning the income that carries them, why NU stock still trades like a 19% tax rate is here to stay, & the 3 numbers to watch next + bonus deep dives into [How AI Agents Are Going to Change the Future of Banking](https://linas.substack.com/p/banks-without-front-doors-ai-agents), [How Nubank Ships AI Agents in Days, Not Weeks](https://linas.substack.com/p/nubank-ai-agents-simulated-customers), and [deep dive into Anthropic’s IPO](https://linas.substack.com/p/anthropic-ipo-s1-analysis-valuation) inside). So let’s jump straight into the *interesting* stuff *🌶️*\n\n## Visa tested 22 AI Shopping Agents and 23% bought the *wrong* thing 🤖🛍️\n\n**Following the agents 🤖** **Visa [V 0.00%↑](https://substack.com/search/%24V)** recently tested 22 AI shopping agents built on models from Google, Meta, OpenAI, Anthropic, and eight other labs. In **23.1%** of all runs, the shopper ended up buying a **product that didn’t meet their needs** 😬\n\nIn a live deployment (via say [Grok Bot](https://linas.substack.com/p/grok-bot-guide), [Claude Duet](https://linas.substack.com/p/weeklyfintechpulse421), and others here), each of those purchases would go through checkout like any other. The payment is authenticated, the card is tokenized, and the transaction settles. Nothing in the payment flow shows that the agent *misunderstood* the shopper, and **nobody has yet agreed on who pays when the shopper disputes the charge**.\n\nIf you read it that way, **Visa’s Agentic Commerce Benchmark** is basically an early estimate of the dispute bill agentic payments will run up. It also hints at *where* Visa wants to sit when that bill arrives.\n\nLet’s dive deeper into this to see why the best AI models still fail, and why a more expensive model doesn’t fix that either. We’ll also look at the consistency figure that matters more than the 57.2% headline pass rate, who is liable when an agent buys the wrong item, and what Visa’s next move means for agent builders, merchants, issuers, and investors.\n\nIf agents already buy through your app, your store or your cards, start with the liability section.", "url": "https://wpnews.pro/news/visa-tested-22-ai-shopping-agents-23-bought-the-wrong-thing-nubanks-q3-2026-half", "canonical_source": "https://linas.substack.com/p/fintechpulse1153", "published_at": "2026-11-18 10:45:33+00:00", "updated_at": "2026-11-18 11:12:33.985107+00:00", "lang": "en", "topics": ["ai-agents", "ai-safety", "ai-products", "large-language-models"], "entities": ["Visa", "Google", "Meta", "OpenAI", "Anthropic", "Nubank", "Grok Bot", "Claude Duet"], "also_reported_by": [], "takeaway": "Visa's benchmark of 22 AI shopping agents found 23.1% of runs ended in a purchase that didn't meet the shopper's needs, and a pricier model did not fix it, so consistency across runs matters more than the 57.2% headline pass rate.", "recommendation": {"advice": "Evaluate shopping agents on consistency across repeated runs, not just pass rate, and test whether pricier models actually reduce wrong-purchase rates before upgrading.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/visa-tested-22-ai-shopping-agents-23-bought-the-wrong-thing-nubanks-q3-2026-half", "markdown": "https://wpnews.pro/news/visa-tested-22-ai-shopping-agents-23-bought-the-wrong-thing-nubanks-q3-2026-half.md", "text": "https://wpnews.pro/news/visa-tested-22-ai-shopping-agents-23-bought-the-wrong-thing-nubanks-q3-2026-half.txt", "jsonld": "https://wpnews.pro/news/visa-tested-22-ai-shopping-agents-23-bought-the-wrong-thing-nubanks-q3-2026-half.jsonld"}}