cd /news/ai-agents/where-the-enterprise-ai-advantage-co… · home topics ai-agents article
[ARTICLE · art-136954] src=fastcompany.com ↗ pub= topic=ai-agents verified=true sentiment=· neutral

Where the enterprise AI advantage comes from

Alibaba.com's CommerceAgentBench, an open-source benchmark of 107 end-to-end e-commerce tasks, found that the strongest AI agent tested completed 61.7% of real-world commerce tasks, with different models leading on different workflows such as requests for quotation, claims settlement, and product publishing. In one estimate covering 44 tasks, Alibaba's AI business agent Accio cost $1.72 in total tokens versus $3.79 for Codex and $3.91 for Claude Code, which Alibaba cites as evidence that enterprises should match model capability to each workflow's requirements. Alibaba says the results make model selection a workflow-level decision rather than a single-model choice.

by read4 min views1 publishedSep 22, 2026

The strongest AI agent we recently tested completed 61.7% of 107 real-world commerce tasks.

That number captures where agentic AI stands today. A system that can complete six out of every 10 complicated business tasks can already take meaningful work off someone’s plate. But for businesses, model choice is only part of the decision. The larger task is matching each workflow with a system that can complete it reliably at an operating cost that makes sense.

For much of the AI boom, progress has been measured through model intelligence. Bigger and more capable models generally meant better results. As AI moves into everyday operations, however, companies also have to account for efficiency. Different tasks demand different levels of reasoning and computing power, and using maximum capability can add cost without improving the outcome. This is one dimension of precision delegation: matching the capability assigned to the workflow with what the work requires.

Today, business outcomes depend on the entire system around a model: how work is structured, what tools the model can access, and the context available when it makes a decision.

This is especially true in specialized domains. At Alibaba.com, 27 years of commerce experience and real-world business data give our AI systems context on how commercial workflows operate. Clearly defined e-commerce tasks may be well-suited to smaller, lightweight models, while more complex work requires greater reasoning capacity.

That changes the enterprise AI equation. Each workflow needs enough capability to meet its required standard at a sustainable cost.

We saw this while building CommerceAgentBench, an open-source benchmark based on e-commerce operations. We distilled real business activity into 107 end-to-end commercial tasks and graded the final outcome: Was the listing published correctly? Was the shipment booked according to specifications? Was the purchase order created and dispatched?

Different tasks favored different models. The model that led on requests for quotation and market research trailed the one that performed best on claims settlement and listing compliance. A third led on publishing products and handling returns.

Those results make model selection a workflow-level decision.

A complicated business request may combine market research, spreadsheet analysis, supplier comparison, and purchase order creation. Each step places different demands on reasoning, speed, or data handling.

In Accio, Alibaba’s AI-powered business agent, we continuously evaluate models across different kinds of commercial work. A complex request can be broken into individual steps, with each routed based on its difficulty and requirements, including quality, speed, price, and data processing. The result is closer to managing a team of specialists than asking one person to do everything.

That also changes the economics. In one estimate covering a set of 44 tasks, Accio’s total token cost was $1.72, compared with $3.79 for Codex and $3.91 for Claude Code.

As the number of high-quality models grows, the ability to evaluate their real-world performance continuously and assign work accordingly will become an increasingly valuable enterprise capability.

Choosing the right model can lower the cost of each step. The next opportunity is reducing how many steps are needed in the first place.

AI agents repeatedly process context, call tools, and pass information through a workflow. Poorly designed systems may misread information they already have or repeat computation that adds nothing to the final result.

A more efficient system can reuse previous computation and compress context when the full history is unnecessary. Specialized agents can also coordinate work so that each component processes only the information it needs.

Lower model prices will make AI cheaper to operate. Better orchestration can reduce the amount of computing required to complete the initial work.

The objective is a reliable business outcome using only the resources the task requires.

The effects are especially visible in small businesses, where a founder may personally handle research, sourcing, merchandising, and operations.

Harrison Nott started with an idea for a cooling towel after playing sports. He used Alibaba.com to develop the product with manufacturers, then Accio to identify demand for pet cooling products and source them. At 16, he has turned that initial idea into a broader cooling-products business that has generated $1 million.

AI gives entrepreneurs access to capabilities that previously required more people, more time, or more specialized expertise. But that leverage becomes much more valuable when those capabilities are reliable and affordable enough to use repeatedly.

Cost, performance, and efficiency are only part of the precision delegation equation. Companies also need to decide how much authority an agent should receive.

A weak draft of a social post carries one kind of consequence. An incorrect supplier payment carries another.

Routine work with consistently strong performance may run with minimal intervention, while higher-risk decisions may still require approval. This is where precision delegation becomes important: assigning work and authority workflow by workflow based on demonstrated performance, cost, and the consequences of getting the decision wrong.

The stakes will rise as agents connect directly to payments, inventory, logistics, and other operational systems. At that point, choosing which model handles the work is only the beginning. Companies also need evidence about how reliably the system performs and clear rules governing what it can do on their behalf.

The next phase of enterprise AI will favor companies that make those decisions at the workflow level. The strongest systems will allocate computing power according to what the job requires and expand an agent’s authority as its performance earns greater trust.

Kuo Zhang is president of Alibaba.com.

── more in #ai-agents 4 stories · sorted by recency
── more on @alibaba.com 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/where-the-enterprise…] indexed:0 read:4min 2026-09-22 ·