{"slug": "the-ai-economy-runs-on-this-incredibly-vague-unit", "title": "The AI economy runs on this (incredibly vague) unit", "summary": "The AI economy relies on tokens, the basic units of language processed by AI systems, but token pricing remains opaque and inconsistent across models and tasks. Users report frustration with unpredictable token limits and costs, while a Stanford study found that AI models can vary by up to 30 times in token consumption for identical tasks, undermining consumer trust in usage-based pricing.", "body_md": "Three-plus years into the [AI](https://www.fastcompany.com/section/artificial-intelligence) boom, we’re all still figuring out what an AI token is actually worth. Welcome to the era of stochastic shopping.\n\nTokens, at their core, are the tiny units of language that artificial intelligence systems ingest and process in order to reason, or at least mimic reasoning, and communicate with us. A token might be a punctuation mark, a word, or even part of a word. OpenAI suggests that, in English, one token is roughly equivalent to four characters, or about three-quarters of a word. By the same calculation, a paragraph might contain around 100 tokens, while roughly 1,500 words would amount to about 2,048 tokens.\n\nThis might sound scientific, but for people using consumer systems such as Claude or ChatGPT—rather than the application program interfaces used by developers and large companies—understanding what a token is and how much it is worth can feel surprisingly opaque. When you enter a prompt, you may receive an estimate of how many tokens the task consumed. What you do not receive is a clear explanation of *why* the task costs that particular number of tokens. The estimate can feel random and frustrating, especially when an AI provider suddenly tells you that you have hit your quota.\n\nUsers regularly complain about running up against those token limits. One Reddit user [described](https://www.reddit.com/r/ChatGPT/comments/1plc35p/reaching_the_chat_conversation_length_limit/?utm_source=chatgpt.com) hitting a cap and losing the emotional nuance they had developed in a chat. On X, some people post about [hitting their limits](https://x.com/yisongyue/status/1985751363440296263?utm_source=chatgpt.com) quickly—as a matter of pride. But many have grown [sensitive](https://www.bbc.com/news/articles/ce8l2q5yq51o) to perceived token caps and to the ways companies appear to throttle or restrict usage, particularly during periods of peak demand.\n\nOf course, complicated tasks generally consume more tokens than simple ones. But token purchases can still feel nebulous in part because companies approach tokenization differently. Models also become personalized to users over time, potentially affecting how many tokens a system utilizes for a specific task.\n\nThere are also different types of tokens. Input tokens are used to process and interpret what a user submits. Output tokens correspond to the response the model generates. Cached tokens allow a system to reuse information it has previously processed rather than starting from scratch each time.\n\nThe models themselves can provide different token estimates in response to the same prompt. A friend and I recently experimented with this by asking the same OpenAI model to produce a simple timeline of American history. My response “cost” me twice as many tokens as his.\n\nA study from researchers at the Stanford Digital Economy Lab [published earlier this](https://arxiv.org/abs/2604.22750) year found that AI models can vary widely in how many tokens they consume to complete the same task, sometimes by as much as 30 times. “This consumption-based pricing . . . has two major issues for consumers,” Jiaxin Pei, a postdoctoral researcher at Stanford who worked on the project, tells *Fast Company*. “You have no guarantee that this task will be done [well]. . . . Regardless . . . you have to pay the full price.”\n\nThe model token estimates are even more* *confusing because a task that might be expensive in terms of tokens for a model isn’t necessarily correlated with whether a task would be laborious for a human. Another wrinkle: That same Stanford research also notes that models underestimate their own token usage, which means it’s difficult to get a model to tell you, ahead of time, what you’re actually buying. (You can take a shot at guesstimating [here](https://longjubai.github.io/agent_token_consumption/), if you’d like).\n\nAll of this raises questions about the quickly fading [token-maxxing moment](https://www.fastcompany.com/91555955/most-businesses-are-measuring-ai-wrong-and-its-costing-them-ai-tokens-strategy). Yes, tokens buy access to *something*, but AI systems are [fundamentally stochastic](https://nymag.com/intelligencer/article/ai-artificial-intelligence-chatbots-emily-m-bender.html), or random, which means you don’t always know *what* you’re buying with tokens. Rather than functioning as discrete items with stable value, tokens are fuzzy units of consumption that only loosely correlate to the usefulness of the AI-generated response you get.\n\nTo be sure, people continue to embrace AI tools, even as they worry that AI companies have accumulated too much power. And tokens are hardly the only opaque currency in the modern economy—think billable hours, or airline points. Still, the confusion surrounding tokens reflects a broader sense that consumers are being [asked to adopt AI](https://www.wsj.com/tech/ai/tech-firms-arent-just-encouraging-their-workers-to-use-ai-theyre-enforcing-it-d43ebf84) before they can meaningfully understand its terms.\n\nNo wonder people are annoyed.", "url": "https://wpnews.pro/news/the-ai-economy-runs-on-this-incredibly-vague-unit", "canonical_source": "https://www.fastcompany.com/91572876/the-ai-economy-runs-on-this-incredibly-vague-unit", "published_at": "2026-07-16 10:11:00+00:00", "updated_at": "2026-07-16 10:54:36.236310+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-products", "ai-ethics", "ai-policy"], "entities": ["OpenAI", "Claude", "ChatGPT", "Stanford Digital Economy Lab", "Jiaxin Pei", "Fast Company", "Reddit", "X"], "alternates": {"html": "https://wpnews.pro/news/the-ai-economy-runs-on-this-incredibly-vague-unit", "markdown": "https://wpnews.pro/news/the-ai-economy-runs-on-this-incredibly-vague-unit.md", "text": "https://wpnews.pro/news/the-ai-economy-runs-on-this-incredibly-vague-unit.txt", "jsonld": "https://wpnews.pro/news/the-ai-economy-runs-on-this-incredibly-vague-unit.jsonld"}}