The tokenmaxxing hangover. - by Gergo Nefelejcs - Mimetiq

SubscribeSign in

The tokenmaxxing hangover.<br>Is your stack ready for the real bill?

Gergo Nefelejcs<br>Jun 25, 2026

Share

The other week OpenAI’s finances were leaked to Ed Zitron and verified by the Financial Times. The numbers are astonishing: $13.07B in revenue against $34B in total costs, a $20.9B operating loss and a headline net loss of $38.5B — inflated by a one-time non-cash charge, with the real cash burn closer to $8B.<br>More telling than the headline figure is the inference line: cash spent on serving model outputs alone was $3.8B in 2024, ballooning to $8.65B in just the first nine months of 2025 — more than double the prior year’s pace.<br>This raises obvious questions about OpenAI’s investor story.<br>But it raises a more pressing question for everyone else in the tech ecosystem: if the company serving the tokens is bleeding this badly, how much are the rest of us actually paying for what the tokens cost to produce?<br>The answer, increasingly, is: a fraction. OpenAI, Google, Anthropic and Meta are all pricing inference below cost to capture market share. Or in other words: a false floor on market prices, subsidized by what looks like seemingly endless venture and strategic capital. It won’t hold indefinitely.<br>Enterprises are already feeling the early tremors. As recently as a few weeks ago, companies like Meta, Amazon, and OpenAI were actively encouraging employees to maximize token usage — treating it as a proxy for AI productivity, with informal leaderboards tracking who could burn the most.<br>The backlash has been swift.<br>Uber burned through its entire 2026 token budget in the first four months of the year, largely through Claude Code usage. Salesforce is looking at a $300 million Anthropic bill, and its CEO is now publicly wishing for a “smart router” to determine which queries actually need the most expensive models. Uber’s COO put the problem plainly: if you can’t draw a direct line from token spend to useful features shipping to users, the costs are harder to justify.<br>The tokenmaxxing era is over, even though the subsidy that made it painless is still in place.<br>Part of the problem is structural.<br>The primary cost of AI has shifted from training models to running them — inference — and increasingly to running networks of agents that call each other in sequence or in parallel to complete workflows. Token prices have fallen consistently, which creates an illusion of decreasing costs.<br>But a Stanford, Berkeley, and CMU research team recently punctured that illusion with what they call the price reversal phenomenon: in nearly a third of model comparisons, the cheaper-listed model actually costs more in practice — sometimes dramatically more. Gemini 3 Flash’s listed price is 80% cheaper than GPT-5.4, but its actual cost across real tasks runs 38% higher.

The reason is thinking tokens: a more efficient model may charge more per token but use far fewer of them, while a “cheap” model burns through vastly more compute to reach the same answer — or fail to reach it at all.<br>Which brings in the second finding, and the more damning one. Researchers at The AGI Company, Stanford, and Oxford assembled 112 practical tasks mirroring the kinds of multi-step interactions enterprises are actually trying to automate — booking, e-commerce, communication, and scheduling. Tested across 11 realistic website environments, frontier models succeeded on at most 41% of them. Which means that for agentic workflows — the high-token-burn use cases everyone is building toward — the majority of spend is currently going toward hallucinated or failed results.<br>So we’re in for a recalculation. Several forces are converging at once:<br>The current pricing is subsidized, and the gap between list price and true cost will narrow as the market matures.<br>Listed prices don’t map neatly to real-world costs anyway, because token consumption is unpredictable and model efficiency varies wildly by task. And the agentic workflows now eating the most tokens are also the ones delivering the least reliable results — while the bill runs regardless.<br>These aren’t problems isolated to AI labs.<br>Every company is now an AI company in some meaningful sense: either a thin wrapper over a model, or a traditional product with AI features bolted on, or a team of people who’ve replaced workflows with AI tools to do more with less.<br>Developers orchestrate fleets of models to write, review, and ship code. Non-technical workers run their days through AI assistants. CFOs are watching the line items and asking a question that’s getting harder to answer: where’s the ROI — and what happens to our margins if prices move in the wrong direction?<br>The answer is smarter logistics and diversification.<br>Think of it like a supply chain.<br>A company that sources everything from a single premium supplier at full price is the most exposed when that supplier raises rates. The smart move is diversifying the models based on use cases,...