MilikMilik

OpenAI Fixes GPT-5.6 Sol’s Token-Burning Problem for API Users

OpenAI Fixes GPT-5.6 Sol’s Token-Burning Problem for API Users
Interest|High-Quality Software

Sol’s Token Limits Were Built for Chat, Not Agents

GPT-5.6 Sol’s token limits and quota optimization updates refer to OpenAI’s decision to reset ChatGPT Work and Codex usage caps and improve Sol’s inference and tool-calling efficiency so that typical agentic coding workloads consume fewer tokens and extend quota duration by about 18 percent under real-world API usage scenarios. OpenAI introduced GPT-5.6 Sol earlier this month as a model built for more demanding coding tasks. It quickly met a wall: power users found that Sol was burning through their Codex and ChatGPT Work allowances during long-running agentic coding sessions, even when the model appeared to spend most of its time waiting for tools to finish. One user described a 43-minute coding session that generated nearly 300 model responses, plus 96 execution calls and 192 wait calls, consuming the remaining 42% of a five-hour usage allowance largely while waiting for tool results. The message from OpenAI’s reaction is blunt: subscription limits designed around short chats cannot survive agentic coding costs.

OpenAI Fixes GPT-5.6 Sol’s Token-Burning Problem for API Users

Reset Limits, Longer Quotas: What Changed for API Users

OpenAI’s immediate fix had two parts: a full reset of GPT-5.6 Sol token limits for ChatGPT Work and Codex users, and backend inference changes that make typical Sol sessions last about 18% longer. In a post on X, engineering lead Thibault Sottiaux admitted the company underestimated how expensive real-world agent execution would be and that testing focused too much on average and median usage, missing the long tail of heavy agent workloads. In practice, this means your agentic coding jobs should keep running longer before hitting caps, and that painful quota depletion during “wait-heavy” tool workflows is less likely. During rollout, OpenAI even temporarily lifted the five-hour usage cap while changes were deployed. This is not a gesture of generosity; it is a correction of a miscalibrated product, and an acknowledgment that developers were right to complain when GPT-5.6 Sol token limits made serious automation feel like a trap.

Kernel and Harness Optimizations: Cutting Agentic Coding Costs

The deeper story is how OpenAI attacked serving costs and API usage efficiency by letting Sol optimize its own stack. With Codex, GPT-5.6 Sol autonomously rewrote and optimized OpenAI’s production kernels, the core code that executes the mathematical operations inside the model. These kernel improvements, combined with broader advancements, reduced end-to-end serving costs by 20%. Sol was trained to write and improve kernels in Triton and Gluon, and its output is guarded by verification tooling such as the Floating-Point Sanitizer, which validates kernels before they reach production. On the agent side, the Rust-based Codex harness orchestrates models, tools, and user environments; Sol helps analyze production traffic, load-balance across accelerators, and tune key-value cache configurations so that more tokens can be served on the same hardware. This is quota optimization in action: instead of asking users to buy more capacity, OpenAI taught the model to consume fewer cycles per result.

OpenAI Fixes GPT-5.6 Sol’s Token-Burning Problem for API Users

Tool-Calling, WebSockets, and API Usage Efficiency

Most of Sol’s token appetite came from its new programmatic tool calling, or “code mode,” which keeps working while tools run in the background and coordinates complex workflows across tools and subagents. That is exactly what developers want from agentic coding—but it pushed API usage efficiency in the wrong direction, turning waiting time into quota burn. OpenAI’s response focused on the API stack: it framed inference work around a simple goal, serving more tokens on the same hardware while preserving intelligence, latency, availability, and reliability. A key change is a WebSocket integration that hoists tokenization state to the server; the first call tokenizes the full prompt, later calls send only new input and a conversation reference, moving tokenization closer to O(1) for follow-ups. For rollouts with 20 or more tool calls, OpenAI reports up to roughly 40% faster end-to-end execution. Faster loops and fewer wasted tokens mean agentic coding costs become more predictable instead of spiking whenever tools are slow.

Opinion: Quotas Must Catch Up With Agents, Not the Other Way Around

The Sol fix solves an immediate frustration while exposing a bigger shift for anyone building or deploying AI agents. Subscription limits were designed around chat, where a handful of turns complete a task; coding agents are different and can spend 30 or 40 minutes iterating, making tool calls, and revising code before they return a result. That makes it much harder for developers to predict how much of their allowance a single job will consume. In that world, OpenAI quota optimization is not a nice-to-have—it is the only way GPT-5.6 Sol token limits stay usable. The benchmark where Sol, with maximum reasoning, outperforms Claude Fable 5 while generating 54% fewer output tokens is telling: capability now has to be measured against efficiency, not in isolation. If agents are going to run entire workflows, platforms must treat serving efficiency and quota design as core product features, not afterthoughts patched once the long tail starts screaming.

Milik earns a commission when you shop through our links, at no extra cost to you. This article was generated with AI from published sources and product data.

You May Also Like

Comments
Say something...
No comments yet. Be the first to share your thoughts!