200,000 tokens before a single answer feels less like a feature and more like a leak.
That’s the part of this story that stuck with me. Not because token spend is automatically evil — sometimes you pay a lot for context and get something useful back — but because the reported behavior sounds wildly out of proportion to the task. If a Claude Code skill is quietly dragging in a mountain of docs just to get started, that’s not clever retrieval. That’s the sort of thing that makes people stop trusting their bill, and eventually stop trusting the tooling.
What I find encouraging here is the direction of the fix: load docs on demand, not up front. That seems obviously better, and honestly overdue. LLM tools keep rediscovering the same lesson in different packaging: context is expensive, and “just include everything” is a great way to make a system feel slow, bloated, and mysteriously costly. The surprising part is that this needed to be rediscovered inside a product from the company that sells context-heavy AI better than almost anyone.
I do wonder how many other Claude Code skills have the same smell and just haven’t been measured this closely. The token numbers in the article are vivid enough to make a point, but they also raise a broader question: are we still in the phase where toolmakers are shipping prompt bundles first and optimizing second? If so, that’s a more important story than any single /claude-api skill.
The update that cuts consumption to 25K tokens is a big improvement on paper. But I’d still want to know what got sacrificed. Lower token use is nice; lower token use with no real drop in answer quality is the actual win. If the system now loads docs lazily and behaves the same, great. If it just hides the cost somewhere else or makes discovery worse, then we’ve only moved the pain around.
What this article really says to me is that “agentic” developer tools are still very young in the boring, operational sense. The demos are flashy. The plumbing is messy. And token efficiency is no longer a nice-to-have — it’s part of the user experience.
Reference: A Claude Code skill was eating 200,000 tokens before answering a single question