90% of my LLM tokens were burning the wrong fires: how headroom cut my agent costs 7x
If you have built any non-trivial agent or RAG pipeline, you have probably been shocked by an API bill at least once. Not the training-side cost. The “every call stuffs a wall of context into the prompt” cost. For me it was Claude Code sessions: the tool outputs, the build logs, the RAG chunks I had been dumping in raw, then paying for by the million tokens. Then I ran into chopratejas/headroom, currently sitting at the top of GitHub’s monthly trending list with +41,093 stars this month. Its tagline reads: ...