llmtee: A lightweight LLM proxy

TL;DR: llmtee is a self-hosted proxy for the OpenAI and Anthropic APIs, plus any OpenAI-compatible provider. Change one base URL, and every request gets logged with tokens, cost, latency and time to first token. It's a single Go binary with a SQLite file. I use LLMs in a lot of places by now. Coding agents, a few n8n workflows, some scripts, and local models running on Ollama. What I didn't have was a single place to see what all of that actually costs. Each provider has its own dashboard, they all slice the data differently, and local models don't show up in any of them. The existing tools didn't fit what I wanted. Langfuse wants an SDK and a stack of Postgres, ClickHouse, Redis and S3. LiteLLM is a full gateway with routing and fallbacks across 100+ providers. Helicone was the closest match, but it's been in maintenance mode since March. All I wanted was to answer "what did this cost, and where did it go?", and to stop a runaway agent before it burns through my monthly budget. So I…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town