Your LLM's time to first token might be measuring your HTTP client 0 ▲ Siddhant Khare 1 hour ago · Tech · hide · 0 comments An 8 KB HTTP read hid visible output for 185 ms in a controlled test. The client boundary changed the result. No comments yet. Log in to reply on the Fediverse. Comments will appear here.
