72 days ago · Tech · hide · Fediverse post

A compiled vLLM run had a lower observed complete-response latency sum across 12 requests, but cold-start debt and different outputs ruled out a break-even claim.

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town