The compiled run had a lower request-latency sum. I still could not claim break-even. 0 ▲ Siddhant Khare 1 hour ago · Tech · hide · 0 comments A compiled vLLM run had a lower observed complete-response latency sum across 12 requests, but cold-start debt and different outputs ruled out a break-even claim. No comments yet. Log in to reply on the Fediverse. Comments will appear here.