Introducing Thales 0 ▲ JoeCode 80 days ago · Tech · hide · Fediverse post The Thales project is a private AI inference cluster built on two Dell PowerEdge R650 servers, each equipped with an NVIDIA T4 GPU. The goal is to provide low‑latency, high‑throughput inference endpoints for a variety of models—fast, deep, and embedding—behind a LiteLLM router. This post summarizes the current status of the build, the steps completed, and the next milestones. Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town