Route AI traffic locally between LLM models and providers

As I started setting up my local LLM workflow, my setup sprawled faster than I could wrangle it. Before long, I ended up with multiple tools to play around with (inputs) and multiple inference providers (outputs). Some providers could handle private data, others were only available in commercial clouds, and more were specific to individual projects only. None of the multiple-input/multiple-o...

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town