Jeremy Keith on open local large language models

Jeremy Keith: I’d love to see the technology decoupled from the current depressing narrative. I’d love to see a thousand homemade software flowers bloom from open local language models. Me too. At work, we use some of the subsidized models Jeremy talks about. We well know that the current token cost is likely to change. I think it is going to continue to march to near zero. Jeremy thinks we’ll get priced out of paradise. We’ll see which happens. But, ever since I was a young man helping a local doctor to care for a local chicken coop with a few hundred chickens in it, I don’t think it is a good idea to keep all of your eggs in a single basket. To that end, we’ve got a fallback agent/LLM set up that we can hot swap out when we need to (at least, I’m working pretty diligently on being able to do just that). Because of that work I’ve had the chance to really put the screws to many open local models. Kick the tires. Turn them upside down and see what falls out of their pockets. They are…