Yzma 0 ▲ Internals for Interns 104 days ago · Tech · hide · Fediverse post In the previous article we looked at what inference actually is — how a model takes a prompt and builds a response one token at a time. I mentioned two Go projects that let you run that loop locally: yzma, which lets Go call the llama.cpp inference engine directly, and kronk, which builds a friendly SDK on top of it. Today we open up yzma and see how the whole thing is put together. Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town