Yzma

In the previous article we looked at what inference actually is — how a model takes a prompt and builds a response one token at a time. I mentioned two Go projects that let you run that loop locally: yzma, which lets Go call the llama.cpp inference engine directly, and kronk, which builds a friendly SDK on top of it. Today we open up yzma and see how the whole thing is put together.