Running llama.cpp on OpenBSD

I’ve been wanting to run a local LLM on my home network for awhile but never got around to it. Most of my hardware is pretty old, but there are still some decent models out there that will run with limited resources. My use cases for this model are: Prototyping/testing - I’d like to have a model on-hand so I can easily plug into it when playing with LLMs. Keeping data local - Something that I know 100% won’t be sending my data to a 3rd party. Fallback for services when internet is down - As a backup for when larger/more powerful models aren’t available. So, it doesn’t need to be the latest and greatest, it just needs to be decently capable, able to handle chats in a reasonable amount of time and return a response when I send it a message. My beefiest home server is my Intel NUC running OpenBSD. That computer is over 10 years old, but does have 16GB of RAM and 2 cores at 1.3GHz. I should be able to run something small but useful w/out too much trouble. Installation # Llama.cpp is…