2 hours ago · 14 min read2787 words · Tech · hide · 0 comments

For six months I’ve been trying to hedge my (and my family’s) access to intelligence. Open models, local inference, a box on my desk that runs a decent model without asking anyone’s permission, you know, the kind of things you’ve seen me write about in previous posts. Last week, I finally did the math on what realistic local local inference would require, and while it helped me make a better sense of the current state of affairs, it made me realise that there’s a limit on what local inference can achieve without the right budget.Limiting myself to the 10k I wanted to make available for hardware purchases, with the current rising prices, and the increasing size of the models, wouldn’t end up in anything more than a baseline insurance for the worst case scenario. And my current hardware may already be covering for that.If I wanted to secure my access to intelligence at a bigger scale maybe I was framing the problem in the wrong way.Two powers, one weaponTo understand why everyone is…

No comments yet. Log in to reply on the Fediverse. Comments will appear here.