The logical destination of LLMs

Graze, the company that do really good stuff around AT protocol user controlled algorithms, have announced that they’re trying to “Billionaire proof inference” by creating an AI cooperative called co/core. It’s quite an interesting idea, where users share their own personal spare compute, from devices like an old MacBook, with a network of other users doing the same thing. The idea is that LLM tasks are run on each other’s machines and everyone appears to mutually benefit. The logical endpoint to this technology is that it’ll be these small, niche networks and local specialised models, used by technology enthusiasts. Add it to the pile of other “game changers” that are now predominantly used by niche groups. The economics don’t add up for the rest and that’s even while paying users/companies are still being hugely subsidised. When the real costs hit, the ROI just simply isn’t there. I’m genuinely glad to see stuff like this co/core initiative happening — it’s actually quite…