The Cheap AI Assistant Era is Here Something has happened in the last few months, and I'm not sure how many in the space have noticed. Open source LLMs have gotten very good at tool calling specifically, and very cheap. We're talking less than 30 cents for a million tokens of output! And, these cheap models can reliably call tools like executing some apple script or calling reminders. The 'harness' concept has also really taken off, providing models with skills to perform critical functions l...
No comments yet. Log in to reply on the Fediverse. Comments will appear here.