2 hours ago · Tech · hide · 0 comments

Lately I've been playing with writing a chatbot library in Common Lisp. My previous gemini bindings were getting unweildy. I wanted to add the ability to run LLMs on my local machine but it turned out to be really kind of kludgy, so I decided to start from scratch with multiple back ends in mind. I've got it to the point where in supports multiple back ends, so now I can prompt local LLMs from Lisp. Recently I added the ability to recursively launch chatbots that can call each other. Since the chatbots do not share their contexts, this greatly reduces the context bloat of thet main chat because it can spawn off subtasks to a minion and not pollute the main context. This also allows you to create a federation of chatbots, each of which specializes in some topic and is overseen by a controlling chatbot that talks to the user. Chatbots can be serialized and checkpointed, so if one is carrying out an agentic task and Lisp crashes, when we restart the agentic tasks are restarted as well…

No comments yet. Log in to reply on the Fediverse. Comments will appear here.