58 minutes ago · Tech · hide · 0 comments

I have been using my personal AI assistant for a few weeks and it is working really well, after I figured out which models to deploy, how to exactly words the various tools and forcing at least one tool call for most interactions. There are some smaller annoyances, but overall things are working mostly as expected. To have a bit more of a personal touch and to make sure Endirillia is not just a brain dead chat bot, I added a user profile and facts. This part turned out to be surprisingly effective, way more than I expected. And it ensure that requests such as "when does G2 play the next time?" does not end in her asking "Which game?", because the user facts are queried for keywords and the top three results are injected into the prompt. This happens automatically whenever the system does not have anything to do. A go-routine checks for new messages in the session table that are not marked as fact_processed and sends a batch request to the LLM to extract important facts. There is a…

No comments yet. Log in to reply on the Fediverse. Comments will appear here.