3 days ago · Tech · 0 comments

I think this is the first week in which I do not have spent any time on feature development on the coding part of LazerBunny. I was using my coding agent, router and controller every day and things just worked. A pleasant surprise to be honest. Instead of rushing into working on the rest of the stack I only implement a single feature for the brain. I went a bit beyond what Fort Minor suggested in their song and implemented a personalisation layer. There have been a few different approaches I have seen how to do this. I decided to keep it as lightweight as possible to not burn GPU cycles while an actual request is waiting to be processed. Once a day at 2am a goroutine runs and checks all sessions that happened during the last 24 hours, to see if there are any facts the LLM believes are worth remembering about me, past conversations or what I am working on. Once the facts are identified, the embeddings are generated and stored in the database. When a request is made the brain runs a…

No comments yet. Log in to reply on the Fediverse. Comments will appear here.