6 days ago · 9 min read1861 words · Tech · hide · 0 comments

I got to know about Andrej Karpathy’s llm-wiki a few months ago. I was intrigued by it, but never got around to using it. The fact that I could capture raw notes on the topic I was researching and the LLM could not only make connections between them, but find topics in my notes and create concept pages was something I saw value in. What is llm-wiki? llm-wiki is a skill developed by Andrej Karpathy used for building personal knowledge bases using LLMs. The idea is that instead of using LLMs like RAG where you upload documents and ask it to search through them and generate an answer, you make “the LLM incrementally build and maintain a persistent wiki - a structured, interlinked collection of markdown files that sits between you and the raw sources”. Having said this and the fact that LLMs tend to hallucinate every now and then, I didn’t want to depend on its summaries completely. I didn’t want to add notes on stuff I didn’t read about. For example, I didn’t want to give it a URL and…

No comments yet. Log in to reply on the Fediverse. Comments will appear here.