Notes on migrating large prompts away from Anthropic/OpenAI to Self hosted LLMs

Maybe you’re a Claude code/codex user diligently avoiding uploading personal data to the providers. Is it possible that the most valuable information isn’t your data- but the meta data about your sessions? The intuitions you apply in coming up with ways to coax the ai into solving problems might actually be special. It’s statistically improbable, but Claude might not be gaslighting you. It may be that you’ve actually got a real insight! Your agent sessions are transcripts of the hardest problems you work on. What would it cost you if someone had copies of them? Last week there was public drama that shines a light on the risk that inference providers are training on user activity with the intent of delivering new discoveries. The mathematicians affected have published concerns about the ethics of frontier providers. If you missed it: https://www.theverge.com/ai-artificial-intelligence/991710/openai-navier-stokes-solution When ‘EDR’ becomes Ethical Deflection and Refusal: It’s become…