1 hour ago · 7 min read1387 words · Tech · hide · Fediverse post

2026-11-21 My first post tested local models that were already a year and a half old. With a current model, Gemma 4 26B A4B, the same laptop gave answers that were mostly right instead of mostly wrong. Local AI is still not something I'd trust blindly, but the gap to the frontier models is much smaller than I reported. As before, I ran the models and the tests myself. The setup, the choice of model and the analysis came from Claude, Anthropic's AI assistant. That includes the analysis of Claude's own output in the comparisons below, which may be biased in its favour. What went wrong The models I tested, Qwen3-30B-A3B and Qwen3-14B, were Claude's recommendation. It suggested them from memory, without checking what was current. Those models were released in spring 2025, and by November 2026 there were newer generations: Google's Gemma 4 (April 2026) and later Qwen releases. When I asked again, Claude searched first and suggested Gemma 4 instead. So my first post compared 2025 local…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town