My AI Code Reviews Ran 20 Rounds. Most of Them Had Nothing To Do With the Code.

IntroA few months ago, I decided to put more emphasis on automated code reviews in GZA, my personal AI coding orchestrator and/or software factory, to increase my confidence in the quality of AI-generated code.I previously wrote about my motivation for building GZA here:What followed re-taught me something I’ve learned and forgotten many times: you cannot fully automate the understanding of complex systems.Upgrading My Review Model and Implementing IterationsTo start taking AI code reviews more seriously, I did 2 things:Upgraded the model I was using for reviews. At the time, I was using Claude Sonnet for coding and Haiku for reviews. I upgraded the review model to Opus, as I believed that creating a list of bugs to be fixed and/or improvements to be made was a more complex task than implementing them. To paraphrase as a question, which is harder: writing a detailed TODO list, or doing the work in the list?Implemented a GZA feature to run automated code reviews and improvements for up…