Pangram is good

Many of the initial wave of “AI writing detectors” were quite bad. The biggest issue you need to be concerned about with an AI writing detector is false positives. If you are a professor and want to check students’ writing, it is very bad to falsely accuse a student. The Pangram product, though, is quite good, and I suggest folks check it out. The other main competitor on the market, GPTZero, is clearly lower quality (such as saying the Constitution is AI generated). GPTZero in their documentation says they are the most accurate AI detector. One of the reasons you don’t really care about accuracy is that you cannot know the underlying rate of AI writing in any corpus except in the scenario where it is artificially generated. And that is the only scenario in which you can know the accuracy for sure. What you care about is specifically the false positive rate and the false negative rate. Unlike GPTZero, Pangram appears to have very low false positive rates. A simple way to estimate the…