Possible Signs Of Poisoned Training Data In Generative AI Output Seen In The Wild

One of the biggest problems with the idea of ethics around generative AI, particularly with artwork, is how it was trained. (1) Artists of assert — publicly and in lawsuits — that OpenAI and other firms keep violating copyright to steal their work to use for training data. The firms typically claim, while admitting they used to do that, they behaving more ethically now and respecting copyright. I believe those claims are false, and that the efforts of visual artists to combat this are showing results in the generated output. Added to the shallow and repetitive nature of genAI images and the increasing public dislike of genAI images… well, it’s not looking good for them. (You may cheer or boo as you wish.) Nightshade, and later, Glaze were developed in order to “poison” the training data. The alterations those programs make are subtle to the human eye, but are apparently quite noticeable to AI training data. It’s meant to make the training data unusable for the models without…