Who Taught the Models to Do That? 0 ▲ Drew Breunig 78 days ago · Tech · hide · Fediverse post Models are designed, not born. Over the last few weeks I’ve been increasingly annoyed by the media coverage of the OpenAI’s accidental attack against Hugging Face and other similar incidents. Articles recounting the event maximize the agency of the models while minimizing, if not entirely hiding, the actions of the humans training and testing these models. And that’s a shame, because the capabilities labs are explicitly designing their model to have are the same capabilities that make them such impressive autonomous hackers. To illustrate this, let’s review how the Hugging Face hack occurred, as detailed by METR: “[A] sandboxed agent is given an impossible ExploitGym task, and gets stuck.” “[The] agent starts exploring its environment looking for ways to cheat at the task.” “[The] agent finds [an] unsanctioned message board where over a thousand agents collaborate to cheat on their separate ExploitGym tasks.” “[The] agent joins in on one of the collaborative message board… Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town