An Open Letter from Academics about AI Risk / Life Without the Internet & the Case for Non-Network Redundancy

There has been an increase in concern over AI destroying humanity, most recently spurred by tweets from former Anthropic employee Jacob Coxon about how dangerous AI is, and a follow-up tweet from current employee Evan Hubinger, who said “Jacob is correct here — we really do earnestly believe A.I. could kill all humans! I personally think it is >10% within the next decade.” Some in the AI world are calling for “the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development” and there has been much discussion of trying to slow down or stop all AI research. Now, a new open letter is circulating, this time from academics worried about the possibility of a “global catastrophe” resulting from AI, calling for political leaders to “create an international treaty, much like the Treaty on the Non-Proliferation of Nuclear Weapons.” It was written by philosopher Molly Gardner (University of…