Training people in AI Safety

As AI technology gets adopted at a never-seen pace, we also need more people to work on AI Safety to make sure that AI applications are actually safe and aligned. Because AI generates content and decisions faster than humans, this is a very interesting research problem: humans cannot verify AI alone, so we need smarter technology to do it. In the interview below Ryan Kidd, the CEO of MATS, talks about the efforts they (and others) are doing to train people in AI Safety. Throughout the conversation he also addresses how many of these AI Safety companies/non-profits have been founded, and even goes into neural networks vs evolutionary algorithms. But AI Safety is a very large umbrella that encompasses soft skills like Policy Making and writing Model Cards to more technical challenges like interpreting neural networks or building guardrails. Ankur Pandey argues that AI Safety training is not focusing on building tools and that's probably where the gains are for society. I actually…