31 minutes ago · Culture · hide

A few years ago I recorded 13 convos w/ folks worried about AI risk, collected at YouTube. I usually asked people why they wanted to treat AI descendants differently from bio-squishy ones. Most accepted future human-level AIs as descendants; we are making them in our image, and they will be more like us than are AIs made by aliens. Most were also okay with bio-squishy descendants usually getting more powerful than, winning conflicts with, and changing values relative to, prior generations. Even so, most still objected to future AI descendants having a similar relation to us.They gave three main arguments. First, some doubted that AIs would be conscious, due their being made out of different physical materials. Making them unworthy descendants, regardless of their behaviors or values. Second, some expected AI value changes to eventually get much larger than future bio-squishy value changes, due to some human values being encoded in slow-to-change DNA. I think this greatly…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town