4 hours ago · Culture · hide

An artificial superintelligence (ASI) is an AI that’s much better than the top humans at almost all cognitive tasks. This is a perfectly fine definition. But, from this definition and from our web of knowledge, we can deduce very little about what an ASI would actually look like. Human geniuses provide a lower bound, but not an upper bound. In some areas, we have deductive theories that describe the space of what is possible for all agents. We know, for example, that a superintelligent AI won’t be able to travel faster than light, or travel back in time, because we have well-trod theories that prohibit these things. In most areas of life, we don’t have such theories, and so we don’t have solid reasons to say what is or is not possible. Consider persuasion. Some humans are very charismatic. But what is the range of charisma? Is superpersuasion possible? I don’t know. The term is very loosely defined, but people just throw the word around like it means something. Without a deductive…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town