AI Does Not Know What's the Best for Humans

AI may, when given a goal, be able to optimize its way towards the goal. However, AI do not know what goals to pursue, and what goals to avoid. As Steven Strogatz and Alex Townsend write in The Guardian: As optimisation becomes more powerful, avoiding these traps becomes more important. The challenge is not simply finding the best answer. It is deciding what “best” really means – and knowing what not to optimise away. ~ Link: The Efficiency Trap: Why Optimising Everything can Backfire, Badly, by Steven Strogatz and Alex Townsend, The Guardian

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town