Terence Tao on Curiosity and AI

Mathematician and genius Terence Tao writing on Mastodon about the role of childish curiosity, the optimization of goals, and AI: “Toutes les grandes personnes ont d’abord été des enfants. (Mais peu d’entre elles s’en souviennent.)” [All grown-ups were once children… but only few of them remember it.] Antoine de Saint-Exupéry, “Le Petit Prince.” An impromptu game of “who can name the largest number?” is an example I often point to as a way in which young children teach each other about non-trivial mathematical ideas and facts, such as infinity and the concept of proof by contradiction (embodied in this case by one child eventually realizing that they can defeat any other child’s guess by adding “plus one” to that guess, thus demonstrating by contradiction1 that there is no largest natural number). Prematurely putting such games to an end by immediately providing the nominal goal—for instance, providing these children with a brief lecture on infinity and the unbounded nature of the…