Indirect lessons from human alignment

(Inspired by a post from Eli Tyre.) Many people make some variant of the following argument: Evolution is an “outer optimizer”. It is trying to make us maximize reproductive fitness. We are “inner optimizers”. We just do what feels good. But what feels good has been set by evolution, which is hoping that it will make us maximize reproductive fitness. But we don’t maximize reproductive fitness. In fact, birth rates are dropping everywhere. Therefore evolution failed. The standard interpretation is that this shows that alignment is hard. We have one example of an attempt (by evolution) to align the behavior of an intelligent system (us) towards some goal (maximize reproductive fitness). And as soon as that intelligent system (still us) was put in a different environment (modernity) it failed to continue to pursue that goal (you reading existential angst+science blogs instead of making/nurturing babies). To be clear, it’s likely good that evolution failed. A world where everyone woke up…