Homework from WordCamp

A few times during the WordCamp US keynote, I asked for a show of hands and got mostly blank stares back, especially on the AI questions. That’s not a criticism — it’s a reading list. If the future is going to be built on this stuff, the WordPress community should be fluent in it. Here’s the homework. How models are actually trained When I asked who knew about the reinforcement learning models go through, Robert looked out and said “I see no yeses.” Base models are trained to predict the next word across huge amounts of text; the friendly, helpful behavior comes after, in post-training, where human/AI feedback reinforces some responses over others. If you use these tools every day, understanding that pipeline changes how you prompt them and what you expect from them. Start with Hugging Face’s Illustrating RLHF, a visual explainer. Chip Huyen’s RLHF deep dive is the best longer read, and Anthropic’s Constitutional AI paper shows where post-training went next. If you only have time for…