Policywerk: Building Reinforcement Learning from First Principles

Most reinforcement learning code starts after the interesting part. Policywerk is a plain-Python Reinforcement Learning project that rebuilds Bellman, Actor-Critic, TD Learning, and Q-Learning from first principles, with tests, tiny environments, and animated visualizations that make the machinery visible.