pytorch 3 The RL Primer You'll Finally Understand: RLHF, PPO, GRPO, DPO Nov 15, 2026 spmd_types: explicit collectives, checked shardings Nov 12, 2026 Muon and FlexShard: why the optimizer needs whole matrices Nov 2, 2026