Tag: GRPO
-
GRPO vs PPO for LLM Reasoning: DeepSeek-R1 Explained
How DeepSeek-R1 trains chain-of-thought reasoning with GRPO instead of PPO. Group Relative Policy Optimization removes the critic network, cuts memory by 40%, and produces emergent self-verification behaviors. Full algorithm breakdown with PyTorch code.