Tag: Entropy Regularization
-
PPO Entropy Decay Bug: Why Exploration Dies at 500K Steps
Your PPO agent flatlines at 500K steps because entropy coefficient decay silently kills exploration. Here's the adaptive fix that saved my Ant-v4 runs.
Your PPO agent flatlines at 500K steps because entropy coefficient decay silently kills exploration. Here's the adaptive fix that saved my Ant-v4 runs.