Tag: Exploration
-
PPO Entropy Decay Bug: Why Exploration Dies at 500K Steps
Your PPO agent flatlines at 500K steps because entropy coefficient decay silently kills exploration. Here's the adaptive fix that saved my Ant-v4 runs.
-
Exploration vs Exploitation: ฮต-greedy๋ถํฐ UCB, Thompson๊น์ง
Compare ฮต-greedy, UCB, Thompson Sampling, and RND for sparse rewards. See which exploration strategy actually works in hard environments.