Category: Reinforcement Learning
-
Exploration vs Exploitation: ฮต-greedy๋ถํฐ UCB, Thompson๊น์ง
Compare ฮต-greedy, UCB, Thompson Sampling, and RND for sparse rewards. See which exploration strategy actually works in hard environments.
-
Model-Based RL: Dyna-Q๋ถํฐ MuZero๊น์ง Planning ์ ๋ต
Dyna-Q to MuZero: how model-based RL learns environment dynamics. MCTS planning and MBPO/Dreamer implementation strategies with code.
-
Policy Gradient ์๋ฒฝ ๊ฐ์ด๋: REINFORCE๋ถํฐ PPO๊น์ง ์ํ ์๋ฆฌ์ PyTorch ๊ตฌํ
Policy Gradient from scratch: REINFORCE to PPO with PyTorch code. Reduce variance 100x using baselines and see why PPO beats vanilla PG.
-
Reward Shaping ๋ง์คํฐํ๊ธฐ: ํ์ต ์๋๋ฅผ 10๋ฐฐ ๋์ด๋ ๋ณด์ ์ค๊ณ ์ ๋ต๊ณผ ํจ์ ํํผ๋ฒ
Reward shaping accelerates RL training 10xโbut breaks policies if done wrong. Use potential-based shaping and avoid these 3 fatal mistakes.
-
Actor-Critic ๋ฐฉ์ ์์ ์ ๋ณต: A2C๋ถํฐ SAC๊น์ง ์ฅ๋จ์ ๋น๊ต์ ํ์ดํผํ๋ผ๋ฏธํฐ ํ๋ ์ค์ ๊ฐ์ด๋
A2C vs PPO vs SAC: real training curves from 5 environments. Hyperparameter tuning secrets that cut training time 40% with Stable-Baselines3.
-
World Model ๊ธฐ๋ฐ ๊ฐํํ์ต: Dreamer v3์ MBPO๋ก ์ํ ํจ์จ 10๋ฐฐ ๋์ด๊ธฐ
Dreamer v3 and MBPO boost RL sample efficiency 10ร. World Models learn environment dynamicsโRSSM architecture and ensemble tricks explained.
-
Sim-to-Real Transfer ์์ ๊ฐ์ด๋: ์๋ฎฌ๋ ์ด์ ๊ฐํํ์ต์ ์ค์ ๋ก๋ด์ ์ ์ฉํ๋ ๋ฐฉ๋ฒ
Sim-to-Real transfer: train robot policies 100x faster in simulation, deploy to hardware with 85% success rate. Domain randomization code.
-
Advanced Game AI: Multi-Agent RL and Self-Play
Build AlphaGo-style game AI: self-play, curriculum learning, and population training. Why single-agent RL fails for competitive games.