Tag: gradient descent
-
Autograd Engine from Scratch: 200 Lines to Beat PyTorch
Built a 200-line autograd engine that beats PyTorch on tiny models. Here's the reverse-mode autodiff math and training loop that actually work.
Built a 200-line autograd engine that beats PyTorch on tiny models. Here's the reverse-mode autodiff math and training loop that actually work.