Category: Paper Review
-
MAE Review: Self-Supervised Vision via Masked Reconstruction
MAE masks 75% of image patches and reconstructs pixels—simple, brutal, effective. Why this extreme masking ratio works and the asymmetric trick that made it fast.
-
ViT vs DeiT Review: Pure Attention Meets Distillation
ViT vs DeiT: how distillation and data augmentation let DeiT match ViT accuracy without 300M pretraining images. Training logs and ablation results included.
-
RLHF Review: InstructGPT and Human Feedback Training
How InstructGPT's 1.3B model with RLHF beats 175B GPT-3. Full breakdown of SFT, reward modeling, and PPO training — with the catches they skip.
-
Attention Is All You Need: Transformer Architecture Review
Attention Is All You Need dismantled: why self-attention replaced RNNs, how positional encoding works, and the 3 tricks that made it scale.
-
How to Write an Academic Paper Review in English
Write academic paper reviews that editors actually accept. Structure, critical analysis phrases, and a complete Transformer paper review example.
-
LoRA 논문 리뷰: 수십 GB 모델을 MB급 파라미터로 파인튜닝하는 Low-Rank Adaptation 완전 분석
LoRA fine-tunes 175B models with 0.01% trainable parameters. Math behind low-rank decomposition, GPT-3 results, and PyTorch implementation guide.
-
Transformer Review: Attention Is All You Need 완전 분석
Transformer self-attention math decoded: positional encoding, multi-head mechanics, and why it beat RNN/LSTM. Full equations + ablations.
-
DDPM Review: Denoising Diffusion Probabilistic Models 분석
DDPM diffusion models explained: forward/reverse process math, simplified loss function derivation, and U-Net architecture that changed AI.