Tag: GPU최적화
-
FlashAttention 리뷰: Transformer 어텐션 2~4배 가속
FlashAttention cuts Transformer memory from O(N²) to O(N) while running 2-4× faster. Here's the IO-aware tiling trick explained.
FlashAttention cuts Transformer memory from O(N²) to O(N) while running 2-4× faster. Here's the IO-aware tiling trick explained.