Tag: RetNet
-
RetNet ๋ ผ๋ฌธ ๋ฆฌ๋ทฐ: Transformer๋ฅผ ๋์ฒดํ ๋ณ๋ ฌ ํ์ต+์์ฐจ ์ถ๋ก ์ํคํ ์ฒ ์์ ๋ถ์
RetNet achieves 8.4ร faster inference than Transformer with 70% less memory. The parallel training + sequential inference proof inside.