Tag: LLM
-
Part 5: Automating Earnings Call Summarization with LLMs
Build an SEC filing summarizer with LLMs: EDGAR API, anti-hallucination guards, and structured extraction. Full pipeline with code.
-
LoRA ๋ ผ๋ฌธ ๋ฆฌ๋ทฐ: ์์ญ GB ๋ชจ๋ธ์ MB๊ธ ํ๋ผ๋ฏธํฐ๋ก ํ์ธํ๋ํ๋ Low-Rank Adaptation ์์ ๋ถ์
LoRA fine-tunes 175B models with 0.01% trainable parameters. Math behind low-rank decomposition, GPT-3 results, and PyTorch implementation guide.
-
RetNet ๋ ผ๋ฌธ ๋ฆฌ๋ทฐ: Transformer๋ฅผ ๋์ฒดํ ๋ณ๋ ฌ ํ์ต+์์ฐจ ์ถ๋ก ์ํคํ ์ฒ ์์ ๋ถ์
RetNet achieves 8.4ร faster inference than Transformer with 70% less memory. The parallel training + sequential inference proof inside.
-
RAG ํ์ดํ๋ผ์ธ ์ต์ ํ ์์ ๊ฐ์ด๋: Naive RAG๋ถํฐ Agentic RAG๊น์ง
Optimize RAG pipelines from naive to agentic: chunking strategies, hybrid search, and reranking code that actually improves retrieval.
-
DeepSeek-V3 ๋ ผ๋ฌธ ๋ฆฌ๋ทฐ: MoE ๊ธฐ๋ฐ ์คํ์์ค LLM์ด GPT-4o๋ฅผ ๋์ด์ ๋น๊ฒฐ
DeepSeek-V3 matches GPT-4o with 671B parameters but activates only 37B. The MoE, MLA, and load balancing techniques that made it possible.
-
LoRA vs QLoRA vs DoRA ์๋ฒฝ ๋น๊ต: ํ๋ผ๋ฏธํฐ ํจ์จ์ ํ์ธํ๋(PEFT) ๋ฉ๋ชจ๋ฆฌ ์ต์ ํ ์ค์ ๊ฐ์ด๋
LoRA uses 60GB GPU, QLoRA needs 16GB, DoRA hits 12GB โ same model quality. Here's the memory breakdown and when to pick each method.