Skip to content

FEA: Add ch19.2-roofline and corresponding figures #41

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jshn9515 merged 4 commits into from
Sep 18, 2026
Merged

FEA: Add ch19.2-roofline and corresponding figures #41

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
941a748
FEA: Add ch19.2-roofline and corresponding figures
jshn9515 Sep 17, 2026
6dcd953
FEA: Update chapter 19.2 on FLOPs, Memory, and Arithmetic Intensity
jshn9515 Sep 17, 2026
a47fe2a
Merge remote-tracking branch 'origin/main' into ch19.2-roofline
jshn9515 Sep 17, 2026
0f12338
DOC: Adjust image height for data movement illustration in Roofline m…
jshn9515 Sep 18, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions _quarto-typst-zh.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,7 @@ book:
- part: "Chapter 19: LLM 训练工程：显存、计算与并行训练"
chapters:
- "zh/ch19-llm-training-engineering/ch19.1-memory-ledger.qmd"
- "zh/ch19-llm-training-engineering/ch19.2-roofline.qmd"
- "zh/ch19-llm-training-engineering/ch19.3-profiling.qmd"
- "zh/ch19-llm-training-engineering/ch19.4-mixed-precision.qmd"
- "zh/ch19-llm-training-engineering/ch19.5-gradient-accumulation.qmd"
Expand Down
1 change: 1 addition & 0 deletions zh/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -117,6 +117,7 @@
## Chapter 19: LLM 训练工程：显存、计算与并行训练

- 19.1 LLM 训练显存账本：参数、激活与状态
- 19.2 FLOPs、Memory 与 Arithmetic Intensity：为什么不是只看计算量
- 19.3 Profiling：怎么知道代码慢在哪里
- 19.4 Mixed Precision：FP32、FP16、BF16 与 Loss Scaling
- 19.5 Gradient Accumulation：显存不够时如何模拟大 Batch
Expand Down
Loading
Loading