Optimized DeepSeek V2/V3 implementation (MLA) - #11446

Closed

fairydreaming wants to merge 10 commits into

ggml-org:masterfrom

fairydreaming:deepseek2-mla-exp

Commits on Jan 22, 2025

llama : experimental DeepSeek2 MLA implementation that caches latent kv representations
sszymczy
committed
93864cd

Commits on Jan 24, 2025

Merge remote-tracking branch 'origin/master' into deepseek2-mla-exp
sszymczy
committed
f0ce53f

Commits on Jan 25, 2025

llama : optimize DeepSeek MLA implementation
sszymczy
committed
de538aa

Commits on Jan 26, 2025

Commits on Jan 27, 2025

Commits on Jan 28, 2025

convert : make lint happy
sszymczy
committed
8ff0991
llama : prompt processing optimizations in DeepSeek V2
sszymczy
committed
8a887de

Commits on Jan 31, 2025

llama : avoid ggml_cont() is possible in DeepSeek V2 implementation
sszymczy
committed
7654331