Logo
Explore Help
Register Sign In
EngineX/xc-llm-ascend
3
0
Fork 0
You've already forked xc-llm-ascend
Code Issues Pull Requests Projects Releases Wiki Activity
Files
a7b40b09ebed0ec5c771a3883a6c9526a1bffac8
xc-llm-ascend/vllm_ascend/torchair/models
History
NeverRaR 807686dec9 perf : optimize memory for deepseek mtp (#2713)
### What this PR does / why we need it?
delete the temp tensor to optimize memory for deepseek mtp for torchair
case

- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0

Signed-off-by: boying <897013703@qq.com>
2025-10-23 15:52:17 +08:00
..
__init__.py
[1/N][refactor] torchair deepseek modeling refactor (#2384)
2025-08-18 15:00:37 +08:00
qwen2.py
[KVCache][Bugfix] Fix kv cache initialization error of attention layer (#3113)
2025-09-24 11:32:34 +08:00
qwen3_moe.py
[MoE] [Refactor] Combine common_fused_moe and fused_moe (#3176)
2025-10-09 14:12:46 +08:00
torchair_deepseek_mtp.py
perf : optimize memory for deepseek mtp (#2713)
2025-10-23 15:52:17 +08:00
torchair_deepseek_v2.py
[feat][torchair] support super kernel feat for quantized dsr1 (#3485)
2025-10-20 20:04:37 +08:00
torchair_deepseek_v3.py
[1/N][refactor] torchair deepseek modeling refactor (#2384)
2025-08-18 15:00:37 +08:00
torchair_pangu_moe.py
[KVCache][Bugfix] Fix kv cache initialization error of attention layer (#3113)
2025-09-24 11:32:34 +08:00
Powered by Gitea Version: 1.24.3 Page: 592ms Template: 104ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API