Logo
Explore Help
Register Sign In
EngineX/xc-llm-ascend
3
0
Fork 0
You've already forked xc-llm-ascend
Code Issues Pull Requests Projects Releases Wiki Activity
Files
802c574532bf4cc6d46b6ee508e7d0f2b6e023a5
xc-llm-ascend/vllm_ascend/torchair/models
History
NeverRaR 807686dec9 perf : optimize memory for deepseek mtp (#2713)
### What this PR does / why we need it?
delete the temp tensor to optimize memory for deepseek mtp for torchair
case

- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0

Signed-off-by: boying <897013703@qq.com>
2025-10-23 15:52:17 +08:00
..
__init__.py
[1/N][refactor] torchair deepseek modeling refactor (#2384)
2025-08-18 15:00:37 +08:00
qwen2.py
[KVCache][Bugfix] Fix kv cache initialization error of attention layer (#3113)
2025-09-24 11:32:34 +08:00
qwen3_moe.py
[MoE] [Refactor] Combine common_fused_moe and fused_moe (#3176)
2025-10-09 14:12:46 +08:00
torchair_deepseek_mtp.py
perf : optimize memory for deepseek mtp (#2713)
2025-10-23 15:52:17 +08:00
torchair_deepseek_v2.py
[feat][torchair] support super kernel feat for quantized dsr1 (#3485)
2025-10-20 20:04:37 +08:00
torchair_deepseek_v3.py
[1/N][refactor] torchair deepseek modeling refactor (#2384)
2025-08-18 15:00:37 +08:00
torchair_pangu_moe.py
[KVCache][Bugfix] Fix kv cache initialization error of attention layer (#3113)
2025-09-24 11:32:34 +08:00
Powered by Gitea Version: 1.24.3 Page: 119ms Template: 8ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API