Pleaplusone 1a1f9a6d89 port deepseekv2 and mtp to main branch (#429) ...

### What this PR does / why we need it?
This PR ports all the deepseek graph mode code and mtp code from v0.7.3
to the main branch
---------

Signed-off-by: SidaoY <1024863041@qq.com>
Signed-off-by: linfeng-yuan <1102311262@qq.com>
Signed-off-by: Yizhou Liu <liuyizhou5@h-partners.com>
Signed-off-by: mengwei805 <mengwei25@huawei.com>
Signed-off-by: libaokui <libaokui@huawei.com>
Signed-off-by: q00832892 <qiaoyang19@huawei.com>
Signed-off-by: ganyi <pleaplusone.gy@gmail.com>
Co-authored-by: SidaoY <1024863041@qq.com>
Co-authored-by: linfeng-yuan <1102311262@qq.com>
Co-authored-by: Yizhou Liu <liuyizhou5@h-partners.com>
Co-authored-by: mengwei805 <mengwei25@huawei.com>
Co-authored-by: libaokui <libaokui@huawei.com>

2025-04-19 17:38:18 +08:00

..

dp_offline

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

disaggregated_prefill_hccl.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

offline_disaggregated_prefill_npu.py

[Feature] Add PD separation feature (#432)

2025-04-15 15:11:35 +08:00

offline_distributed_inference_npu.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

offline_inference_audio_language.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

offline_inference_npu_v1.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

offline_inference_npu.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00