zzzzwwjj 5c6d05a59e support deepseek quant & mix-parallel with graphmode (#585) ...

### What this PR does / why we need it?
1. support deepseek with w8a8 quant;
2. support deepseek with mix-parallel(multi-DP, EP+TP);
3. support deepseek with graphmode.
---------

Signed-off-by: wen-jie666 <wenjie39@huawei.com>
Signed-off-by: Yizhou Liu <liuyizhou5@h-partners.com>
Signed-off-by: libaokui <libaokui@huawei.com>
Signed-off-by: linfeng-yuan <1102311262@qq.com>
Co-authored-by: wen-jie666 <wenjie39@huawei.com>

2025-04-23 16:23:25 +08:00

..

dp_offline

support deepseek quant & mix-parallel with graphmode (#585)

2025-04-23 16:23:25 +08:00

disaggregated_prefill_hccl.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

offline_disaggregated_prefill_npu.py

[Feature] Add PD separation feature (#432)

2025-04-15 15:11:35 +08:00

offline_distributed_inference_npu.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

offline_inference_audio_language.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

offline_inference_npu_v1.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

offline_inference_npu.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00