xc-llm-ascend

Files

hucong 12bc78d252 [v0.11.0][BugFix][P/D] Modify the recalculation logic to prevent waiting requests from filling up the D node KVCache (#3686 )

### What this PR does / why we need it?
Modify the recalculation logic to prevent waiting requests from filling
up the D node KVCache

Signed-off-by: underfituu <hzhucong@163.com>

2025-10-25 09:15:42 +08:00

disaggregated_prefill_v1

[v0.11.0][BugFix][P/D] Modify the recalculation logic to prevent waiting requests from filling up the D node KVCache (#3686 )

2025-10-25 09:15:42 +08:00

eplb

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

external_online_dp

[Feature] Support moe multi-stream for aclgraph. (#2946 )

2025-09-19 11:06:45 +08:00

offline_data_parallel.py

[bugfix] Fix Qwen3-30B-A3B dp parallel hung issue when running with the dp parallel example (#3287 )

2025-09-30 15:30:01 +08:00

offline_disaggregated_prefill_npu.py

Fix VLLM_ASCEND_LLMDD_RPC_PORT renaming (#3108 )

2025-09-23 10:33:04 +08:00

offline_dualbatch_overlap_npu.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979 )

2025-07-28 14:06:20 +08:00

offline_embed.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_external_launcher.py

[Test] enable external launcher and add e2e test for sleep mode in level2 (#3344 )

2025-10-11 17:29:38 +08:00

offline_inference_audio_language.py

Fix some ci issue and refactor modelrunner (#2445 )

2025-08-20 09:01:04 +08:00

offline_inference_npu_tp2.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_inference_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_inference_sleep_mode_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_weight_load.py

2025-09-26 11:07:10 +08:00

prompt_embedding_inference.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

run_dp_server.sh

[Feature] Support moe multi-stream for aclgraph. (#2946 )

2025-09-19 11:06:45 +08:00