xc-llm-ascend

Files

wangxiaoteng888 c2d58c0655 [P/D][BugFix][v0.11.0-dev]Fix proxy format processing errors & Layerwise connector performance optimization (#4069 )

### What this PR does / why we need it?
1.Fix proxy format processing errors.
2.Layer-wise connector performance optimization

Signed-off-by: wangxiaoteng <wangxiaoteng@huawei.com>

2025-11-09 09:55:10 +08:00

disaggregated_prefill_v1

[P/D][BugFix][v0.11.0-dev]Fix proxy format processing errors & Layerwise connector performance optimization (#4069 )

2025-11-09 09:55:10 +08:00

eplb

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

external_online_dp

[Feature] Support moe multi-stream for aclgraph. (#2946 )

2025-09-19 11:06:45 +08:00

offline_data_parallel.py

[bugfix] Fix Qwen3-30B-A3B dp parallel hung issue when running with the dp parallel example (#3287 )

2025-09-30 15:30:01 +08:00

offline_disaggregated_prefill_npu.py

Fix VLLM_ASCEND_LLMDD_RPC_PORT renaming (#3108 )

2025-09-23 10:33:04 +08:00

offline_dualbatch_overlap_npu.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979 )

2025-07-28 14:06:20 +08:00

offline_embed.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_external_launcher.py

[Test] enable external launcher and add e2e test for sleep mode in level2 (#3344 )

2025-10-11 17:29:38 +08:00

offline_inference_audio_language.py

Fix some ci issue and refactor modelrunner (#2445 )

2025-08-20 09:01:04 +08:00

offline_inference_npu_tp2.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_inference_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_inference_sleep_mode_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_weight_load.py

2025-09-26 11:07:10 +08:00

prompt_embedding_inference.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

run_dp_server.sh

[Feature] Support moe multi-stream for aclgraph. (#2946 )

2025-09-19 11:06:45 +08:00