xc-llm-ascend

Files

wangxiyuan 8a7154001e [0.11.0]Chery pick pta upgrade change (#3940 )

This PR cherry-pick two commit from main to upgrade torch-npu to 2.7.1
official release

---------

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>

2025-10-31 22:14:26 +08:00

disaggregated_prefill_v1

[0.11.0]Chery pick pta upgrade change (#3940 )

2025-10-31 22:14:26 +08:00

eplb

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

external_online_dp

[Feature] Support moe multi-stream for aclgraph. (#2946 )

2025-09-19 11:06:45 +08:00

offline_data_parallel.py

[bugfix] Fix Qwen3-30B-A3B dp parallel hung issue when running with the dp parallel example (#3287 )

2025-09-30 15:30:01 +08:00

offline_disaggregated_prefill_npu.py

Fix VLLM_ASCEND_LLMDD_RPC_PORT renaming (#3108 )

2025-09-23 10:33:04 +08:00

offline_dualbatch_overlap_npu.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979 )

2025-07-28 14:06:20 +08:00

offline_embed.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_external_launcher.py

[Test] enable external launcher and add e2e test for sleep mode in level2 (#3344 )

2025-10-11 17:29:38 +08:00

offline_inference_audio_language.py

Fix some ci issue and refactor modelrunner (#2445 )

2025-08-20 09:01:04 +08:00

offline_inference_npu_tp2.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_inference_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_inference_sleep_mode_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

offline_weight_load.py

2025-09-26 11:07:10 +08:00

prompt_embedding_inference.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837 )

2025-07-17 14:13:30 +08:00

run_dp_server.sh

[Feature] Support moe multi-stream for aclgraph. (#2946 )

2025-09-19 11:06:45 +08:00