zhuo97 f5404dc650 Fix the device error when using ray as vllm-acend backend (#884) ...

1. Remove RAY_EXPERIMENTAL_NOSET_ASCEND_RT_VISIBLE_DEVICES
2. Add lazy init for vllm_ascend_C

Signed-off-by: zhuo97 <1103045176@qq.com>

2025-06-16 21:03:16 +08:00

..

disaggregated_prefill

[fix] fix bug in 1p1d disaggregated_prefill example (#1184)

2025-06-12 19:40:58 +08:00

dp_offline

[Misc] Refactor additional_config (#1029)

2025-06-05 16:28:01 +08:00

offline_disaggregated_prefill_npu.py

[Feature] Add PD separation feature (#432)

2025-04-15 15:11:35 +08:00

offline_distributed_inference_npu.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

offline_dualbatch_overlap_npu.py

[perf]: support dual-batch overlap(dbo) for deepseek (#941)

2025-06-07 16:46:58 +08:00

offline_inference_audio_language.py

[MISC] fix format check error (#654)

2025-04-29 11:14:19 +08:00

offline_inference_npu_v1.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

offline_inference_npu.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

offline_multi_step_custom_ops.py

Fix the device error when using ray as vllm-acend backend (#884)

2025-06-16 21:03:16 +08:00

prompt_embedding_inference.py

[ModelRunner] Support embedding inputs (#916)

2025-06-06 20:21:13 +08:00

run_dp_attention_etp16_benmark.sh

etp best a2 (#1101)

2025-06-11 10:40:50 +08:00

run_dp_attention_etp16.sh

etp best a2 (#1101)

2025-06-11 10:40:50 +08:00

run_dp_server.sh

[Disaggregated Prefill] P2P Disaggregated Prefill based on llm_datadist (#694)

2025-05-01 22:31:36 +08:00