[Doc] Update faq (#2334)
### What this PR does / why we need it? - update determinitic calculation - update support device ### Does this PR introduce _any_ user-facing change? - Users should update ray and protobuf when using ray as distributed backend - Users should change to use `export HCCL_DETERMINISTIC=true` when enabling determinitic calculation ### How was this patch tested? N/A - vLLM version: v0.10.0 - vLLM main: https://github.com/vllm-project/vllm/commit/ea1292ad3ee724e44b3dfec2a26778cd614729f9 Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
1 parent
dc585f148a
commit
49ec6c98b7
1 file changed
+5
-5
+5
-5
@@ -10,7 +10,7 @@
|
||||
|
||||
### 1. What devices are currently supported?
|
||||
|
||||
Currently, **ONLY** Atlas A2 series(Ascend-cann-kernels-910b),Atlas A2 series(Atlas-A3-cann-kernels) and Atlas 300I(Ascend-cann-kernels-310p) series are supported:
|
||||
Currently, **ONLY** Atlas A2 series(Ascend-cann-kernels-910b),Atlas A3 series(Atlas-A3-cann-kernels) and Atlas 300I(Ascend-cann-kernels-310p) series are supported:
|
||||
|
||||
- Atlas A2 Training series (Atlas 800T A2, Atlas 900 A2 PoD, Atlas 200T A2 Box16, Atlas 300T A2)
|
||||
- Atlas 800I A2 Inference series (Atlas 800I A2)
|
||||
@@ -161,10 +161,10 @@ for output in outputs:
|
||||
2. Set the following enveriments parameters:
|
||||
|
||||
```bash
|
||||
export LCCL_DETERMINISTIC = 1
|
||||
export HCCL_DETERMINISTIC = 1
|
||||
export ATB_MATMUL_SHUFFLE_K_ENABLE = 0
|
||||
export ATB_LLM_LCOC_ENABLE = 0
|
||||
export LCCL_DETERMINISTIC=1
|
||||
export HCCL_DETERMINISTIC=true
|
||||
export ATB_MATMUL_SHUFFLE_K_ENABLE=0
|
||||
export ATB_LLM_LCOC_ENABLE=0
|
||||
```
|
||||
|
||||
### 19. How to fix the error "ImportError: Please install vllm[audio] for audio support" for Qwen2.5-Omni model?
|
||||
|
||||
Reference in new issue
Block a user