forked from EngineX-Iluvatar/enginex-vllm-bi100-qwen36
add --hf-overrides architectures=Qwen3_5MoeForCausalLM (fix model config arch mismatch)
This commit is contained in:
@@ -30,6 +30,8 @@ command:
|
||||
- --reasoning-parser
|
||||
- qwen3
|
||||
- --enable-prefix-caching
|
||||
- --hf-overrides
|
||||
- '{"architectures":["Qwen3_5MoeForCausalLM"]}'
|
||||
- --dtype
|
||||
- half
|
||||
env:
|
||||
|
||||
Reference in New Issue
Block a user