Revert "fix(precision): guard all corex .so outputs with nan_to_num + reduce max-model-len"
This reverts commit 8acc47129b.
This commit is contained in:
@@ -8,7 +8,7 @@ command:
|
||||
- --served-model-name
|
||||
- llm
|
||||
- --max-model-len
|
||||
- '131072'
|
||||
- '256000'
|
||||
- --gpu-memory-utilization
|
||||
- '0.95'
|
||||
- --trust-remote-code
|
||||
|
||||
Reference in New Issue
Block a user