fix(critical): match Sub168 config exactly + disable risky numerical patch
1. computility-run.yaml: restore Sub168's proven params: - max-model-len=256000 (not 100000) - gpu-memory-utilization=0.95 (not 0.90) - max-num-seqs=2 (not 1) - max-num-batched-tokens=4096 (restored) - enable-chunked-prefill (restored) These params worked for Sub168. Now that pip install is removed, they should work for us too. 2. patch_ops.sh: disable patch_numerical_stability.py If corex_gdn loads (which it should without pip install breaking deps), Python GatedDeltaNet fallback never runs, so numerical patches are unnecessary. Running regex replacements on qwen3_5.py risks breaking corex import conditions.
This commit is contained in:
@@ -8,14 +8,16 @@ command:
|
||||
- --served-model-name
|
||||
- llm
|
||||
- --max-model-len
|
||||
- '100000'
|
||||
- '256000'
|
||||
- --gpu-memory-utilization
|
||||
- '0.90'
|
||||
- '0.95'
|
||||
- --trust-remote-code
|
||||
- -tp
|
||||
- '4'
|
||||
- --max-num-seqs
|
||||
- '1'
|
||||
- '2'
|
||||
- --max-num-batched-tokens
|
||||
- '4096'
|
||||
- --disable-log-requests
|
||||
- --disable-frontend-multiprocessing
|
||||
- --enforce-eager
|
||||
@@ -25,6 +27,7 @@ command:
|
||||
- --reasoning-parser
|
||||
- qwen3
|
||||
- --enable-prefix-caching
|
||||
- --enable-chunked-prefill
|
||||
- --dtype
|
||||
- half
|
||||
env:
|
||||
|
||||
Reference in New Issue
Block a user