fix(critical): match Sub168 config exactly + disable risky numerical patch

1. computility-run.yaml: restore Sub168's proven params:
   - max-model-len=256000 (not 100000)
   - gpu-memory-utilization=0.95 (not 0.90)
   - max-num-seqs=2 (not 1)
   - max-num-batched-tokens=4096 (restored)
   - enable-chunked-prefill (restored)
   These params worked for Sub168. Now that pip install is removed,
   they should work for us too.

2. patch_ops.sh: disable patch_numerical_stability.py
   If corex_gdn loads (which it should without pip install breaking deps),
   Python GatedDeltaNet fallback never runs, so numerical patches are
   unnecessary. Running regex replacements on qwen3_5.py risks breaking
   corex import conditions.
This commit is contained in:
project6
2026-08-07 10:27:53 +00:00
parent 1ba0dd3966
commit 2680d62ec8
2 changed files with 14 additions and 15 deletions

View File

@@ -8,14 +8,16 @@ command:
- --served-model-name
- llm
- --max-model-len
- '100000'
- '256000'
- --gpu-memory-utilization
- '0.90'
- '0.95'
- --trust-remote-code
- -tp
- '4'
- --max-num-seqs
- '1'
- '2'
- --max-num-batched-tokens
- '4096'
- --disable-log-requests
- --disable-frontend-multiprocessing
- --enforce-eager
@@ -25,6 +27,7 @@ command:
- --reasoning-parser
- qwen3
- --enable-prefix-caching
- --enable-chunked-prefill
- --dtype
- half
env: