v2: conservative max-num-seqs=8 + batched-tokens=16384, revert dtype/256K (v1 OOM crash)

更新 computility-run.yaml
优化启动参数：max-model-len→256K, max-num-seqs→8, batched-tokens→16384, 加prefix-caching和dtype
2026-10-01 23:29:16 +08:00 · 2026-09-24 07:57:33 +08:00
1 changed files with 2 additions and 2 deletions
--- a/computility-run.yaml
+++ b/computility-run.yaml
@@ -15,11 +15,11 @@ command:
    - -tp
    - '4'
    - --max-num-seqs
-    - '1'
+    - '8'
    - --disable-log-requests
    - --disable-frontend-multiprocessing
    - --max-num-batched-tokens
-    - '8192'
+    - '16384'
    - --enable-chunked-prefill
    - --max-seq-len-to-capture
    - '32768'
Author	SHA1	Message	Date
wanglin	d6dfff0918	v2: conservative max-num-seqs=8 + batched-tokens=16384, revert dtype/256K (v1 OOM crash)	2026-10-01 23:29:16 +08:00
wanglin	a56835199e	更新 computility-run.yaml 优化启动参数：max-model-len→256K, max-num-seqs→8, batched-tokens→16384, 加prefix-caching和dtype	2026-09-24 07:57:33 +08:00