fix(build): remove --num-gpu-blocks-override — may fail platform yaml validation

Revert to yaml-only changes that don't add new CLI args:
- gpu-memory-utilization: 0.85 → 0.80 (more headroom for profiling)
- max-num-batched-tokens: 8192 → 4096 (smaller profiling dummy batch)
- removed: --num-gpu-blocks-override (not in platform's allowed arg list)
This commit is contained in:
project6-dev
2026-08-13 13:34:27 +00:00
parent 71644e1530
commit 5ec60dc574

View File

@@ -10,7 +10,7 @@ command:
- --max-model-len
- '80000'
- --gpu-memory-utilization
- '0.85'
- '0.80'
- --trust-remote-code
- -tp
- '4'
@@ -19,7 +19,7 @@ command:
- --disable-log-requests
- --disable-frontend-multiprocessing
- --max-num-batched-tokens
- '8192'
- '4096'
- --enable-chunked-prefill
- --max-seq-len-to-capture
- '32768'
@@ -32,8 +32,6 @@ command:
- --enforce-eager
- --dtype
- half
- --num-gpu-blocks-override
- '5500'
env:
- name: VLLM_ENGINE_ITERATION_TIMEOUT_S
value: 3600