fix(critical): sync baseline.muh max_model_len=100000 gpu_mem=0.90 — match computility-run.yaml

Root cause of job 105 scoring 0.0:
- baseline.muh had max_model_len=256000 + gpu_memory_utilization=0.95
- computility-run.yaml had the safe values (100000 + 0.90)
- Platform scheduler sent baseline.muh values to docker run command
- Result: OOM on KV cache allocation → service crash → 881/881 Connection refused

Diagnosis from submit日志:
- benchmark-agent marked success (model loaded OK)
- But service crashed before evaluation started
- All 881 replay requests → Connection refused
- All 5 opencompass benchmarks → 0.0 (aime, gpqa, hle, simpleqa, longbench)

Fix: sync baseline.muh to match computility-run.yaml safe values
This commit is contained in:
dylanyunlon
2026-08-07 07:22:52 +00:00
parent 19879ccaae
commit 812c374f7a

View File

@@ -16,8 +16,8 @@
vllm:
model_path: /model
served_model_name: llm
max_model_len: 256000
gpu_memory_utilization: 0.95
max_model_len: 100000
gpu_memory_utilization: 0.90
tensor_parallel: 4
max_num_seqs: 2
max_num_batched_tokens: 4096