fix(critical): sync baseline.muh max_model_len=100000 gpu_mem=0.90 — match computility-run.yaml
Root cause of job 105 scoring 0.0: - baseline.muh had max_model_len=256000 + gpu_memory_utilization=0.95 - computility-run.yaml had the safe values (100000 + 0.90) - Platform scheduler sent baseline.muh values to docker run command - Result: OOM on KV cache allocation → service crash → 881/881 Connection refused Diagnosis from submit日志: - benchmark-agent marked success (model loaded OK) - But service crashed before evaluation started - All 881 replay requests → Connection refused - All 5 opencompass benchmarks → 0.0 (aime, gpqa, hle, simpleqa, longbench) Fix: sync baseline.muh to match computility-run.yaml safe values
This commit is contained in:
@@ -16,8 +16,8 @@
|
||||
vllm:
|
||||
model_path: /model
|
||||
served_model_name: llm
|
||||
max_model_len: 256000
|
||||
gpu_memory_utilization: 0.95
|
||||
max_model_len: 100000
|
||||
gpu_memory_utilization: 0.90
|
||||
tensor_parallel: 4
|
||||
max_num_seqs: 2
|
||||
max_num_batched_tokens: 4096
|
||||
|
||||
Reference in New Issue
Block a user