8 Commits

Author	SHA1	Message	Date
wanglin	ee1c3c4c9b	add --hf-overrides architectures=Qwen3_5MoeForCausalLM (fix model config arch mismatch)	2026-10-02 20:00:19 +08:00
wanglin	941c42a04f	v3: 对齐成功配置 — 补 --enforce-eager 与 corex 运行库环境变量, max-model-len 256K / gmu 0.95 / seqs 4 / bt 8192 ... v3: 对齐成功配置 — 补 --enforce-eager 与 corex 运行库环境变量, max-model-len 256K / gmu 0.95 / seqs 4 / bt 8192	2026-10-02 19:53:25 +08:00
wanglin	d6dfff0918	v2: conservative max-num-seqs=8 + batched-tokens=16384, revert dtype/256K (v1 OOM crash)	2026-10-01 23:29:16 +08:00
wanglin	a56835199e	更新 computility-run.yaml ... 优化启动参数：max-model-len→256K, max-num-seqs→8, batched-tokens→16384, 加prefix-caching和dtype	2026-09-24 07:57:33 +08:00
Lu Xinlong	810874ddb8	enable prefix caching	2026-06-26 13:27:52 +08:00
Lu Xinlong	c84151eef9	fix issues	2026-06-26 12:55:02 +08:00
liwei02	3d62430fd7	调整配置参数	2026-06-25 17:36:43 +08:00
Lu Xinlong	72aa7e690a	Add README and start commands	2026-06-23 17:17:22 +08:00