|
|
941c42a04f
|
v3: 对齐成功配置 — 补 --enforce-eager 与 corex 运行库环境变量, max-model-len 256K / gmu 0.95 / seqs 4 / bt 8192
v3: 对齐成功配置 — 补 --enforce-eager 与 corex 运行库环境变量, max-model-len 256K / gmu 0.95 / seqs 4 / bt 8192
|
2026-10-02 19:53:25 +08:00 |
|
|
|
d6dfff0918
|
v2: conservative max-num-seqs=8 + batched-tokens=16384, revert dtype/256K (v1 OOM crash)
|
2026-10-01 23:29:16 +08:00 |
|
|
|
a56835199e
|
更新 computility-run.yaml
优化启动参数：max-model-len→256K, max-num-seqs→8, batched-tokens→16384, 加prefix-caching和dtype
|
2026-09-24 07:57:33 +08:00 |
|
|
|
810874ddb8
|
enable prefix caching
|
2026-06-26 13:27:52 +08:00 |
|
|
|
c84151eef9
|
fix issues
|
2026-06-26 12:55:02 +08:00 |
|
liwei02
|
3d62430fd7
|
调整配置参数
|
2026-06-25 17:36:43 +08:00 |
|
|
|
72aa7e690a
|
Add README and start commands
|
2026-06-23 17:17:22 +08:00 |
|
