project6-dev 71644e1530 fix: num-gpu-blocks-override 4000→5500 — 4000 blocks can't fit a 70K prompt
5500 blocks × 16 tokens = 88K token capacity.
Covers max-model-len=80000 + output generation headroom.
2026-08-13 13:25:23 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-13 02:29:40 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%