Claude 87cc24b819 doc(prd): CCCL tuning_select_if.cuh complete design → serving_chat.py mapping
tuning_select_if.cuh (2729 lines) complete design analysis:
- 3-level dispatch: compute_capability → sm_tuning → benchmark params
- Per-type/per-mode/per-hardware specialization tables
- Every param from real benchmark (annotated with 4 speedup ratios)
- Fallback to conservative default when no tuning match

Maps to our serving layer:
- Request type dispatch (tool/reasoning/basic) = compute_capability
- max_tokens cap by type = threads_per_block/items_per_thread
- Sub168 log data = benchmark annotations
- default_policy = conservative fallback

No code changes needed — current serving_chat.py already implements
this 3-level dispatch pattern with Sub168 benchmark-derived params.
2026-08-08 07:52:02 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-07 07:47:01 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%