project6 4d9165fa30 arch(tuning): translate CCCL tuning_transform_tile.cuh — derive chunk sizes from hardware ...

tuning_transform_tile.cuh entire design (90 lines):
  pick_tile_size() computes optimal tile dimensions from:
    - Hardware: threads_per_block=128, vector_bytes=16 (LDG.E.128),
      max_occupancy=16, cc_to_min_bytes_in_flight(cc)
    - Data types: min(sizeof(Out), sizeof(Ins)...) → items_for_vec
    - Latency: target / (occupancy × threads × bytes) → items_for_latency
    - Result: max(vec, latency) rounded to power_of_2, capped at 32
    - Special: MUFU-heavy ops with small types → reduce items/thread
  Key insight: tile size is DERIVED, not hardcoded.

Translation to _HardwarePolicy.detect():
  Previous: deltanet_chunk_size = 64 (hardcoded), prefill_chunk = 4096
  Now: chunk_size derived from solve_triangular availability:
    - solve_tri available → 64 (amortize launch, like CCCL max_items)
    - solve_tri unavailable → 32 (fewer Python iterations, like CCCL
      MUFU-heavy reduction for sub-4B ops)
  prefill_chunk stays 4096 but with documented derivation from
  BI-V100 memory budget (matching CCCL's bytes_in_flight target).

CCCL source: cub/cub/device/dispatch/tuning/tuning_transform_tile.cuh
Maps to: qwen3_6_scripts/qwen3_5.py (_HardwarePolicy)

2026-08-07 09:15:56 +00:00

..

qwen3_5

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

qwen3_5_moe

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

reasoning

fix(critical): 3 fixes from sub508 diagnosis — n>1 crash guard + thinking format + content fallback

2026-08-07 07:55:04 +00:00

_custom_ops.py

fix(critical): CCCL policy_selector degradation for MoE — PyTorch fallback for topk_softmax

2026-08-07 08:56:50 +00:00

api_server.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

arg_utils.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

chat_utils.py

fix(critical): 3 bugs causing 0.0 score — OOM crash + thinking param + multimodal

2026-08-07 07:05:40 +00:00

cli_args.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logits_processor.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

mamba_cache.py

[fix/correctness] mamba_cache: safe swap via clone, not in-place fancy indexing

2026-08-06 06:33:26 +00:00

model_runner.py

fix(engine): CCCL overflow_cast + checked_allocator patterns for NaN/OOM

2026-08-07 08:56:36 +00:00

paged_attention_v2_pytorch.py

[ENGINE] CCCL SmemResource pattern: pre-allocate staging buffers in V2 paged attention

2026-08-07 04:37:44 +00:00

paged_attn.py

perf: increase prefix attention tile budget 96MB→256MB

2026-08-07 04:44:18 +00:00

patch_ops.sh

fix(critical): patch_ops.sh cwd bug — all cp/deploy ./paths resolved against Dockerfile WORKDIR=/workspace/ instead of script dir

2026-08-07 06:20:02 +00:00

patch_transformers_qwen3_5.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

prefix_prefill.py

fix(critical): v2 kernel softmax normalization was commented out — outputs were wrong

2026-08-07 02:46:46 +00:00

protocol.py

fix: max_num_seqs=2 for n=2 support + remove protocol n clamp

2026-08-07 08:18:41 +00:00

qwen3_5.py

arch(tuning): translate CCCL tuning_transform_tile.cuh — derive chunk sizes from hardware

2026-08-07 09:15:56 +00:00

qwen3coder_tool_parser.py

fix(critical): disable thinking for tool_call requests — fixes d03_tool_call FAIL

2026-08-07 07:45:28 +00:00

registry.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

sampler.py

[BASE] qwen3_6_scripts/sampler.py: CCCL topk unsorted output optimization

2026-08-06 02:55:51 +00:00

scheduler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sequence.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

serving_chat.py

fix(thinking): default enable_thinking=True for t1a/t1c PASS

2026-08-07 09:01:57 +00:00

tool_parsers_init.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

verify_functional.py

fix(verify): remove duplicate TC-22~30 test definitions — CCCL test_then.cu audit

2026-08-07 06:36:12 +00:00

xformers.py

feat(xformers): replace Q-only tiling with Q+KV tiling + online softmax

2026-08-07 01:54:52 +00:00