dylanyunlon 32fd4299b3 [test+engine] 18→21 test cases + CCCL-informed improvements ...

verify_functional.py:
- TC-19 Idempotency: seed=42 temp=0 two requests must be identical
  (from CCCL catch2_test_device_reduce_deterministic.cu RFA pattern)
- TC-20 Top-p boundary: top_p=1.0 and 0.01 edge cases
  (from CCCL catch2_test_device_topk_keys.cu k=1/k=N boundaries)
- TC-21 Frequency penalty: freq_penalty=1.5 + presence_penalty=0.5
  (from CCCL tuning_histogram.cuh privatized bin counting)

model_runner.py:
- Added CCCL cuda::experimental::graph_memory_resource design notes
  on CUDA Graph capture batch size optimization for BI-V100

CCCL sources read as input this session:
- catch2_test_device_segmented_reduce_custom_policy_hub.cu (policy injection)
- thrust/detail/random_bijection.h (Feistel cipher for sampling)
- cudax/experimental/graph.cuh (CUDA Graph memory pools)
- catch2_test_device_reduce_deterministic.cu (RFA determinism)

2026-08-06 06:33:18 +00:00

..

qwen3_5

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

qwen3_5_moe

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

reasoning

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

_custom_ops.py

[FIX] Deploy _custom_ops.py SMEM 32KB→48KB fix — was in repo but never deployed

2026-08-05 08:38:40 +00:00

api_server.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

arg_utils.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

chat_utils.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

cli_args.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logits_processor.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

mamba_cache.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

model_runner.py

[test+engine] 18→21 test cases + CCCL-informed improvements

2026-08-06 06:33:18 +00:00

paged_attn.py

[critical/deploy] sync root paged_attn.py + prefix_prefill.py → qwen3_6_scripts/

2026-08-06 06:10:56 +00:00

patch_ops.sh

[FIX] Deploy _custom_ops.py SMEM 32KB→48KB fix — was in repo but never deployed

2026-08-05 08:38:40 +00:00

patch_transformers_qwen3_5.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

prefix_prefill.py

[critical/deploy] sync root paged_attn.py + prefix_prefill.py → qwen3_6_scripts/

2026-08-06 06:10:56 +00:00

protocol.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

qwen3_5.py

[FIX] qwen3_5.py: replace solve_triangular with manual forward substitution

2026-08-06 03:02:29 +00:00

qwen3coder_tool_parser.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

registry.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

sampler.py

[BASE] qwen3_6_scripts/sampler.py: CCCL topk unsorted output optimization

2026-08-06 02:55:51 +00:00

scheduler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sequence.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

serving_chat.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

tool_parsers_init.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

verify_functional.py

[test+engine] 18→21 test cases + CCCL-informed improvements

2026-08-06 06:33:18 +00:00

xformers.py

[CRITICAL] computility-run.yaml: add all corex env vars + align with proven job66 config

2026-08-06 04:27:39 +00:00