dylanyunlon f3810c53ae [ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py ...

Full file replacements for:
  - registry.py (453 lines): Qwen3_5ForCausalLM + Qwen3_5MoeForCausalLM
    pre-registered in _TEXT_GENERATION_MODELS dict
  - tool_parsers/__init__.py: Qwen3CoderToolParser pre-imported + exported

Eliminated: patch_vllm_qwen3_5.py, patch_vllm_tool_parser.py

Remaining: patch_transformers_qwen3_5.py (1 script) — this one modifies
pip-installed transformers' configuration_auto.py which is version-specific
and can't be pre-copied. Documented in patch_ops.sh.

Score: 5/6 patch scripts eliminated. Only 1 remains (unavoidable).

2026-08-05 08:36:52 +00:00

..

qwen3_5

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

qwen3_5_moe

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

reasoning

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

api_server.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

arg_utils.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

chat_utils.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

cli_args.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logits_processor.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

mamba_cache.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

model_runner.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

paged_attn.py

[CCCL-PORT] CachingDeviceAllocator buffer reuse in prefix attention tile loop

2026-08-05 08:36:10 +00:00

patch_enable_triton.py

[OPT] Enable Triton prefill + raise decode threshold — the actual performance work

2026-07-30 15:41:25 +00:00

patch_head256_triton.py

[OPT] head_dim=256 Triton support — BLOCK=32 for Qwen3.6

2026-07-30 16:05:01 +00:00

patch_ixformer_native.py

[VERIFIED] Hardware-tested native kernel integration

2026-07-31 06:43:25 +00:00

patch_model_runner.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_ops.sh

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

patch_paged_attention_v2.py

[BUGFIX] patch_paged_attention_v2.py: NameError V2_MODULE undefined → V2_MODULE_PYTORCH

2026-08-05 07:07:54 +00:00

patch_transformers_qwen3_5.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_triton_tuning.py

fix: critical config + tuning corrections from CCCL source analysis

2026-08-03 06:45:54 +00:00

patch_vectorized_decode.py

[OPT] Enable Triton prefill + raise decode threshold — the actual performance work

2026-07-30 15:41:25 +00:00

patch_vllm_qwen3_5.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_vllm_tool_parser.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_xformers_sdpa_batch_kernel.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_xformers_sdpa_batch.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_xformers_sdpa_seq_kernel.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

patch_xformers_sdpa_seq.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

protocol.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

qwen3_5.py

[CCCL-PORT] Try native FusedMoE kernel before PyTorch fallback

2026-08-05 08:31:34 +00:00

qwen3coder_tool_parser.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

registry.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

sampler.py

[CCCL-PORT] Deploy sampler.py top-k fast path from partition/flagged.cu

2026-08-05 08:30:21 +00:00

scheduler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sequence.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

serving_chat.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

tool_parsers_init.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

verify_functional.py

[CCCL-PORT] Functional verification from three_way_partition test pattern + sampler deploy

2026-08-05 08:31:52 +00:00

xformers.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00