project6-dev 0ea77690a0 fix(CRITICAL): stop overwriting base image model layer — match comp 168 strategy ...

Root cause of ALL failures: we overwrite base image's production code with our
inferior versions, breaking multimodal, killing C++ kernel performance, and
causing engine death.

Comp 168 evidence (48/52 pass, score=60194):
  - Uses base image qwen3_5.py (81706B) with full multimodal + CoreX integration
  - Uses base image corex_gdn/moe/fa2.py with real C++ kernels (libcorex_gdn.so)
  - Uses base image _custom_ops.py (ERROR spam is harmless)
  - d01: 8.49s, d05 multimodal: PASS, t13 base64 image: PASS

Our sub 508 (21/52 pass, score=0):
  - Overwrites qwen3_5.py → NO multimodal → engine death on image request
  - Overwrites corex_*.py → Python fallback → d01: 95.87s (11x slower)
  - Overwrites _custom_ops.py → may break base fallback chain

Changes:
1. patch_ops.sh: qwen3_5.py — KEEP base if >1000 bytes (was: ALWAYS overwrite)
2. patch_ops.sh: corex_*.py — KEEP base if >500 bytes (was: ALWAYS overwrite)
3. patch_ops.sh: _custom_ops.py — KEEP base always (was: ALWAYS overwrite)
4. computility-run.yaml: match comp 168 exactly:
   - max_model_len: 80000 → 256000
   - gpu_memory_utilization: 0.95 → 0.9
   - max_num_seqs: 2 → 1
   - REMOVE chunked_prefill + batched_tokens
   - REMOVE limit-mm-per-prompt (base image handles it)

2026-08-10 09:43:36 +00:00

..

flash_qla_sm70

fix(GDN): gate clamp [-5,0] (decay only) + state clamp ±100

2026-08-10 04:44:05 +00:00

qwen3_5

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

qwen3_5_moe

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

reasoning

fix(critical): 3 fixes from sub508 diagnosis — n>1 crash guard + thinking format + content fallback

2026-08-07 07:55:04 +00:00

_custom_ops.py

fix(MoE): robust CUDA kernel loading + no-GPU precompile

2026-08-10 07:50:28 +00:00

api_server.py

refactor(api): CCCL tuning_adjacent_difference policy_selector — dynamic error handling

2026-08-08 07:01:37 +00:00

arg_utils.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

chat_utils.py

fix(critical): 3 bugs causing 0.0 score — OOM crash + thinking param + multimodal

2026-08-07 07:05:40 +00:00

cli_args.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logits_processor.py

[ARCH] Eliminate AST patch scripts — full file replacements only

2026-08-05 08:24:43 +00:00

mamba_cache.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

model_runner.py

fix(engine): CCCL overflow_cast + checked_allocator patterns for NaN/OOM

2026-08-07 08:56:36 +00:00

paged_attention_v2_pytorch.py

[ENGINE] CCCL SmemResource pattern: pre-allocate staging buffers in V2 paged attention

2026-08-07 04:37:44 +00:00

paged_attn.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

patch_model_runner.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

patch_numerical_stability.py

fix(cccl): robust fallback — inject module-level safety if regex misses

2026-08-07 09:58:35 +00:00

patch_ops.sh

fix(CRITICAL): stop overwriting base image model layer — match comp 168 strategy

2026-08-10 09:43:36 +00:00

patch_transformers_qwen3_5.py

fix(critical): remove pip install transformers — was breaking corex kernel loading

2026-08-07 10:02:09 +00:00

patch_vllm_tool_parser.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

patch_xformers_sdpa_batch_kernel.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

patch_xformers_sdpa_batch.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

patch_xformers_sdpa_seq_kernel.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

patch_xformers_sdpa_seq.py

arch(CRITICAL): deploy ALL base engine patches — paged_attn, xformers, sequence, scheduler

2026-08-08 10:48:01 +00:00

precompile_gdn.py

build(SM70): precompile GDN CUDA kernel to .so during docker build

2026-08-10 01:08:38 +00:00

prefix_prefill.py

fix(critical): v2 kernel softmax normalization was commented out — outputs were wrong

2026-08-07 02:46:46 +00:00

probe_corex_api.py

fix(build): add .dockerignore + safe probe — fix docker build failure

2026-08-08 11:21:43 +00:00

protocol.py

fix(dispatch): radix_sort-inspired size-dispatch — disable thinking for small max_tokens, clamp oversized max_tokens

2026-08-08 07:36:31 +00:00

qwen3_5_base_original.py

arch(CRITICAL): replace custom qwen3_5.py with base original (1369 lines)

2026-08-08 08:10:55 +00:00

qwen3_5.py

revert(corex_gdn+qwen3_5): restore to ff3562b9 — no rewriting existing modules

2026-08-10 09:32:24 +00:00

qwen3coder_tool_parser.py

refactor(tool_parser): CCCL agent_radix_sort_downsweep union TempStorage — phased state

2026-08-08 07:02:22 +00:00

registry.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

sampler.py

[BASE] qwen3_6_scripts/sampler.py: CCCL topk unsorted output optimization

2026-08-06 02:55:51 +00:00

scheduler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sequence.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

serving_chat.py

fix(d05): remove image_url stripping — model IS multimodal

2026-08-10 00:15:06 +00:00

tool_parsers_init.py

[ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py

2026-08-05 08:36:52 +00:00

verify_functional.py

fix(verify): remove duplicate TC-22~30 test definitions — CCCL test_then.cu audit

2026-08-07 06:36:12 +00:00

xformers.py

feat(xformers): replace Q-only tiling with Q+KV tiling + online softmax

2026-08-07 01:54:52 +00:00