Commit Graph

4 Commits

Author SHA1 Message Date
Claude
eb57eb7d1c clean: remove 444 .pyc files + libcccl_allocator.so from git tracking
These cause docker build failures on competition platform.
.gitignore and .dockerignore already exclude them.
2026-08-14 02:20:26 +00:00
root
9a52f05783 prebuilt: add corex_gdn_chunk_recurrent.so with fixed pybind kwargs 2026-08-14 02:10:54 +00:00
muh-bot
08dc010a15 [CRITICAL/base] Register Qwen3_5MoeForCausalLM in model registry + copy adapter to models/
WITHOUT THIS CHANGE: vllm cannot load Qwen3.6-35B-A3B model.
The model's config.json has architectures=['Qwen3_5MoeForCausalLM'],
but registry.py only had Qwen3ForCausalLM and Qwen3MoeForCausalLM.
Model init fails → ALL 50+ functional tests fail → zero competition score.

Changes:
1. registry.py: Add Qwen3_5MoeForCausalLM -> ('qwen3_5', 'Qwen3_5MoeForCausalLM')
2. Copy vllm_adapter/qwen3_5.py -> vllm/model_executor/models/qwen3_5.py
   so the registry's module resolution finds it.

The adapter (588 lines) implements:
- Qwen3_5MoeMLP, Qwen3_5MoeSparseMoeBlock (256 experts, top-8)
- Qwen3_5MoeAttention (with shared_expert support)
- Qwen3_5MoeDecoderLayer, Qwen3_5MoeModel, Qwen3_5MoeForCausalLM
- All imports use absolute paths (from vllm.xxx) + relative (.interfaces)
  which work correctly from vllm/model_executor/models/ directory.

CCCL context: agent_rle.cuh's streaming_context pattern — the model adapter
is the 'streaming context' that provides partition-specific information
(text_config, shared_expert, layer_types) to the generic MoE dispatch layer.

Competition: Basic award requires ALL 50+ functional tests to pass.
No one has achieved this yet. This registration is the prerequisite.
2026-08-06 04:26:19 +00:00
dylanyunlon
ef6abf3dc7 [DEPLOY] Complete submission: baseline + all optimizations
Adds ALL files needed for Dockerfile build:
  - qwen3_6_scripts/ (baseline patches + our optimizations)
  - vllm/ (full vllm package)
  - paged_attention_v2_pytorch.py (V2 with single-bmm optimization)
  - Dockerfile + computility-run.yaml

Our optimizations vs baseline:
  1. paged_attn.py: pre-gathered context KV (eliminates 194 gather calls),
     Triton try/fallback, V2 heuristic, threshold 32K→64K
  2. paged_attention_v2_pytorch.py: fills NotImplementedError,
     single-bmm Phase 1 (195 launches → 3)
  3. patch_enable_triton.py: HAS_TRITON=True with safety fallback
  4. patch_triton_tuning.py: BLOCK=64, NUM_WARPS=4 for BI-V100
  5. computility-run.yaml: gpu-memory-utilization 0.9→0.95,
     max-num-batched-tokens 8192→16384

This repo can now be submitted to dev.modelhub.org.cn as-is.
2026-07-30 16:06:20 +00:00