dylanyunlong/project_6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
daa8067080c1a82bcd919d796e2397c6a477f61c
project_6/qwen3_6_scripts
History
project6-dev 4c365b8c03 feat(CCCL): device-level CUB algorithms for MoE dispatch 
Add complete CCCL CUB header tree (1394 files) to cccl_preload/include/:
- cub/device/ — DeviceRadixSort, DeviceScan, DeviceHistogram, DeviceReduce, DeviceSelect
- cub/agent/ — all agent implementations (sort, scan, reduce, histogram, etc)
- cub/block/ — BlockScan, BlockReduce, BlockExchange, BlockLoad, BlockStore, etc
- cub/warp/ — WarpScan, WarpReduce, WarpExchange, WarpMergeSort
- cub/thread/ — thread-level operators
- thrust/ — sort_by_key, iterator utilities
- cuda/ — execution, stream, memory_resource, functional

New kernel: cccl_moe_sort_scatter.cu
- Uses CUB DeviceRadixSort::SortPairs to sort (expert_id, token_idx) pairs
- O(n) radix sort replaces O(n log n) torch.argsort in MoE prefill path
- Boundary detection + fill for expert offsets/sizes
- Compiled against CCCL upstream headers (not corex CUB) to avoid BI-V100 bugs

Previously only 288 CCCL headers (CachingDeviceAllocator only).
Now 1394 headers — full CUB device-level algorithm stack available for
all future kernels.
2026-08-13 11:18:52 +00:00
..
cccl_preload
feat(CCCL): device-level CUB algorithms for MoE dispatch
2026-08-13 11:18:52 +00:00
prebuilt/corex-3.2.3-ivcore10
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
qwen3_5
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
qwen3_5_moe
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
reasoning
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
vendor_overrides/vllm
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
wheels
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
api_server.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
bi100_env.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
bi100_profile.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
block_major_kv_cache.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_cccl_moe_sort_scatter.sh
feat(CCCL): device-level CUB algorithms for MoE dispatch
2026-08-13 11:18:52 +00:00
build_corex_attn_head_rms_norm.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_fused_paged_prefill_split4.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_beta_decay.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_causal_conv.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_chunk_recurrent.sh
feat: C++ GDN chunk+recurrent from xllm upstream + verification script
2026-08-13 04:01:59 +00:00
build_corex_gdn_gated_norm.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_packed_decode.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_gdn_qk_map.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_moe_direct_routed.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_moe_exact_reduce.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_moe_index_combine.sh
feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream
2026-08-13 03:48:12 +00:00
build_corex_moe_topk_softmax.sh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
build_corex_moe_weight_gather.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
build_corex_paged_kv_gather.sh
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
cccl_moe_sort_scatter.cu
feat(CCCL): device-level CUB algorithms for MoE dispatch
2026-08-13 11:18:52 +00:00
chat_utils.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
cli_args.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_attn_head_rms_norm.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_block_major_kv_transfer.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_fused_paged_prefill_split4.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_beta_decay.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_causal_conv.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_chunk_recurrent.cu
feat: C++ GDN chunk+recurrent from xllm upstream + verification script
2026-08-13 04:01:59 +00:00
corex_gdn_gated_norm.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_packed_decode.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_gdn_qk_map.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_moe_direct_routed.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_moe_exact_reduce.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_moe_index_combine.cu
feat: moe_compute_index + moe_combine_result CUDA kernels from xllm upstream
2026-08-13 03:48:12 +00:00
corex_moe_topk_softmax.cu
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
corex_moe_weight_gather.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_paged_kv_gather.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
corex_query_tiled_paged_prefill.cu
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
device_utils.cuh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
gdn_prefix.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
install_prebuilt_corex.sh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
mamba_cache.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
moe_topk_sigmoid_kernels.cuh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
moe_topk_softmax_kernels.cuh
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
paged_attn.py
perf: native ixformer decode — v1 ≤32K, v2 >32K (no Python fallback)
2026-08-13 07:09:50 +00:00
patch_block_major_cache_engine.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_block_major_worker_capacity.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_block_manager_cache_trace.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_corex_swap_blocks.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_executor_startup_debug.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_model_runner.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_ops.sh
build: wire CCCL preload into competition pipeline
2026-08-13 10:31:33 +00:00
patch_transformers_qwen3_5.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_utils.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_vllm_qwen3_5.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_vllm_tool_parser.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_worker_cache_transfer_order.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_worker_profile_override.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_worker_startup_profile_guard.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_profile.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_sdpa_batch_kernel.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_sdpa_batch.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_sdpa_seq_kernel.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
patch_xformers_sdpa_seq.py
perf: replace Python Q-tiling fallback with ixformer.flash_attn_varlen_func
2026-08-13 05:14:08 +00:00
protocol.py
fix(critical): fold max_completion_tokens + max_num_seqs=2 + max_model_len=80000 + xllm_latest layer import
2026-08-13 03:19:39 +00:00
qwen3_5.py
feat: wire corex_gdn_chunk_recurrent C++ kernel into GDN prefill path
2026-08-13 06:25:09 +00:00
qwen3coder_tool_parser.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
scheduler.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
sequence.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00
serving_chat.py
fix: topk_softmax .so + fp32 router + enforce_eager + comp168 params
2026-08-12 11:14:01 +00:00
serving_tokenization.py
feat: 替换为 project_7 验证通过的 wudixzy stack
2026-08-12 03:31:05 +00:00