dylanyunlong/project_6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Commit Graph

  • 3d0f4392c7 [ENGINE] model_runner.py: CCCL CachingDeviceAllocator pattern — reduce CUDA graph capture from 1028→19 sizes dylanyunlon 2026-08-07 01:59:18 +00:00
  • 79621cf8af feat(xformers): replace Q-only tiling with Q+KV tiling + online softmax muh-bot 2026-08-07 01:54:48 +00:00
  • 8d0551c113 [ENGINE] attention.py: CCCL dispatch_reduce.cuh single-tile decision for V1/V2 dylanyunlon 2026-08-07 01:54:40 +00:00
  • 01a4e136b7 [ENGINE] attention.py: apply 3 CCCL patterns from dispatch_reduce.cuh + agent_reduce.cuh + grid_even_share.cuh dylanyunlon 2026-08-07 01:53:58 +00:00
  • 1f1067b1de docs: add PIPELINE_STATUS.md — ground truth for muh injection mapping and toolchain status muh-bot 2026-08-07 01:45:39 +00:00
  • d9548d397d [analysis] CCCL↔muh 26-algorithm tuning gap report — 294 bench pts needed, 19% line coverage, reduce/scan/topk P0 dylanyunlon 2026-08-07 01:45:37 +00:00
  • c8d79e2b02 sync: update cccl_upstream benchmarks to latest NVIDIA/cccl main muh-bot 2026-08-07 01:32:29 +00:00
  • d15dcea7c6 [ENGINE] port SDPA fallback for head_dim>128 to base xformers backend Dylan 2026-08-07 01:24:04 +00:00
  • 4ca0115af7 [ENGINE] apply CCCL CacheAsyncConfiguration pattern to activation/layernorm Dylan 2026-08-07 01:22:17 +00:00
  • 951afd0c02 [ENGINE] apply CCCL GridEvenShare dispatch pattern to V1/V2 attention decision Dylan 2026-08-07 01:19:50 +00:00
  • 5ba9c1e731 [CRITICAL/deploy] fix 3 deployment gaps found from docker crash log dylanyunlon 2026-08-06 07:01:14 +00:00
  • b075b015b1 [CRITICAL/deploy] fix Docker build: add bash shebang to patch_ops.sh + robust Dockerfile dylanyunlon 2026-08-06 06:44:31 +00:00
  • a667d2e914 [fix/deploy] patch_ops.sh: resilient pip install with fallback muh 2026-08-06 06:35:37 +00:00
  • cf245adff9 [fix/correctness] mamba_cache: safe swap via clone, not in-place fancy indexing muh 2026-08-06 06:33:21 +00:00
  • 32fd4299b3 [test+engine] 18→21 test cases + CCCL-informed improvements dylanyunlon 2026-08-06 06:33:18 +00:00
  • b7226efcb4 [critical/deploy] computility-run.yaml: quote numeric env values for YAML safety muh 2026-08-06 06:29:38 +00:00
  • 065f5fd13a [muh/scan] rewrite tuning_scan.cuh: 27%→42% CCCL parity dylanyunlon 2026-08-06 06:19:59 +00:00
  • 86d6c9f6c2 [critical/config] baseline.muh: sync from computility-run.yaml — was stale muh 2026-08-06 06:12:51 +00:00
  • 9203e7b09e [critical/deploy] sync root paged_attn.py + prefix_prefill.py → qwen3_6_scripts/ muh 2026-08-06 06:10:52 +00:00
  • 9a7fd70150 [CRITICAL/base] Register qwen3_coder tool parser as hermes alias muh-bot 2026-08-06 06:10:43 +00:00
  • b73c8ea60b [test] verify_functional.py: 13→18 test cases, fix missing TC-11/12 registration muh 2026-08-06 06:05:19 +00:00
  • 0cfdb6ae5d [docs] CCCL ↔ EngineX architecture alignment — from reading 3792 CCCL source files muh 2026-08-06 06:02:40 +00:00
  • 7552365c7f [perf/decode] paged_attn: CCCL GridEvenShare-informed tile sizing muh 2026-08-06 06:00:52 +00:00
  • 2ee9571575 [muh/pipeline] derive_injection.py: bridge CCCL struct fields → vllm runtime injection muh 2026-08-06 05:56:28 +00:00
  • b446763c2d [CRITICAL/base] cli_args.py: add --reasoning-parser stub to prevent server startup crash muh-bot 2026-08-06 05:22:54 +00:00
  • 9fda58f7cd [CRITICAL] computility-run.yaml: add all corex env vars + align with proven job66 config Claude 2026-08-06 04:27:35 +00:00
  • 08dc010a15 [CRITICAL/base] Register Qwen3_5MoeForCausalLM in model registry + copy adapter to models/ muh-bot 2026-08-06 04:26:19 +00:00
  • d8d435c7d0 [BASE] cache_engine.py: CCCL temporary_storage layout two-phase KV cache allocation Claude 2026-08-06 04:22:53 +00:00
  • 34b3a4a617 [BASE] block_table.py: CCCL dispatch_select_if alias_temporaries batch allocation Claude 2026-08-06 04:22:02 +00:00
  • 4eb83a7ee4 [BASE] activation.py SiluAndMul: CCCL dispatch_transform CacheAsyncConfiguration output tensor caching Claude 2026-08-06 04:17:59 +00:00
  • 322f5553e1 [base/sampler] CCCL dispatch_merge_sort alias_temporaries: eliminate .repeat() allocation in _apply_penalties muh-bot 2026-08-06 04:14:11 +00:00
  • 1064ce756b [base/sampler] CCCL dispatch_topk alias_temporaries: fix _sampler_cache bug + pre-allocate temp storage muh-bot 2026-08-06 04:13:03 +00:00
  • dd59ec95c2 [ENGINE] prefix_caching_block: CCCL DeviceCopy::Batched 3-phase swap_in/swap_out Claude 2026-08-06 04:12:19 +00:00
  • 5aba296eba [muh] gen_patch: expand VLLM_INJECTION_POINTS to full real injection surface muh-bot 2026-08-06 04:01:40 +00:00
  • bf5d19991c [FIX] qwen3_5.py: replace solve_triangular with manual forward substitution muh-bot 2026-08-06 03:02:23 +00:00
  • b4803c3259 [BASE] qwen3_6_scripts/sampler.py: CCCL topk unsorted output optimization muh-pipeline 2026-08-06 02:55:51 +00:00
  • f59d30dcb2 [BASE] qwen3_6_scripts/paged_attn.py: CCCL shifted_output defensive init muh-pipeline 2026-08-06 02:53:07 +00:00
  • 8056641f08 [BASE] qwen3_6_scripts/xformers.py: CCCL block_load_to_shared pre-alloc pattern muh-pipeline 2026-08-06 02:51:48 +00:00
  • 2d1588d261 [BASE] qwen3_6_scripts/sampler.py: CCCL dispatch_topk DoubleBuffer pattern muh-pipeline 2026-08-06 02:38:51 +00:00
  • e784910d47 [ENGINE] Pattern 7: CCCL C API JIT → Triton autotune mapping muh-bot 2026-08-06 02:32:34 +00:00
  • da553227e9 [BASE] qwen3_6_scripts/verify_functional.py: add CCCL-derived boundary tests muh-pipeline 2026-08-06 02:30:42 +00:00
  • 6c472d640f [ENGINE] CCCL system-level patterns → BI-V100 engine module muh-bot 2026-08-06 02:30:15 +00:00
  • 6148e03bc7 [BASE] vllm/core/evictor_v2.py: CCCL bucket_sort2d design pattern annotation muh-pipeline 2026-08-06 02:29:19 +00:00
  • b6538fd10e [BASE] vllm/attention/ops/paged_attn.py: fix num_kv_heads type annotation muh-pipeline 2026-08-06 02:28:12 +00:00
  • a7e0ef1138 [ENGINE] scan tuning: document GridThreshold=500 gate from CCCL source muh-pipeline 2026-08-06 02:22:13 +00:00
  • edccbb00b4 [ENGINE] paged_attention_v2: CCCL single-tile fast path + GridEvenShare constants muh-pipeline 2026-08-06 02:21:23 +00:00
  • 9c723eeb29 [DOC] GROUND_TRUTH_STATUS v2 — based on complete code reading muh-bot 2026-08-06 02:21:03 +00:00
  • 11cbc00cf2 [DOCS] CCCL benchmark reference: 199 annotations from 27 tuning files extracted muh-pipeline 2026-08-06 02:16:33 +00:00
  • dedf08166a [CCCL] Add missing CCCL components: c2h, nvbench_helper, cmake, cudax, AGENTS.md muh-bot 2026-08-06 02:14:18 +00:00
  • b0d597363a [BUGFIX] qwen3_6_scripts/model_runner.py: fix max_decode_seq_len (deployment version) muh-engine 2026-08-06 01:41:49 +00:00
  • dac9aa46f5 [BUGFIX] vllm/worker/model_runner.py: fix max_decode_seq_len passed as max_encoder_seq_len muh-engine 2026-08-06 01:19:51 +00:00
  • 29f119c094 [ENGINE] vllm/attention/ops/paged_attn.py: CCCL block_reduce_raking V1/V2 dispatch muh-engine 2026-08-06 01:18:34 +00:00
  • e3f85e79ee [DEPLOY] sync qwen3_6_scripts/ with latest engine changes for submission muh 2026-08-06 01:04:55 +00:00
  • b80fd2b56b [ENGINE] paged_attn V2: CCCL agent_merge_sort union TempStorage cache muh-engine 2026-08-06 01:04:01 +00:00
  • 0d810ff989 [ENGINE] muh_cc_dispatch + analysis: max_num_seqs=1 from computility-run.yaml muh-engine 2026-08-06 01:02:15 +00:00
  • d70deefae1 [ENGINE] sampler.py: CCCL bit_packed_counter documentation + cache retention muh 2026-08-06 01:00:46 +00:00
  • 082ded7d69 [ENGINE] xformers.py: CCCL GQA broadcast eliminates 6x repeat_interleave in sdpa_fallback muh 2026-08-06 00:59:40 +00:00
  • c7d3da7922 [ENGINE] sampler.py: CCCL counting_iterator tensor reuse pattern muh-engine 2026-08-06 00:15:02 +00:00
  • 50c731412a [INSIGHT] tuning_scan: gridDim.x < 500 makes ALL delay policies equivalent on BI-V100 muh 2026-08-05 09:32:21 +00:00
  • 28b4701935 [ENGINE] paged_attn: CCCL spread_out_items_per_thread adaptive tile sizing muh 2026-08-05 09:31:11 +00:00
  • 5fbcfff7f3 [ENGINE] fused_moe.py: CCCL kernel_transform_tile assume_divisible muh-engine 2026-08-05 09:30:53 +00:00
  • 18c42c099d [ENGINE] triton_flash_attention.py: CCCL make_warp_uniform autotune muh-engine 2026-08-05 09:29:23 +00:00
  • c0395ade14 [ENGINE] muh_cc_dispatch.py: CCCL cc_dispatch.cuh Python port muh-engine 2026-08-05 09:25:48 +00:00
  • 8c969ce7dc [ENGINE] paged_attn.py: CCCL dispatch_reduce architecture port muh-engine 2026-08-05 09:22:46 +00:00
  • 821c59500d [CLEANUP] Remove 13 dead patch scripts — only 1 remains (transformers registration) dylanyunlon 2026-08-05 08:39:54 +00:00
  • b902090fb2 [FIX] Deploy _custom_ops.py SMEM 32KB→48KB fix — was in repo but never deployed dylanyunlon 2026-08-05 08:38:36 +00:00
  • 81972a05c6 [CCCL-PORT] Three-tier decode dispatch from kernel_segmented_reduce.cuh Claude 2026-08-05 08:38:15 +00:00
  • f3810c53ae [ARCH] Eliminate 2 more patch scripts — registry.py + tool_parsers __init__.py dylanyunlon 2026-08-05 08:36:45 +00:00
  • 503009596d [CCCL-PORT] CachingDeviceAllocator buffer reuse in prefix attention tile loop Claude 2026-08-05 08:36:10 +00:00
  • 8cdac642de [CCCL-PORT] Functional verification from three_way_partition test pattern + sampler deploy dylanyunlon 2026-08-05 08:31:48 +00:00
  • 6d0965195c [CCCL-PORT] Try native FusedMoE kernel before PyTorch fallback Claude 2026-08-05 08:31:31 +00:00
  • 44bdf49cae [CCCL-PORT] Deploy sampler.py top-k fast path from partition/flagged.cu dylanyunlon 2026-08-05 08:30:21 +00:00
  • 327f9fbf40 [ARCH] Eliminate AST patch scripts — full file replacements only dylanyunlon 2026-08-05 08:24:38 +00:00
  • 10af71357b [CCCL-PORT] Two architecture-level optimizations from CCCL system design Claude 2026-08-05 08:19:55 +00:00
  • 0b94081051 [FIX] Sync paged_attn.py to qwen3_6_scripts/ — Docker COPY target dylanyunlon 2026-08-05 08:16:29 +00:00
  • 269f6eebba [CCCL-PORT] summary_statistics.cu transform_reduce pattern → online softmax design doc dylanyunlon 2026-08-05 08:12:12 +00:00
  • 1a4e100583 [CCCL-PORT] agent_reduce vectorized load pattern + explicit memory management dylanyunlon 2026-08-05 08:11:19 +00:00
  • f7f8113c73 [CCCL-PORT] Adaptive tile sizing from dispatch_reduce.cuh GridEvenShare dylanyunlon 2026-08-05 08:10:29 +00:00
  • 15753cb68d [STATUS] Ground truth: gen_patch C++ injection dead, real path is Triton+Python tuning dylanyunlon 2026-08-05 07:57:53 +00:00
  • 96f64650cf [CRITICAL] yaml 恢复到基础引擎原版——先通过功能测试再优化性能 muh-bot 2026-08-05 07:47:07 +00:00
  • 5e618bf480 [housekeeping] add enginex_base/ to gitignore — 解压后的基础引擎仅供本地分析 muh-bot 2026-08-05 07:17:37 +00:00
  • a7a72e496c Merge branch 'main' of https://github.com/dylanyunlon/project_6 muh-bot 2026-08-05 07:14:27 +00:00
  • a7f95a5943 [SIMPLIFY] Dockerfile 恢复到基础引擎原版 4 行——所有适配通过 patch_ops.sh muh-bot 2026-08-05 07:14:23 +00:00
  • 3426d8185a [muh_dispatch] 修正 head_dim=128→256 + 删除死代码 + 强制 V1 muh-bot 2026-08-05 07:12:26 +00:00
  • f3a4e7ecfe [CRITICAL] Restore original enginex paged_attn.py — Triton kernel hangs BI-V100 project_6 2026-08-05 07:11:59 +00:00
  • cfa6516cc6 [BUGFIX] patch_paged_attention_v2.py: NameError V2_MODULE undefined → V2_MODULE_PYTORCH muh-bot 2026-08-05 07:07:54 +00:00
  • fd2ff241fb [perf] sampler: fast path for top_k without top_p — torch.topk replaces full sort Claude 2026-08-05 06:32:35 +00:00
  • 8070690aac [perf] MoE align_block_size: pre-allocate sort buffers, eliminate 192 CUDA mallocs/step Claude 2026-08-05 06:31:11 +00:00
  • 730831f267 [fix] paged_attn: re-force V1 — V2 is pure PyTorch, not C++ (confirmed from _custom_ops.py) Claude 2026-08-05 06:27:17 +00:00
  • b6e7bca45a [perf] paged_attn: restore V1/V2 adaptive dispatch + V2 tensor pre-alloc + PARTITION_SIZE 512→1024 Claude 2026-08-05 06:26:16 +00:00
  • d3b110803c [perf] MoE intermediate cache pre-allocation: eliminate 189 CUDA mallocs per decode step project_6 2026-08-05 03:58:46 +00:00
  • 4e16133c7a [analysis] MoE execution path: 640+ kernel launches/step, 192 CUDA mallocs/step project_6 2026-08-05 03:58:06 +00:00
  • afb5d23b12 [v2] document CCCL kernel_reduce.cuh SingleTile + scan GridThreshold=500 insights muh-bot 2026-08-05 03:57:25 +00:00
  • 60f0e2a61c [CRITICAL] Force V1 decode: PyTorch V2 is 10-50x slower than ixformer V1 muh-bot 2026-08-05 03:56:54 +00:00
  • 5ca49d0e7c [docs] GridEvenShare work distribution — BI-V100 attention reduce needs only 9 CTAs project_6 2026-08-05 03:36:44 +00:00
  • ce42a8579d [gen_patch] Replace dead .cu injection points with real Triton/config targets project_6 2026-08-05 03:36:33 +00:00
  • c17e517e9e [docs] CCCL transform architecture — vectorized vs prefetch, bytes_in_flight scope project_6 2026-08-05 03:36:00 +00:00
  • 5d6f159906 [v2] Phase 2 kernel fusion: save 1 division launch + CCCL sources read project_6 2026-08-05 03:35:10 +00:00
  • e36da2efa9 [docs+code] lookback delay is a no-op on BI-V100 + V2 compound reduce pattern project_6 2026-08-05 03:35:06 +00:00
  • 162a45d4ea [muh_kernel_map] fix syntax error + add bytes_in_flight from CCCL babelstream benchmark muh-bot 2026-08-05 03:34:08 +00:00