project6 17720b5386 arch(core): translate CCCL cc_dispatch.cuh entire design into _HardwarePolicy
cc_dispatch.cuh is CCCL's runtime-hardware → compile-time-policy bridge:
  1. Detect device compute_capability at runtime
  2. policy_selector(cc) returns full kernel config
  3. lowest_cc_resolver merges identical policies across CCs
  4. dispatch_compute_cap bridges runtime → compile-time specialization

Translated as _HardwarePolicy class in qwen3_5.py:
  1. detect() probes BI-V100 capabilities once (SMEM, cuSOLVER, MoE ops)
  2. Returns deltanet_chunk_size, solve_triangular_available, moe_native_*
  3. All kernel code reads from _hw_policy instead of hardcoded constants
  4. MoE forward skips native attempt if hasattr() shows ops missing

Concrete changes:
  - DeltaNet chunk_size: hw_policy-selected (64 if solve_tri, 32 if not)
  - _forward_sub_lower: no per-call try/except, uses pre-detected flag
  - _DNN_CHUNK: reads from hw_policy
  - MoE native: hasattr() pre-check avoids exception on every layer init

CCCL source: cub/cub/detail/cc_dispatch.cuh (full file translation)
Maps to: qwen3_6_scripts/qwen3_5.py
2026-08-07 09:08:22 +00:00
2026-08-07 08:43:51 +00:00
2026-07-30 17:03:23 +08:00
2026-08-07 07:47:01 +00:00

project_6

Description
No description provided
Readme 427 MiB
Languages
C++ 41.8%
Cuda 31.6%
Python 22.2%
C 2.1%
CMake 1.1%
Other 1.1%