project6-dev 4c365b8c03 feat(CCCL): device-level CUB algorithms for MoE dispatch ...

Add complete CCCL CUB header tree (1394 files) to cccl_preload/include/:
- cub/device/ — DeviceRadixSort, DeviceScan, DeviceHistogram, DeviceReduce, DeviceSelect
- cub/agent/ — all agent implementations (sort, scan, reduce, histogram, etc)
- cub/block/ — BlockScan, BlockReduce, BlockExchange, BlockLoad, BlockStore, etc
- cub/warp/ — WarpScan, WarpReduce, WarpExchange, WarpMergeSort
- cub/thread/ — thread-level operators
- thrust/ — sort_by_key, iterator utilities
- cuda/ — execution, stream, memory_resource, functional

New kernel: cccl_moe_sort_scatter.cu
- Uses CUB DeviceRadixSort::SortPairs to sort (expert_id, token_idx) pairs
- O(n) radix sort replaces O(n log n) torch.argsort in MoE prefill path
- Boundary detection + fill for expert offsets/sizes
- Compiled against CCCL upstream headers (not corex CUB) to avoid BI-V100 bugs

Previously only 288 CCCL headers (CachingDeviceAllocator only).
Now 1394 headers — full CUB device-level algorithm stack available for
all future kernels.

2026-08-13 11:18:52 +00:00

..

detail

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

iterator

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

mr

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

system

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

type_traits

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

adjacent_difference.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

binary_search.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

copy.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

count.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

device_allocator.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

device_free.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

device_malloc.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

device_ptr.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

device_reference.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

device_vector.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

equal.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

execution_policy.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

extrema.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

fill.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

find.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

for_each.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

functional.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

generate.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

host_vector.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

memory.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

merge.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

mismatch.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

partition.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

reduce.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

remove.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

replace.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

reverse.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

scan.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

scatter.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

sequence.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

sort.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

swap.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

system_error.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

tabulate.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

transform_reduce.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

transform.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

uninitialized_fill.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

unique.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

version.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00

zip_function.h

feat(CCCL): device-level CUB algorithms for MoE dispatch

2026-08-13 11:18:52 +00:00