muh d70deefae1 [ENGINE] sampler.py: CCCL bit_packed_counter documentation + cache retention ...

Reference catch2_test_memcpy_bitpacked_counter.cu bit packing pattern.
Maintain int64 dtype (scatter_add_ CUDA requirement) but document the
future optimization path to int16 (4x memory reduction when supported).
Pre-allocation caching already in place from prior commit.

2026-08-06 01:00:46 +00:00

..

__pycache__

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

fused_moe

[ENGINE] fused_moe.py: CCCL kernel_transform_tile assume_divisible

2026-08-05 09:30:53 +00:00

mamba

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

quantization

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

__init__.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

activation.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

layernorm.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

linear.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logits_processor.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

pooler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

rejection_sampler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

resampler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

rotary_embedding.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sampler.py

[ENGINE] sampler.py: CCCL bit_packed_counter documentation + cache retention

2026-08-06 01:00:46 +00:00

spec_decode_base_sampler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

typical_acceptance_sampler.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

vocab_parallel_embedding.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00