muh d70deefae1 [ENGINE] sampler.py: CCCL bit_packed_counter documentation + cache retention ...

Reference catch2_test_memcpy_bitpacked_counter.cu bit packing pattern.
Maintain int64 dtype (scatter_add_ CUDA requirement) but document the
future optimization path to int16 (4x memory reduction when supported).
Pre-allocation caching already in place from prior commit.

2026-08-06 01:00:46 +00:00

..

__pycache__

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

adapter_commons

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

assets

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

attention

[ENGINE] triton_flash_attention.py: CCCL make_warp_uniform autotune

2026-08-05 09:29:23 +00:00

compilation

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

core

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

distributed

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

engine

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

entrypoints

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

executor

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

inputs

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logging

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

lora

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

model_executor

[ENGINE] sampler.py: CCCL bit_packed_counter documentation + cache retention

2026-08-06 01:00:46 +00:00

multimodal

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

platforms

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

plugins

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

prompt_adapter

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

spec_decode

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

transformers_utils

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

triton_utils

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

usage

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

worker

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

__init__.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

_core_ext.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

_custom_ops.py

[v2] PARTITION_SIZE 512→1024 + fix import path

2026-08-05 03:32:23 +00:00

_ipex_ops.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

beam_search.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

block.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

config.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

connections.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

envs.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

forward_context.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

logger.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

outputs.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

pooling_params.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

py.typed

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sampling_params.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

scalar_type.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

scripts.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

sequence.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

tracing.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

utils.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00

version.py

[DEPLOY] Complete submission: baseline + all optimizations

2026-07-30 16:06:20 +00:00