Ke Bao 85b2e05770 Add int8 quant kernel (#2848)

2025-01-13 13:16:58 +08:00

..

decoding_attention_triton

benchmark decoding attention kernel with cudnn (#2467)

2024-12-17 03:31:57 -08:00

fused_moe_triton

Misc fix for min_p_sampling, --cuda-graph-bs (#2761)

2025-01-07 02:52:53 -08:00

quantization

Add int8 quant kernel (#2848)

2025-01-13 13:16:58 +08:00

rmsnorm

[Benchmark] add a benchmark for hf/vllm/sglang rmsnorm (#2486)

2024-12-15 13:52:08 +08:00

scheduler_batch

[kernel optimize] benchmark write_req_to_token_pool_triton and optimize kernel (#2509)

2024-12-22 02:31:02 -08:00