Ma Mingfei 5ad296bda1 Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

..

activation.cpp

…

bmm.cpp

…

CMakeLists.txt

[CPU] [FP8] set SGLANG_CPU_FP8_CVT_FTZ in CMakeLists.txt (#7885)

2025-07-09 01:53:53 -07:00

common.h

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

decode.cpp

Support non-contiguous query input for extend/decode attention (#7462)

2025-07-02 19:59:45 -07:00

extend.cpp

Support non-contiguous query input for extend/decode attention (#7462)

2025-07-02 19:59:45 -07:00

gemm_fp8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm_int8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm.h

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

interface.cpp

[CPU] remove process_group from inputs of shm_allreduce and shm_allgather (#7486)

2025-06-30 21:54:11 -07:00

moe_fp8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

moe_int8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

moe.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

norm.cpp

CPU: map changes from developing branch in sgl-kernel (#6833)

2025-06-10 01:08:15 -07:00

numa_utils.cpp

[CPU] add c++ kernel to bind CPU cores and memory node (#7524)

2025-06-29 19:45:25 -07:00

qkv_proj.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

rope.cpp

Add CPU optimized kernels for topk and rope fusions (#6456)

2025-06-02 17:37:34 -07:00

shm.cpp

CPU: map changes from developing branch in sgl-kernel (#6833)

2025-06-10 01:08:15 -07:00

shm.h

CPU: map changes from developing branch in sgl-kernel (#6833)

2025-06-10 01:08:15 -07:00

topk.cpp

[CPU][sgl-kernel] biased_grouped_topk: fix correction_bias dtype to float32 (#8212)

2025-08-04 18:28:31 -07:00

torch_extension_cpu.cpp

[CPU] [sgl-kernel] set dispatch key of initialize to CatchAll (#7734)

2025-07-02 22:39:24 -07:00

vec.h

[CPU][sgl-kernel] biased_grouped_topk: fix correction_bias dtype to float32 (#8212)

2025-08-04 18:28:31 -07:00