blzheng 13fb8b5489 [CPU] Optimize FP16 decode_attention_cpu (#10652)

2025-10-22 21:39:51 -07:00

..

activation.cpp

[CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300)

2025-09-08 23:23:13 -07:00

bmm.cpp

[CPU] Fix build issue (#6419)

2025-05-21 11:17:10 -07:00

CMakeLists.txt

[CPU] [FP8] set SGLANG_CPU_FP8_CVT_FTZ in CMakeLists.txt (#7885)

2025-07-09 01:53:53 -07:00

common.h

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

decode.cpp

[CPU] Optimize FP16 decode_attention_cpu (#10652)

2025-10-22 21:39:51 -07:00

extend.cpp

Support non-contiguous query input for extend/decode attention (#7462)

2025-07-02 19:59:45 -07:00

gemm_fp8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm_int8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm.h

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

interface.cpp

[CPU] remove process_group from inputs of shm_allreduce and shm_allgather (#7486)

2025-06-30 21:54:11 -07:00

moe_fp8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

moe_int8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

moe.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

norm.cpp

CPU: map changes from developing branch in sgl-kernel (#6833)

2025-06-10 01:08:15 -07:00

numa_utils.cpp

[CPU] add c++ kernel to bind CPU cores and memory node (#7524)

2025-06-29 19:45:25 -07:00

qkv_proj.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

rope.cpp

Add CPU optimized kernels for topk and rope fusions (#6456)

2025-06-02 17:37:34 -07:00

shm.cpp

CPU: map changes from developing branch in sgl-kernel (#6833)

2025-06-10 01:08:15 -07:00

shm.h

CPU: map changes from developing branch in sgl-kernel (#6833)

2025-06-10 01:08:15 -07:00

topk.cpp

[CPU][sgl-kernel] biased_grouped_topk: fix correction_bias dtype to float32 (#8212)

2025-08-04 18:28:31 -07:00

torch_extension_cpu.cpp

[CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300)

2025-09-08 23:23:13 -07:00

vec.h

[CPU] Optimize FP16 decode_attention_cpu (#10652)

2025-10-22 21:39:51 -07:00