Chunan Zeng 65c24c28f9 [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

..

__init__.py

[Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

allreduce.py

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

attention.py

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

elementwise.py

Optimize rope in sgl kernel (#4267)

2025-03-10 10:07:45 -07:00

gemm.py

[Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

moe.py

Add moe topk softmax templated from vllm (#4302)

2025-03-14 12:03:33 -07:00

sampling.py

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

speculative.py

Add greedy verification kernel (#4383)

2025-03-16 00:58:26 -07:00

utils.py

Rename files in sgl kernel to avoid nested folder structure (#4213)

2025-03-08 22:54:51 -08:00

version.py

bump v0.0.5.post3 (#4520)

2025-03-17 13:05:59 -07:00