fzyzcjy c6d549e773 Multiple tiny code cleanups (#4608)

2025-03-22 22:39:11 -07:00

..

ep_moe

Multiple tiny code cleanups (#4608)

2025-03-22 22:39:11 -07:00

fused_moe_triton

Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418)

2025-03-17 00:03:43 -07:00

fused_moe_native.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

router.py

Add some fused elementwise kernels for grok-1 (#4398)

2025-03-13 13:39:10 -07:00

topk.py

Revert "feat: update grouped_topk to support softmax and sigmoid" (#4505)

2025-03-17 11:30:26 -07:00