Szymon Ożóg 8cbf71dc2d Triton 3.4.0 MoE config for Deepseek TP16 H100 (#9978)

2025-09-03 13:16:16 -07:00

..

ep_moe

Change tensor alignment method to mn major (#9844)

2025-09-02 01:23:13 -07:00

fused_moe_triton

Triton 3.4.0 MoE config for Deepseek TP16 H100 (#9978)

2025-09-03 13:16:16 -07:00

moe_runner

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

token_dispatcher

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

__init__.py

Add fp4 quantize before all-gather for Flashinfer cutlass MoE DP (max throughput) (#7667)

2025-08-15 22:08:11 -07:00

cutlass_moe_params.py

[CUTLASS-FP4-MOE] Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887)

2025-06-05 13:13:14 -07:00

cutlass_moe.py

move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679)

2025-08-27 03:34:29 -07:00

cutlass_w4a8_moe.py

[feat] Support tp mode for DeepSeek-R1-W4AFP8 (#8118)

2025-09-01 22:17:26 -07:00

fused_moe_native.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

rocm_moe_utils.py

[AMD] Fix Llama 4 FP8 accuracy issues on MI300X (#7699)

2025-08-22 13:13:45 -07:00

router.py

Update grok.py and tiktoken tokenizer (#9532)

2025-08-23 05:40:18 -07:00

topk.py

[Model] Support Meituan LongCat-Flash && LongCat-Flash-MTP (#9824)

2025-08-30 23:29:21 -07:00

utils.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00